-- Logs begin at Thu 2021-12-16 13:46:27 UTC, end at Thu 2021-12-16 15:02:05 UTC. -- Dec 16 14:21:21.298592 dv-cinder-821892-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Dec 16 14:21:21.306519 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Dec 16 14:21:21.308533 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Dec 16 14:21:21 2021] *** Dec 16 14:21:21.308533 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 16 14:21:21.308533 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 16 14:21:21.308533 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: nodename: dv-cinder-821892-3-iscsi Dec 16 14:21:21.308533 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: machine: x86_64 Dec 16 14:21:21.308533 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: clock source: unix Dec 16 14:21:21.308533 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: pcre jit disabled Dec 16 14:21:21.308533 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: detected number of CPU cores: 4 Dec 16 14:21:21.308533 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: current working directory: / Dec 16 14:21:21.308533 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: detected binary path: /usr/bin/uwsgi-core Dec 16 14:21:21.309248 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: your processes number limit is 47680 Dec 16 14:21:21.309248 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: your memory page size is 4096 bytes Dec 16 14:21:21.309248 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: detected max file descriptor number: 2048 Dec 16 14:21:21.309248 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: lock engine: pthread robust mutexes Dec 16 14:21:21.309248 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: thunder lock: enabled Dec 16 14:21:21.311303 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Dec 16 14:21:21.311303 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 16 14:21:21.350690 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: Python main interpreter initialized at 0x560253a719c0 Dec 16 14:21:21.350690 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: python threads support enabled Dec 16 14:21:21.350690 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: your server socket listen backlog is limited to 100 connections Dec 16 14:21:21.350690 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: your mercy for graceful operations on workers is 90 seconds Dec 16 14:21:21.351080 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: mapped 403077 bytes (393 KB) for 2 cores Dec 16 14:21:21.351158 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: *** Operational MODE: preforking *** Dec 16 14:21:21.351414 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: *** uWSGI is running in multiple interpreter mode *** Dec 16 14:21:21.351414 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: spawned uWSGI master process (pid: 67581) Dec 16 14:21:21.351635 dv-cinder-821892-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Dec 16 14:21:21.354326 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: spawned uWSGI worker 1 (pid: 67594, cores: 1) Dec 16 14:21:21.354326 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: spawned uWSGI worker 2 (pid: 67595, cores: 1) Dec 16 14:21:21.354326 dv-cinder-821892-3-iscsi devstack@keystone.service[67581]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 16 14:21:26.210713 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 14:21:26.210713 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: from cryptography.utils import int_from_bytes Dec 16 14:21:26.211472 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 14:21:26.211472 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: from cryptography.utils import int_from_bytes Dec 16 14:21:26.211577 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 14:21:26.211577 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: from cryptography.utils import int_from_bytes Dec 16 14:21:26.211971 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 14:21:26.211971 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: from cryptography.utils import int_from_bytes Dec 16 14:21:26.261547 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:21:26.261754 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 16 14:21:26.261928 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:21:26.262030 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] command line args: [] {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 16 14:21:26.262117 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 16 14:21:26.262198 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 16 14:21:26.262304 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] command line args: [] {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 16 14:21:26.262403 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ================================================================================ {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 16 14:21:26.262583 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 16 14:21:26.262727 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] admin_token = **** {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.262867 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ================================================================================ {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 16 14:21:26.262992 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] config_dir = [] {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.263117 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] admin_token = **** {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.263242 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.263242 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] config_source = [] {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.263380 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] config_dir = [] {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.263464 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] debug = True {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.263555 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.263636 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.264897 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] config_source = [] {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.264897 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] debug = True {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.265029 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.265091 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.265174 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] insecure_debug = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.265239 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.265298 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.265364 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] insecure_debug = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.265423 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.265480 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.265536 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] list_limit = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.265592 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.265656 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] log_config_append = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.265723 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] list_limit = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.265785 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.265844 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] log_config_append = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.265905 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] log_dir = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.265969 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.266035 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] log_file = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.266099 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] log_dir = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.266163 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.266226 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] log_file = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.266290 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.266353 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.266429 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.266489 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.266551 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.266623 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.266682 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.266745 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.266812 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.266872 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.266935 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.266999 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.267231 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.267310 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.267382 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.267480 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.267627 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.267706 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.267823 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.267942 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.268030 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.268180 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.268311 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.268418 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.268671 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.268757 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] notification_format = cadf {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.268948 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] notification_format = cadf {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.269162 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.269249 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.270195 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.270298 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.270373 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] publish_errors = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.270493 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] publish_errors = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.270636 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.270712 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.270824 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.270941 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.271032 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.271104 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.271239 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.271337 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.271474 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.271569 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.271711 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] standard_threads = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.271804 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] standard_threads = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.271944 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] strict_password_check = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.272028 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] strict_password_check = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.272191 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.272270 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.272347 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] use_eventlog = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.272426 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] use_eventlog = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.272526 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] use_journal = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.272604 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] use_journal = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.272701 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] use_json = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.272807 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] use_json = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.272893 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] use_stderr = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.272976 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] use_stderr = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.273049 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] use_syslog = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.273174 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] use_syslog = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.273282 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] watch_log_file = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.273364 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] watch_log_file = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:21:26.273542 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.273696 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.273776 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.273847 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.274032 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.274117 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.274273 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.274360 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.274527 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.274603 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.274763 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.274846 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.275013 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.275091 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.275249 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.275333 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.275501 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.275578 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.275748 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.275827 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.276002 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.276087 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.276238 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.276316 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.276497 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.276582 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.276746 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.276857 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.277009 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.277093 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.277266 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.277353 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.277533 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.277611 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.277795 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.277881 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.278048 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.278127 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.278282 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.278359 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.278514 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.278598 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.278745 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.278832 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.278979 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.279057 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.279230 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.279306 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.279487 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.279568 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.279717 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.279793 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.279950 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.280026 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.280198 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.280276 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.280453 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.280538 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.280692 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.280770 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.280967 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.281047 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.281202 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.281278 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.281439 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.281515 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.281670 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.281754 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.281900 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.281982 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.282132 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.282210 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.282363 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.282440 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.282590 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.282667 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.282828 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.282904 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.283080 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.283164 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.283313 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.283389 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.283546 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.283628 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.283778 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.283856 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.284012 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.284095 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.284249 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.284354 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.284497 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.284606 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.284730 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.284856 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.284992 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.285107 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.285258 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.285363 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.286055 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.286145 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.286300 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.286394 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.286541 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.286619 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.286777 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.286867 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.287032 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.287120 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.287274 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.287401 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.287509 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.287594 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.287743 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.287831 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.288007 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.288086 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.288245 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.288322 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.288475 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.288561 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.288713 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.288812 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.288973 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.289054 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.289240 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.289327 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.289478 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.289568 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.289729 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.289806 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.289965 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.290043 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.290213 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] cache.enabled = True {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.290299 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] cache.enabled = True {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.290455 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.290533 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.290694 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.290770 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.290927 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.291013 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.291165 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.291242 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.291398 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.291475 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.291636 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.291790 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.291898 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.291977 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.292142 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.292225 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.292382 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.292473 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.292615 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.292697 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.292867 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.292952 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.293101 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.293193 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.293339 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.293418 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.293568 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.293645 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.293807 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.293893 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.294041 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.294119 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.294289 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.294366 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.294525 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.294611 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.294782 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.294859 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.295039 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.295115 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.295281 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.295366 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.295510 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] auth.external = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.295587 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] auth.external = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.295739 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] auth.mapped = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.295826 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] auth.mapped = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.296032 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.296117 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.296267 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.296352 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.296496 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] auth.password = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.296574 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] auth.password = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.296727 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] auth.token = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.296893 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] auth.token = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.296982 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.297060 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.297217 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] catalog.caching = True {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.297315 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] catalog.caching = True {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.297467 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.297557 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.297697 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.297782 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.297945 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.298023 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.298192 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.298269 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.298423 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.298507 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.298734 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] credential.caching = True {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.298833 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] credential.caching = True {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.298907 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] credential.driver = sql {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.298976 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] credential.driver = sql {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.299144 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.299224 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.299396 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.299483 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.299631 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.299719 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.299878 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.299985 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.300116 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.300197 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.300369 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.300448 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.300625 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.300704 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.300908 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.300990 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.301169 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.301259 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.301458 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.301538 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.301705 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.301786 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.301971 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.302049 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.302213 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.302293 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.302473 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.302553 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.302710 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] federation.caching = True {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.302788 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] federation.caching = True {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.302950 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.303040 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.303201 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] federation.driver = sql {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.303280 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] federation.driver = sql {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.303449 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.303527 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.303683 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.303770 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.303932 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.304012 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.304172 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.304250 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.304444 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.304531 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.304683 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.304762 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.304967 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.305047 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.305206 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.305296 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.305455 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.305543 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.305693 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] identity.caching = True {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.305772 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] identity.caching = True {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.305945 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.306098 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.306277 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.306355 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.306520 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.306598 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.306758 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.306846 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.307011 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] identity.driver = sql {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.307091 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] identity.driver = sql {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.307246 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.307324 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.307484 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.307571 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.307736 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.307815 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.307989 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.308068 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.308221 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.308308 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.308455 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.308534 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.308687 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.308767 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.308961 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.309054 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.309211 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.309289 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.309460 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.309538 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.309718 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.309804 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.309968 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.310048 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.310242 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.310322 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.310487 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.310574 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.310725 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.310803 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.310959 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.311038 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.311196 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.311282 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.311426 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.311505 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.311667 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.311754 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.311901 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.311989 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.312138 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.312216 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.312387 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.312465 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.312619 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.312698 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.312892 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.312975 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.313144 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.313223 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.313381 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.313463 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.313630 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.313710 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.313878 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.313957 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.314110 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.314190 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.314348 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.314427 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.314581 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.password = **** {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.314660 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.password = **** {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.314819 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.314899 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.315055 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.315133 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.315298 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.315376 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.315535 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.315615 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.315773 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.315852 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.316021 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.316100 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.316274 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.316356 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.316531 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.316610 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.316764 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.316858 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.317041 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.317123 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.317291 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.317372 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.317530 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.317617 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.317765 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.317845 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.318001 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.318080 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.318231 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.user = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.318319 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.user = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.318469 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.318549 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.318724 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.318803 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.318957 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.319035 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.319203 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.319283 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.319452 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.319531 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.319697 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.319776 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.319934 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.320014 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.320163 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.320241 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.320399 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.320478 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.320632 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.320713 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.320892 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.320974 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.321122 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.321200 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.321369 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.321450 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.321619 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.321697 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.321868 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.321946 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.322116 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.322195 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.322363 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.322443 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.322593 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.322671 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.322840 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.322920 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.323080 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.323160 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.323314 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.323392 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.323623 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.323718 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.323791 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.323861 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.324018 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.324099 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.324268 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.324350 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.324506 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.324585 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.324761 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] policy.driver = sql {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.324860 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] policy.driver = sql {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.325019 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.325100 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.325261 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.325340 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.325498 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.325576 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.325731 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] receipt.caching = True {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.326075 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] receipt.caching = True {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.326246 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.326348 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.326610 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.326705 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.326788 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.326863 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.326969 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.327049 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.327209 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.327289 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.327455 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] resource.caching = True {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.327536 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] resource.caching = True {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.327713 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.327792 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.327966 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] resource.driver = sql {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.328054 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] resource.driver = sql {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.328207 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.328286 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.328455 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.328533 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.328705 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.328846 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.330471 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] revoke.caching = True {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.333772 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] revoke.caching = True {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.333772 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.333962 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.334028 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.334179 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.334253 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] role.cache_time = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.334320 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] role.cache_time = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.334384 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] role.caching = True {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.334455 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] role.caching = True {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.334527 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] role.driver = sql {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.334527 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] role.list_limit = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.334669 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] role.driver = sql {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.334741 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.334812 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] role.list_limit = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.334883 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.334954 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.335033 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.335107 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.335179 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.335250 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.335321 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.335387 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.335465 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.335542 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.335613 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.335683 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.335752 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.335822 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.335904 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.335978 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.336049 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.336120 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.336189 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.336259 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.336336 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.336409 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.336480 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.336550 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.336550 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.336668 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.336668 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.336813 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.336877 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.336937 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.337008 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.337077 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.337160 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.337235 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.337306 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.337366 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.337424 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.337502 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.337565 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.337636 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.337706 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.337776 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.337849 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.337928 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.338001 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.338071 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.338136 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.338206 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.338276 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.338354 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.338427 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.338488 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.338548 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.338617 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.338687 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.338770 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.338843 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.338914 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.338984 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.339054 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.339114 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] token.cache_time = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.339191 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.339265 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] token.caching = True {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.339336 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] token.cache_time = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.339405 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.339475 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] token.caching = True {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.339545 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] token.provider = fernet {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.339623 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.339695 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.339765 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] token.provider = fernet {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.339835 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.339905 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.339974 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.340047 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.340120 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.340244 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.340327 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.340488 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.340568 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.340736 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.340853 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] trust.driver = sql {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.341009 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.341090 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.341265 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] trust.driver = sql {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.341344 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.341498 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.341579 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.341736 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.341814 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.341975 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.342055 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.342204 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.342285 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.342448 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.342527 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.342685 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.342762 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.342934 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.343015 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] database.connection = **** {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.343205 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.343285 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.343454 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.343533 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] database.connection = **** {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.343710 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.343789 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.343950 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.344028 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.344189 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.344268 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.344427 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.344509 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.344664 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.344744 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.344930 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.345011 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.345175 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.345257 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.345416 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.345495 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.345660 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.345739 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.345898 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.345979 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.346148 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.346235 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.346381 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.346460 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.346632 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.346712 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.346876 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.346955 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.347115 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.347204 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.347352 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.347442 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.347524 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=67594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 16 14:21:26.347609 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.348485 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:21:26.348658 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=67595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 16 14:21:26.377290 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.377493 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.377725 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.378010 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.378248 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.378474 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.387763 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.389944 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.418339 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.418571 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.418956 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.419194 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.473808 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.474032 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.526545 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.526761 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.604735 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.604991 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.669883 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.670064 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.670135 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.670212 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.670317 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.670422 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.670537 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.670621 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.670756 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.670838 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.670977 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.671106 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.694557 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.694736 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.694829 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.694974 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.695080 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.695200 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.695286 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.695421 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.695504 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.695637 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.695721 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.695852 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.695937 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.696064 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.707655 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.707780 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.720588 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.720711 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.720842 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.720949 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.721074 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.721159 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.721299 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.721383 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.721518 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.721617 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.721735 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.721820 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.721951 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=67595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.722036 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=67594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:21:26.740069 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.740228 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 16 14:21:26.740735 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.740844 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.740997 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 16 14:21:26.741081 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 16 14:21:26.741267 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.741380 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.741527 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.741611 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 16 14:21:26.741783 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.741876 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.742037 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.742120 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.742325 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.742576 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.752319 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.752596 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.752884 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.752970 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.753161 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.753246 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.753446 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.753724 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.761128 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=67594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.763418 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=67595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.764243 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=67594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.764519 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.764805 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.765096 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.765374 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.765681 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.766069 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.766367 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.766579 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=67595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.766672 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.766856 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.766950 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.767134 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.767229 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.767413 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.767691 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.767956 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.768233 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.768508 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.768773 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.769076 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.769341 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.795000 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.795657 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.796541 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=67594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.796843 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.797239 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=67595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.797517 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.802554 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=67594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.802830 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.803113 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.803327 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=67595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.803606 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.803885 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.816808 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=67594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.816808 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.816982 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=67595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.816982 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.817124 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=67594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.817124 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.817124 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.817345 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=67595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.817422 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.817496 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.817579 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.817655 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.817729 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.817803 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.817875 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.817956 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.818033 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.818106 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.818106 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.818106 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.835080 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.835354 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.835931 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.836222 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.839773 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=67594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.840652 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=67595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.843404 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.843687 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.844259 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.844549 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.849081 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=67594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.849968 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=67595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.852523 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=67594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.853442 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=67595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.856000 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.856301 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.856580 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.856886 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.856986 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.857165 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.857260 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.857441 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.857535 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.857775 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.858060 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.858343 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.877166 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=67594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.877447 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.877710 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.877969 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.879850 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=67595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.880131 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.880397 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.880664 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.885995 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.887737 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.888017 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.888964 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.890755 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.890925 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=67594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.891098 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.891470 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.891757 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.892040 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.892325 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.894111 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=67595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.894389 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.895371 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.895665 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.896123 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.905727 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=67594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.906001 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.906273 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.906548 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.906820 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.907087 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.907359 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.909484 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=67595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.909762 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.910039 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.910347 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.910625 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.910898 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.911170 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.924468 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=67594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.928431 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=67594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.931082 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=67595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.931888 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.933436 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.934676 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=67595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.934973 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=67594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.935251 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.935531 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.937948 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.939472 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.941045 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=67595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.941326 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.942158 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.943005 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.944618 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=67594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.947697 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.947994 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.948271 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.948542 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.949218 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.951021 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=67595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.954108 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.954395 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.954675 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.954964 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.958171 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=67594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.958450 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.958729 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.964390 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=67595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.964675 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.964975 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.966334 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=67594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.966608 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.966886 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.967153 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.967414 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.967684 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.967956 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.968216 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.968475 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.968749 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.969035 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.969286 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.969549 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.969799 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=67594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.972537 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=67595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:21:26.973404 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.973404 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.973404 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.973655 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.973931 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.974199 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.974462 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.974727 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.975007 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.975274 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.975542 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.975809 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:26.976132 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=67595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:21:27.006724 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560253a719c0 pid: 67594 (default app) Dec 16 14:21:27.009941 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614c011-6708-4f3a-b74b-f54fd2add060 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:27.010241 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614c011-6708-4f3a-b74b-f54fd2add060 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:27.010523 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614c011-6708-4f3a-b74b-f54fd2add060 None None] PATH_INFO: `/v3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:27.015038 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560253a719c0 pid: 67595 (default app) Dec 16 14:21:27.015592 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 791 bytes} [Thu Dec 16 14:21:27 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:34.362428 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb02c6f-ca3f-4d33-b01d-872a9c24c8c2 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:34.363003 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb02c6f-ca3f-4d33-b01d-872a9c24c8c2 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:34.363145 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb02c6f-ca3f-4d33-b01d-872a9c24c8c2 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:34.368101 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1/2] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:21:34 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:34.374291 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52e23f-bd5e-439f-a665-ba400757b35b None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:34.374730 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52e23f-bd5e-439f-a665-ba400757b35b None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:34.374866 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52e23f-bd5e-439f-a665-ba400757b35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:34.419722 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG oslo_db.sqlalchemy.engines [None req-fe52e23f-bd5e-439f-a665-ba400757b35b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=67594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:21:34.565732 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG passlib.handlers.bcrypt [None req-fe52e23f-bd5e-439f-a665-ba400757b35b None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=67594) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 16 14:21:34.566171 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG passlib.handlers.bcrypt [None req-fe52e23f-bd5e-439f-a665-ba400757b35b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=67594) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 16 14:21:34.626868 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-fe52e23f-bd5e-439f-a665-ba400757b35b None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:34.628325 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-fe52e23f-bd5e-439f-a665-ba400757b35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:34.768753 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:21:34.964533 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb02c6f-ca3f-4d33-b01d-872a9c24c8c2 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:35.007431 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG oslo_db.sqlalchemy.engines [None req-1cb02c6f-ca3f-4d33-b01d-872a9c24c8c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=67595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:21:35.102820 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb02c6f-ca3f-4d33-b01d-872a9c24c8c2 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:35.106931 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15b28c-babf-40b9-9486-72b3c2fd7693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:35.107530 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15b28c-babf-40b9-9486-72b3c2fd7693 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:35.107828 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15b28c-babf-40b9-9486-72b3c2fd7693 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:35.108118 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15b28c-babf-40b9-9486-72b3c2fd7693 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:35.116600 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15b28c-babf-40b9-9486-72b3c2fd7693 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:35.167944 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6b15b28c-babf-40b9-9486-72b3c2fd7693 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 16 14:21:35.168290 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15b28c-babf-40b9-9486-72b3c2fd7693 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:21:35.178276 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:21:34 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:21:35.185229 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52e23f-bd5e-439f-a665-ba400757b35b None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:35.197475 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52e23f-bd5e-439f-a665-ba400757b35b None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:35.201824 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed6f3d-52a1-4414-b20d-2a2c78e5cf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:35.202897 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed6f3d-52a1-4414-b20d-2a2c78e5cf76 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:35.203186 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed6f3d-52a1-4414-b20d-2a2c78e5cf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:35.203524 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed6f3d-52a1-4414-b20d-2a2c78e5cf76 admin admin] PATH_INFO: `/v3/projects/4379b60ef2094a39988c4f13a32f6cb0` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:35.204926 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed6f3d-52a1-4414-b20d-2a2c78e5cf76 admin admin] RBAC: Authorizing `identity:get_project(project_id=4379b60ef2094a39988c4f13a32f6cb0)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:35.256081 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5bed6f3d-52a1-4414-b20d-2a2c78e5cf76 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 16 14:21:35.256352 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed6f3d-52a1-4414-b20d-2a2c78e5cf76 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:21:35.260910 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 3/5] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:21:35 2021] GET /identity/v3/projects/4379b60ef2094a39988c4f13a32f6cb0 => generated 344 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:37.333583 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590fb8d-05bf-4d99-a93a-2a8a32d65884 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:37.334151 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590fb8d-05bf-4d99-a93a-2a8a32d65884 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:37.334151 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590fb8d-05bf-4d99-a93a-2a8a32d65884 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:37.338565 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 3/6] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:21:37 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:37.344040 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d2912-53d6-42fa-be4d-a750288cb4fc None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:37.344450 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d2912-53d6-42fa-be4d-a750288cb4fc None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:37.344611 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d2912-53d6-42fa-be4d-a750288cb4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:37.370366 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-620d2912-53d6-42fa-be4d-a750288cb4fc None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:37.372848 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-620d2912-53d6-42fa-be4d-a750288cb4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:37.384936 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:37.411054 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590fb8d-05bf-4d99-a93a-2a8a32d65884 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:37.424707 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590fb8d-05bf-4d99-a93a-2a8a32d65884 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:37.429266 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62117968-e022-4b45-9ed3-86ece6bb869c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:37.429894 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62117968-e022-4b45-9ed3-86ece6bb869c admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:37.430192 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62117968-e022-4b45-9ed3-86ece6bb869c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:37.430518 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62117968-e022-4b45-9ed3-86ece6bb869c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:37.439134 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62117968-e022-4b45-9ed3-86ece6bb869c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:37.441694 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62117968-e022-4b45-9ed3-86ece6bb869c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:21:37.450166 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:21:37 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:21:37.456136 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d2912-53d6-42fa-be4d-a750288cb4fc None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:37.465493 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d2912-53d6-42fa-be4d-a750288cb4fc None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:37.469673 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b56c7d-e9f8-4279-9893-f42fbae7411a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:37.470466 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b56c7d-e9f8-4279-9893-f42fbae7411a admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:37.470763 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b56c7d-e9f8-4279-9893-f42fbae7411a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:37.471052 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b56c7d-e9f8-4279-9893-f42fbae7411a admin admin] PATH_INFO: `/v3/users/8c2ac62eab7c4164bfd09ecc79a439aa` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:37.472376 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b56c7d-e9f8-4279-9893-f42fbae7411a admin admin] RBAC: Authorizing `identity:get_user(user_id=8c2ac62eab7c4164bfd09ecc79a439aa)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:37.474252 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b56c7d-e9f8-4279-9893-f42fbae7411a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:21:37.475687 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 5/9] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:21:37 2021] GET /identity/v3/users/8c2ac62eab7c4164bfd09ecc79a439aa => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:21:39.631449 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e8978-cb01-49a3-a5aa-aa5444af46ec None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:39.632007 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e8978-cb01-49a3-a5aa-aa5444af46ec None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:39.632007 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e8978-cb01-49a3-a5aa-aa5444af46ec None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:39.633736 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 5/10] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:21:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 16 14:21:39.639116 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26662cfc-5718-4089-9ed3-6b6fcde85cae None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:39.639505 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26662cfc-5718-4089-9ed3-6b6fcde85cae None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:39.639694 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26662cfc-5718-4089-9ed3-6b6fcde85cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:39.662327 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-26662cfc-5718-4089-9ed3-6b6fcde85cae None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:39.663487 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-26662cfc-5718-4089-9ed3-6b6fcde85cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:39.670374 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 6/11] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:39.694053 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e8978-cb01-49a3-a5aa-aa5444af46ec None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:39.705944 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e8978-cb01-49a3-a5aa-aa5444af46ec None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:39.710700 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05df1d2-2d0f-4f80-90b1-a0295e5ecf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:39.711431 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05df1d2-2d0f-4f80-90b1-a0295e5ecf66 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:39.711725 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05df1d2-2d0f-4f80-90b1-a0295e5ecf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:39.712009 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05df1d2-2d0f-4f80-90b1-a0295e5ecf66 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:39.725326 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05df1d2-2d0f-4f80-90b1-a0295e5ecf66 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:21:39.731557 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-b05df1d2-2d0f-4f80-90b1-a0295e5ecf66 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:21:39.732703 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 6/12] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:21:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:39.739051 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26662cfc-5718-4089-9ed3-6b6fcde85cae None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:39.747620 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26662cfc-5718-4089-9ed3-6b6fcde85cae None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:39.755800 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d93c60-f3bf-4408-b739-bcd33b5c8672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:39.756401 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d93c60-f3bf-4408-b739-bcd33b5c8672 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:39.756699 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d93c60-f3bf-4408-b739-bcd33b5c8672 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:39.757020 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d93c60-f3bf-4408-b739-bcd33b5c8672 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:39.757749 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d93c60-f3bf-4408-b739-bcd33b5c8672 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:21:39.758058 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d93c60-f3bf-4408-b739-bcd33b5c8672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:39.759787 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING py.warnings [None req-55d93c60-f3bf-4408-b739-bcd33b5c8672 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:21:39.759787 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: warnings.warn(msg) Dec 16 14:21:39.759787 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: Dec 16 14:21:39.760706 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d93c60-f3bf-4408-b739-bcd33b5c8672 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:21:39.771704 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 7/13] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:21:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:39.777264 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05df1d2-2d0f-4f80-90b1-a0295e5ecf66 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:39.786960 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05df1d2-2d0f-4f80-90b1-a0295e5ecf66 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:39.791031 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d9224-700a-4119-81ba-218d4578de87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:39.791804 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d9224-700a-4119-81ba-218d4578de87 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:39.792091 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d9224-700a-4119-81ba-218d4578de87 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:39.792372 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d9224-700a-4119-81ba-218d4578de87 admin admin] PATH_INFO: `/v3/users/8c2ac62eab7c4164bfd09ecc79a439aa` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:39.794015 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d9224-700a-4119-81ba-218d4578de87 admin admin] RBAC: Authorizing `identity:get_user(user_id=8c2ac62eab7c4164bfd09ecc79a439aa)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:39.795818 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d9224-700a-4119-81ba-218d4578de87 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:21:39.797275 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 7/14] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:21:39 2021] GET /identity/v3/users/8c2ac62eab7c4164bfd09ecc79a439aa => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:39.802824 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d93c60-f3bf-4408-b739-bcd33b5c8672 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:39.812223 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d93c60-f3bf-4408-b739-bcd33b5c8672 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:39.816380 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4eeed-7ad7-4e25-88b4-33b0d0a654ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:39.817131 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4eeed-7ad7-4e25-88b4-33b0d0a654ed admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:39.817426 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4eeed-7ad7-4e25-88b4-33b0d0a654ed admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:39.817713 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4eeed-7ad7-4e25-88b4-33b0d0a654ed admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:39.818861 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4eeed-7ad7-4e25-88b4-33b0d0a654ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:39.820583 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4eeed-7ad7-4e25-88b4-33b0d0a654ed admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:21:39.822053 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 8/15] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:21:39 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:39.827926 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d9224-700a-4119-81ba-218d4578de87 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:39.838152 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d9224-700a-4119-81ba-218d4578de87 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:39.842244 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df6e4a-bf5a-4106-bd9b-d84991395231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:39.842820 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df6e4a-bf5a-4106-bd9b-d84991395231 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:39.843109 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df6e4a-bf5a-4106-bd9b-d84991395231 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:39.843393 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df6e4a-bf5a-4106-bd9b-d84991395231 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:39.844157 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df6e4a-bf5a-4106-bd9b-d84991395231 admin admin] RBAC: Adding query filter params (role.id=90166eb3dcfa41e58450e140b8b0fea3, scope.domain.id=default, user.id=8c2ac62eab7c4164bfd09ecc79a439aa) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:21:39.845372 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df6e4a-bf5a-4106-bd9b-d84991395231 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:39.846221 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING py.warnings [None req-c4df6e4a-bf5a-4106-bd9b-d84991395231 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:21:39.846221 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: warnings.warn(msg) Dec 16 14:21:39.846221 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: Dec 16 14:21:39.848093 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df6e4a-bf5a-4106-bd9b-d84991395231 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:21:39.855171 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 8/16] 10.222.0.64 () {56 vars in 1343 bytes} [Thu Dec 16 14:21:39 2021] GET /identity/v3/role_assignments?user.id=8c2ac62eab7c4164bfd09ecc79a439aa&scope.domain.id=default&role.id=90166eb3dcfa41e58450e140b8b0fea3 => generated 233 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:41.915837 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699147a7-83fa-42c7-8c80-21fc64a88a43 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:41.916433 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699147a7-83fa-42c7-8c80-21fc64a88a43 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:41.916433 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699147a7-83fa-42c7-8c80-21fc64a88a43 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:41.918376 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 9/17] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:21:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:41.923609 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f651c6-066e-403d-a853-2b88fcef1af6 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:41.923996 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f651c6-066e-403d-a853-2b88fcef1af6 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:41.924193 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f651c6-066e-403d-a853-2b88fcef1af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:41.956448 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG passlib.handlers.bcrypt [None req-c0f651c6-066e-403d-a853-2b88fcef1af6 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=67595) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 16 14:21:41.956888 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG passlib.handlers.bcrypt [None req-c0f651c6-066e-403d-a853-2b88fcef1af6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=67595) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 16 14:21:42.003625 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-c0f651c6-066e-403d-a853-2b88fcef1af6 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:42.005262 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-c0f651c6-066e-403d-a853-2b88fcef1af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:42.041708 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 9/18] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:42.063844 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699147a7-83fa-42c7-8c80-21fc64a88a43 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:42.076058 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699147a7-83fa-42c7-8c80-21fc64a88a43 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:42.080079 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214fc2b7-267f-44dc-8a2f-e92995e3e24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:42.080807 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fc2b7-267f-44dc-8a2f-e92995e3e24e admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:42.081605 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fc2b7-267f-44dc-8a2f-e92995e3e24e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:42.081900 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fc2b7-267f-44dc-8a2f-e92995e3e24e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:42.093576 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214fc2b7-267f-44dc-8a2f-e92995e3e24e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:21:42.100455 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-214fc2b7-267f-44dc-8a2f-e92995e3e24e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:21:42.101599 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 10/19] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:21:42 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:42.107351 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f651c6-066e-403d-a853-2b88fcef1af6 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:42.116051 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f651c6-066e-403d-a853-2b88fcef1af6 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:42.120173 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24044e3-1643-4e96-b77b-56b29fd74af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:42.121137 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24044e3-1643-4e96-b77b-56b29fd74af4 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:42.121434 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24044e3-1643-4e96-b77b-56b29fd74af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:42.121721 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24044e3-1643-4e96-b77b-56b29fd74af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:42.122571 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24044e3-1643-4e96-b77b-56b29fd74af4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:21:42.122871 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24044e3-1643-4e96-b77b-56b29fd74af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:42.123906 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING py.warnings [None req-d24044e3-1643-4e96-b77b-56b29fd74af4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:21:42.123906 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: warnings.warn(msg) Dec 16 14:21:42.123906 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: Dec 16 14:21:42.124835 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24044e3-1643-4e96-b77b-56b29fd74af4 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:21:42.134282 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 10/20] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:21:42 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:21:42.139812 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214fc2b7-267f-44dc-8a2f-e92995e3e24e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:42.150213 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214fc2b7-267f-44dc-8a2f-e92995e3e24e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:42.154546 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5a460-315f-4615-906c-14395dcbf63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:42.155342 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5a460-315f-4615-906c-14395dcbf63f admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:42.155635 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5a460-315f-4615-906c-14395dcbf63f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:42.155921 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5a460-315f-4615-906c-14395dcbf63f admin admin] PATH_INFO: `/v3/users/8c2ac62eab7c4164bfd09ecc79a439aa` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:42.157062 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5a460-315f-4615-906c-14395dcbf63f admin admin] RBAC: Authorizing `identity:get_user(user_id=8c2ac62eab7c4164bfd09ecc79a439aa)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:42.158987 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5a460-315f-4615-906c-14395dcbf63f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:21:42.161446 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 11/21] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:21:42 2021] GET /identity/v3/users/8c2ac62eab7c4164bfd09ecc79a439aa => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:42.166808 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24044e3-1643-4e96-b77b-56b29fd74af4 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:42.176226 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24044e3-1643-4e96-b77b-56b29fd74af4 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:42.180329 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1351e9e-95b9-4ad8-bf1d-02b08d97ab74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:42.181125 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1351e9e-95b9-4ad8-bf1d-02b08d97ab74 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:42.181424 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1351e9e-95b9-4ad8-bf1d-02b08d97ab74 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:42.181711 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1351e9e-95b9-4ad8-bf1d-02b08d97ab74 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:42.183008 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1351e9e-95b9-4ad8-bf1d-02b08d97ab74 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:42.184715 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1351e9e-95b9-4ad8-bf1d-02b08d97ab74 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:21:42.186192 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 11/22] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:21:42 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:42.191652 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5a460-315f-4615-906c-14395dcbf63f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:42.201316 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5a460-315f-4615-906c-14395dcbf63f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:42.205538 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dad323-7ade-43d8-b77c-68a6c41d6887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:42.206845 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dad323-7ade-43d8-b77c-68a6c41d6887 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:42.207141 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dad323-7ade-43d8-b77c-68a6c41d6887 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:42.207429 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dad323-7ade-43d8-b77c-68a6c41d6887 admin admin] PATH_INFO: `/v3/domains/default/users/8c2ac62eab7c4164bfd09ecc79a439aa/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:42.209341 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dad323-7ade-43d8-b77c-68a6c41d6887 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8c2ac62eab7c4164bfd09ecc79a439aa, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:42.210360 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING py.warnings [None req-01dad323-7ade-43d8-b77c-68a6c41d6887 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:21:42.210360 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: warnings.warn(msg) Dec 16 14:21:42.210360 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: Dec 16 14:21:42.212344 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dad323-7ade-43d8-b77c-68a6c41d6887 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:21:42.416029 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 12/23] 10.222.0.64 () {58 vars in 1382 bytes} [Thu Dec 16 14:21:42 2021] PUT /identity/v3/domains/default/users/8c2ac62eab7c4164bfd09ecc79a439aa/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:21:44.439517 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcfd83-9575-4b64-8b8e-4b1c29645ddf None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:44.440046 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcfd83-9575-4b64-8b8e-4b1c29645ddf None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:44.440159 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcfd83-9575-4b64-8b8e-4b1c29645ddf None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:44.441882 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 12/24] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:21:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:44.447916 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4640a51-8ba4-456a-bb33-4b78e02efeff None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:44.448419 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4640a51-8ba4-456a-bb33-4b78e02efeff None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:44.448947 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4640a51-8ba4-456a-bb33-4b78e02efeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:44.479899 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-f4640a51-8ba4-456a-bb33-4b78e02efeff None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:44.481401 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-f4640a51-8ba4-456a-bb33-4b78e02efeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:44.547191 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 13/25] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:44.574731 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcfd83-9575-4b64-8b8e-4b1c29645ddf None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:44.586652 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcfd83-9575-4b64-8b8e-4b1c29645ddf None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:44.590604 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db8d19-ca2d-4670-9263-09fb37070d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:44.591314 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db8d19-ca2d-4670-9263-09fb37070d0a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:44.591600 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db8d19-ca2d-4670-9263-09fb37070d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:44.591880 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db8d19-ca2d-4670-9263-09fb37070d0a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:44.604647 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db8d19-ca2d-4670-9263-09fb37070d0a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:21:44.610842 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-e0db8d19-ca2d-4670-9263-09fb37070d0a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:21:44.611916 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 13/26] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:21:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:44.618030 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4640a51-8ba4-456a-bb33-4b78e02efeff None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:44.626568 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4640a51-8ba4-456a-bb33-4b78e02efeff None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:44.631241 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb566f-18cb-42e0-8af6-face03e5b6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:44.631829 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb566f-18cb-42e0-8af6-face03e5b6db admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:44.632118 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb566f-18cb-42e0-8af6-face03e5b6db admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:44.632401 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb566f-18cb-42e0-8af6-face03e5b6db admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:44.633145 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb566f-18cb-42e0-8af6-face03e5b6db admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:21:44.633446 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb566f-18cb-42e0-8af6-face03e5b6db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:44.635304 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb566f-18cb-42e0-8af6-face03e5b6db admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:21:44.647035 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 14/27] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:21:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:44.652442 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db8d19-ca2d-4670-9263-09fb37070d0a admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:44.662388 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db8d19-ca2d-4670-9263-09fb37070d0a admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:44.666504 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b70b5-80dd-415c-8c4d-8e3b321b31cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:44.667288 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b70b5-80dd-415c-8c4d-8e3b321b31cd admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:44.667580 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b70b5-80dd-415c-8c4d-8e3b321b31cd admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:44.667865 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b70b5-80dd-415c-8c4d-8e3b321b31cd admin admin] PATH_INFO: `/v3/users/8c2ac62eab7c4164bfd09ecc79a439aa` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:44.669197 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b70b5-80dd-415c-8c4d-8e3b321b31cd admin admin] RBAC: Authorizing `identity:get_user(user_id=8c2ac62eab7c4164bfd09ecc79a439aa)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:44.671036 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b70b5-80dd-415c-8c4d-8e3b321b31cd admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:21:44.672514 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 14/28] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:21:44 2021] GET /identity/v3/users/8c2ac62eab7c4164bfd09ecc79a439aa => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:44.677728 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb566f-18cb-42e0-8af6-face03e5b6db admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:44.686912 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb566f-18cb-42e0-8af6-face03e5b6db admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:44.691594 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea20b7-8e35-4aab-ad15-67b116a0da2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:44.692256 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea20b7-8e35-4aab-ad15-67b116a0da2c admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:44.692544 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea20b7-8e35-4aab-ad15-67b116a0da2c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:44.692885 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea20b7-8e35-4aab-ad15-67b116a0da2c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:44.693968 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea20b7-8e35-4aab-ad15-67b116a0da2c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:44.695682 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea20b7-8e35-4aab-ad15-67b116a0da2c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:21:44.697148 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 15/29] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:21:44 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:44.702594 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b70b5-80dd-415c-8c4d-8e3b321b31cd admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:44.711905 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b70b5-80dd-415c-8c4d-8e3b321b31cd admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:44.716014 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f99f5-de17-42f2-b7c5-1a82dfd0359a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:44.716585 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f99f5-de17-42f2-b7c5-1a82dfd0359a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:44.716908 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f99f5-de17-42f2-b7c5-1a82dfd0359a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:44.717190 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f99f5-de17-42f2-b7c5-1a82dfd0359a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:44.717957 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f99f5-de17-42f2-b7c5-1a82dfd0359a admin admin] RBAC: Adding query filter params (role.id=90166eb3dcfa41e58450e140b8b0fea3, scope.domain.id=default, user.id=8c2ac62eab7c4164bfd09ecc79a439aa) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:21:44.718258 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f99f5-de17-42f2-b7c5-1a82dfd0359a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:44.720097 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f99f5-de17-42f2-b7c5-1a82dfd0359a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:21:44.726417 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 15/30] 10.222.0.64 () {56 vars in 1343 bytes} [Thu Dec 16 14:21:44 2021] GET /identity/v3/role_assignments?user.id=8c2ac62eab7c4164bfd09ecc79a439aa&scope.domain.id=default&role.id=90166eb3dcfa41e58450e140b8b0fea3 => generated 530 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:46.791889 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0956e-ee83-4253-bd89-5afadcf16791 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:46.792407 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0956e-ee83-4253-bd89-5afadcf16791 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:46.792517 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0956e-ee83-4253-bd89-5afadcf16791 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:46.794225 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 16/31] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:21:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:46.799471 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2161533-9cda-4120-9726-860000bced86 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:46.800367 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2161533-9cda-4120-9726-860000bced86 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:46.800567 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2161533-9cda-4120-9726-860000bced86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:46.823434 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-e2161533-9cda-4120-9726-860000bced86 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:46.824590 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e2161533-9cda-4120-9726-860000bced86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:46.832272 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 16/32] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:46.854523 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0956e-ee83-4253-bd89-5afadcf16791 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:46.866844 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0956e-ee83-4253-bd89-5afadcf16791 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:46.870899 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00962e00-a282-4e95-8936-acd4ee33bb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:46.871530 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00962e00-a282-4e95-8936-acd4ee33bb68 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:46.871827 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00962e00-a282-4e95-8936-acd4ee33bb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:46.872119 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00962e00-a282-4e95-8936-acd4ee33bb68 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:46.880305 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00962e00-a282-4e95-8936-acd4ee33bb68 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:46.882142 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00962e00-a282-4e95-8936-acd4ee33bb68 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:21:46.890602 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 17/33] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:21:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:21:46.896655 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2161533-9cda-4120-9726-860000bced86 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:46.905171 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2161533-9cda-4120-9726-860000bced86 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:46.909983 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4ec7b-1142-424f-8ff6-a8a965954a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:46.910699 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4ec7b-1142-424f-8ff6-a8a965954a74 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:46.910990 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4ec7b-1142-424f-8ff6-a8a965954a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:46.911284 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4ec7b-1142-424f-8ff6-a8a965954a74 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:46.912360 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4ec7b-1142-424f-8ff6-a8a965954a74 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:46.914087 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4ec7b-1142-424f-8ff6-a8a965954a74 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:21:46.915516 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 17/34] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:21:46 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:49.085955 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0f345-4228-4c93-ae1b-442246c1aa26 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:49.086465 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0f345-4228-4c93-ae1b-442246c1aa26 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:49.086577 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0f345-4228-4c93-ae1b-442246c1aa26 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:49.088181 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 18/35] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:21:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:49.093279 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a563f2-98d5-4c3b-a9cb-a82290de1369 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:49.093677 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a563f2-98d5-4c3b-a9cb-a82290de1369 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:49.093851 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a563f2-98d5-4c3b-a9cb-a82290de1369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:49.116483 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-82a563f2-98d5-4c3b-a9cb-a82290de1369 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:49.117592 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-82a563f2-98d5-4c3b-a9cb-a82290de1369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:49.124434 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 18/36] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:21:49.147369 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0f345-4228-4c93-ae1b-442246c1aa26 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:49.159670 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0f345-4228-4c93-ae1b-442246c1aa26 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:49.163644 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41269f95-5181-4da1-970e-3e8359829d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:49.164357 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41269f95-5181-4da1-970e-3e8359829d15 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:49.164651 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41269f95-5181-4da1-970e-3e8359829d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:49.164975 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41269f95-5181-4da1-970e-3e8359829d15 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:49.177427 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41269f95-5181-4da1-970e-3e8359829d15 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:49.179265 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41269f95-5181-4da1-970e-3e8359829d15 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:21:49.196112 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-41269f95-5181-4da1-970e-3e8359829d15 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:21:49.197240 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 19/37] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:21:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:49.203246 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a563f2-98d5-4c3b-a9cb-a82290de1369 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:49.211970 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a563f2-98d5-4c3b-a9cb-a82290de1369 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:49.216120 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cca7a-61cc-45c2-916b-55dc29fcf41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:49.216707 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cca7a-61cc-45c2-916b-55dc29fcf41b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:49.217033 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cca7a-61cc-45c2-916b-55dc29fcf41b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:49.217322 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cca7a-61cc-45c2-916b-55dc29fcf41b admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:49.218015 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cca7a-61cc-45c2-916b-55dc29fcf41b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:21:49.218313 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cca7a-61cc-45c2-916b-55dc29fcf41b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:49.219300 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING py.warnings [None req-555cca7a-61cc-45c2-916b-55dc29fcf41b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:21:49.219300 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: warnings.warn(msg) Dec 16 14:21:49.219300 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: Dec 16 14:21:49.220209 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cca7a-61cc-45c2-916b-55dc29fcf41b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:21:49.235920 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 19/38] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:21:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:49.241951 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41269f95-5181-4da1-970e-3e8359829d15 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:49.251191 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41269f95-5181-4da1-970e-3e8359829d15 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:49.255260 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c47c2-cb0a-4fe0-b788-3aeb996427b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:49.255845 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c47c2-cb0a-4fe0-b788-3aeb996427b5 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:49.256142 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c47c2-cb0a-4fe0-b788-3aeb996427b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:49.256424 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c47c2-cb0a-4fe0-b788-3aeb996427b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:49.257126 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c47c2-cb0a-4fe0-b788-3aeb996427b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:49.258124 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING py.warnings [None req-7c8c47c2-cb0a-4fe0-b788-3aeb996427b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:21:49.258124 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: warnings.warn(msg) Dec 16 14:21:49.258124 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: Dec 16 14:21:49.259330 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c47c2-cb0a-4fe0-b788-3aeb996427b5 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:21:49.286696 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 20/39] 10.222.0.64 () {60 vars in 1162 bytes} [Thu Dec 16 14:21:49 2021] POST /identity/v3/projects => generated 301 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:21:51.445039 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2e592-f40c-44ae-9fdb-333f72fa5a2c None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:51.445578 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2e592-f40c-44ae-9fdb-333f72fa5a2c None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:51.445578 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2e592-f40c-44ae-9fdb-333f72fa5a2c None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:51.447298 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 20/40] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:21:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:51.452713 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5856e-84db-4116-b9c6-d37a44944ef3 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:51.453150 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5856e-84db-4116-b9c6-d37a44944ef3 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:51.453329 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5856e-84db-4116-b9c6-d37a44944ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:51.476273 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-2aa5856e-84db-4116-b9c6-d37a44944ef3 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:51.477454 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-2aa5856e-84db-4116-b9c6-d37a44944ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:51.540947 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 21/41] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:51.563024 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2e592-f40c-44ae-9fdb-333f72fa5a2c None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:51.575033 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2e592-f40c-44ae-9fdb-333f72fa5a2c None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:51.579042 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567c5c5-8353-4d3c-957d-574a9d90dccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:51.579625 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567c5c5-8353-4d3c-957d-574a9d90dccb admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:51.579914 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567c5c5-8353-4d3c-957d-574a9d90dccb admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:51.580196 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567c5c5-8353-4d3c-957d-574a9d90dccb admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:51.580947 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567c5c5-8353-4d3c-957d-574a9d90dccb admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:51.581942 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING py.warnings [None req-f567c5c5-8353-4d3c-957d-574a9d90dccb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:21:51.581942 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: warnings.warn(msg) Dec 16 14:21:51.581942 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: Dec 16 14:21:51.582839 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567c5c5-8353-4d3c-957d-574a9d90dccb admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:21:51.787709 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 21/42] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:21:51 2021] POST /identity/v3/roles => generated 219 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:21:53.957122 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294a6a2-f30d-4dc0-af0d-1620527d3685 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:53.957634 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294a6a2-f30d-4dc0-af0d-1620527d3685 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:53.957720 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294a6a2-f30d-4dc0-af0d-1620527d3685 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:53.959387 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 22/43] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:21:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:53.964765 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fb304-cb64-4b45-a70d-56d4e14d3b11 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:53.965179 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fb304-cb64-4b45-a70d-56d4e14d3b11 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:53.965368 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fb304-cb64-4b45-a70d-56d4e14d3b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:53.989040 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-9b7fb304-cb64-4b45-a70d-56d4e14d3b11 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:53.990477 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-9b7fb304-cb64-4b45-a70d-56d4e14d3b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:53.997573 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 22/44] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:54.018981 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294a6a2-f30d-4dc0-af0d-1620527d3685 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:54.030530 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294a6a2-f30d-4dc0-af0d-1620527d3685 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:54.035071 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c71706-c677-4d35-8579-eee0a25b3679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:54.035658 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c71706-c677-4d35-8579-eee0a25b3679 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:54.035949 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c71706-c677-4d35-8579-eee0a25b3679 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:54.036235 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c71706-c677-4d35-8579-eee0a25b3679 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:54.036971 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c71706-c677-4d35-8579-eee0a25b3679 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:54.037972 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING py.warnings [None req-22c71706-c677-4d35-8579-eee0a25b3679 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:21:54.037972 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: warnings.warn(msg) Dec 16 14:21:54.037972 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: Dec 16 14:21:54.038889 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c71706-c677-4d35-8579-eee0a25b3679 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:21:54.053353 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 23/45] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:21:54 2021] POST /identity/v3/roles => generated 225 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:21:56.202338 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e99f33-1bef-4966-88ab-07556e1a2726 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:56.202846 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e99f33-1bef-4966-88ab-07556e1a2726 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:56.202931 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e99f33-1bef-4966-88ab-07556e1a2726 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:56.204603 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 23/46] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:21:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:56.210465 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313a363-4162-46b7-a7e1-7381168acb7b None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:56.210853 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313a363-4162-46b7-a7e1-7381168acb7b None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:56.211048 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313a363-4162-46b7-a7e1-7381168acb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:56.233934 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-a313a363-4162-46b7-a7e1-7381168acb7b None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:56.235089 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-a313a363-4162-46b7-a7e1-7381168acb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:56.242044 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 24/47] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:56.264901 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e99f33-1bef-4966-88ab-07556e1a2726 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:56.277558 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e99f33-1bef-4966-88ab-07556e1a2726 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:56.281577 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf935d-450b-4504-ac68-2c04eec8516a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:56.282170 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf935d-450b-4504-ac68-2c04eec8516a admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:56.282466 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf935d-450b-4504-ac68-2c04eec8516a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:56.282756 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf935d-450b-4504-ac68-2c04eec8516a admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:56.283488 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf935d-450b-4504-ac68-2c04eec8516a admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:56.285312 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf935d-450b-4504-ac68-2c04eec8516a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:21:56.297695 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 24/48] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:21:56 2021] POST /identity/v3/roles => generated 223 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:21:58.359501 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15a402-7dac-4f1f-97d4-f9de8ab04ddd None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:58.360017 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15a402-7dac-4f1f-97d4-f9de8ab04ddd None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:58.360103 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15a402-7dac-4f1f-97d4-f9de8ab04ddd None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:58.361817 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 25/49] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:21:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:58.367287 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a7463-be43-40ca-94e8-e4fe5f0a97fc None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:58.367836 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a7463-be43-40ca-94e8-e4fe5f0a97fc None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:58.367923 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a7463-be43-40ca-94e8-e4fe5f0a97fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:58.390270 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-298a7463-be43-40ca-94e8-e4fe5f0a97fc None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:58.391406 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-298a7463-be43-40ca-94e8-e4fe5f0a97fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:58.398975 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 25/50] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:58.421758 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15a402-7dac-4f1f-97d4-f9de8ab04ddd None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:58.433389 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15a402-7dac-4f1f-97d4-f9de8ab04ddd None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:58.437584 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32658fe0-509a-4393-9c34-2c1dbe2bd294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:58.438298 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32658fe0-509a-4393-9c34-2c1dbe2bd294 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:58.438585 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32658fe0-509a-4393-9c34-2c1dbe2bd294 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:58.438867 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32658fe0-509a-4393-9c34-2c1dbe2bd294 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:58.440462 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32658fe0-509a-4393-9c34-2c1dbe2bd294 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:58.442193 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32658fe0-509a-4393-9c34-2c1dbe2bd294 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:21:58.443641 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 26/51] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:21:58 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:58.449089 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a7463-be43-40ca-94e8-e4fe5f0a97fc None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:58.458386 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a7463-be43-40ca-94e8-e4fe5f0a97fc None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:58.462582 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fa789-1377-425c-8a48-ba9538a483fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:58.463164 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fa789-1377-425c-8a48-ba9538a483fe admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:58.463461 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fa789-1377-425c-8a48-ba9538a483fe admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:58.463748 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fa789-1377-425c-8a48-ba9538a483fe admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:58.464406 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0fa789-1377-425c-8a48-ba9538a483fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:58.465445 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING py.warnings [None req-fe0fa789-1377-425c-8a48-ba9538a483fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:21:58.465445 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: warnings.warn(msg) Dec 16 14:21:58.465445 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: Dec 16 14:21:58.466642 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0fa789-1377-425c-8a48-ba9538a483fe admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:21:58.493078 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 26/52] 10.222.0.64 () {60 vars in 1162 bytes} [Thu Dec 16 14:21:58 2021] POST /identity/v3/projects => generated 312 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:22:00.563553 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664fe86-3a62-4673-8a24-94adc88eccc9 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:00.564125 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664fe86-3a62-4673-8a24-94adc88eccc9 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:00.564125 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664fe86-3a62-4673-8a24-94adc88eccc9 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:00.566371 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 27/53] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:22:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:00.571547 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804385f4-6eb8-4141-a56b-4dac21215ef1 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:00.571963 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804385f4-6eb8-4141-a56b-4dac21215ef1 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:00.572124 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804385f4-6eb8-4141-a56b-4dac21215ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:00.594785 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-804385f4-6eb8-4141-a56b-4dac21215ef1 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:00.595967 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-804385f4-6eb8-4141-a56b-4dac21215ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:00.662284 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 27/54] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:22:00.685300 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664fe86-3a62-4673-8a24-94adc88eccc9 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:00.700243 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664fe86-3a62-4673-8a24-94adc88eccc9 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:00.704266 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1d43f-8c5c-464d-8f11-36fb5d59062e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:00.705616 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1d43f-8c5c-464d-8f11-36fb5d59062e admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:00.705919 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1d43f-8c5c-464d-8f11-36fb5d59062e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:00.706251 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1d43f-8c5c-464d-8f11-36fb5d59062e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:00.707352 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1d43f-8c5c-464d-8f11-36fb5d59062e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:00.709085 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1d43f-8c5c-464d-8f11-36fb5d59062e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:00.710532 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 28/55] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:00 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:00.715894 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804385f4-6eb8-4141-a56b-4dac21215ef1 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:00.725029 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804385f4-6eb8-4141-a56b-4dac21215ef1 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:00.729181 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726eea2f-57ed-425d-9c14-7a4cc5d8bfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:00.729764 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726eea2f-57ed-425d-9c14-7a4cc5d8bfc4 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:00.730058 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726eea2f-57ed-425d-9c14-7a4cc5d8bfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:00.730352 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726eea2f-57ed-425d-9c14-7a4cc5d8bfc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:00.731003 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726eea2f-57ed-425d-9c14-7a4cc5d8bfc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:00.732951 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726eea2f-57ed-425d-9c14-7a4cc5d8bfc4 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:00.758399 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 28/56] 10.222.0.64 () {60 vars in 1161 bytes} [Thu Dec 16 14:22:00 2021] POST /identity/v3/projects => generated 298 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:22:02.838539 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2b0b2-7c43-4b5f-8550-9634b3b45c40 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:02.839072 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2b0b2-7c43-4b5f-8550-9634b3b45c40 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:02.839164 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2b0b2-7c43-4b5f-8550-9634b3b45c40 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:02.840803 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 29/57] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:22:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:02.846085 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686d791-3319-4c19-bece-66ee745f296d None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:02.846468 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686d791-3319-4c19-bece-66ee745f296d None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:02.846661 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686d791-3319-4c19-bece-66ee745f296d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:02.868611 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-5686d791-3319-4c19-bece-66ee745f296d None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:02.869792 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-5686d791-3319-4c19-bece-66ee745f296d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:02.933975 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 29/58] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:02.957165 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2b0b2-7c43-4b5f-8550-9634b3b45c40 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:02.968844 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2b0b2-7c43-4b5f-8550-9634b3b45c40 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:02.973364 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964ead9-5ba3-45d0-a91c-2b33cbce1b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:02.974077 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964ead9-5ba3-45d0-a91c-2b33cbce1b9d admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:02.974371 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964ead9-5ba3-45d0-a91c-2b33cbce1b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:02.974659 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964ead9-5ba3-45d0-a91c-2b33cbce1b9d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:02.975726 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964ead9-5ba3-45d0-a91c-2b33cbce1b9d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:02.977475 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964ead9-5ba3-45d0-a91c-2b33cbce1b9d admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:02.978912 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 30/59] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:02 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:02.983942 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686d791-3319-4c19-bece-66ee745f296d None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:02.993076 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686d791-3319-4c19-bece-66ee745f296d None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:02.997140 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec97d2e-74ef-4576-b0ea-6ff1ce7bfc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:02.997731 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec97d2e-74ef-4576-b0ea-6ff1ce7bfc64 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:02.998023 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec97d2e-74ef-4576-b0ea-6ff1ce7bfc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:02.998307 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec97d2e-74ef-4576-b0ea-6ff1ce7bfc64 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:02.998993 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec97d2e-74ef-4576-b0ea-6ff1ce7bfc64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:02.999988 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING py.warnings [None req-4ec97d2e-74ef-4576-b0ea-6ff1ce7bfc64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:22:02.999988 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: warnings.warn(msg) Dec 16 14:22:02.999988 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: Dec 16 14:22:03.001277 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec97d2e-74ef-4576-b0ea-6ff1ce7bfc64 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:03.025679 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 30/60] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Dec 16 14:22:02 2021] POST /identity/v3/users => generated 275 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:22:05.654520 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618106ba-fd9a-4ac7-85a4-6d0a04dea7b5 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:05.655067 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618106ba-fd9a-4ac7-85a4-6d0a04dea7b5 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:05.655067 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618106ba-fd9a-4ac7-85a4-6d0a04dea7b5 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:05.656749 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 31/61] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:22:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:05.662618 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ead7a-58a7-4a86-bffa-d1bb08b9869a None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:05.663046 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ead7a-58a7-4a86-bffa-d1bb08b9869a None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:05.663192 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ead7a-58a7-4a86-bffa-d1bb08b9869a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:05.684716 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-588ead7a-58a7-4a86-bffa-d1bb08b9869a None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:05.685883 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-588ead7a-58a7-4a86-bffa-d1bb08b9869a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:05.693882 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 31/62] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:05.717680 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618106ba-fd9a-4ac7-85a4-6d0a04dea7b5 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:05.729923 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618106ba-fd9a-4ac7-85a4-6d0a04dea7b5 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:05.734035 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76576abe-33be-4116-bacc-3502b34e13e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:05.734757 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76576abe-33be-4116-bacc-3502b34e13e8 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:05.735053 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76576abe-33be-4116-bacc-3502b34e13e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:05.735343 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76576abe-33be-4116-bacc-3502b34e13e8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:05.746731 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76576abe-33be-4116-bacc-3502b34e13e8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:22:05.753650 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-76576abe-33be-4116-bacc-3502b34e13e8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:22:05.754773 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 32/63] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:22:05 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:22:05.760722 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ead7a-58a7-4a86-bffa-d1bb08b9869a None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:05.770054 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ead7a-58a7-4a86-bffa-d1bb08b9869a None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:05.774209 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe25712-0e71-48a0-80fa-7237d5d12a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:05.774803 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe25712-0e71-48a0-80fa-7237d5d12a2d admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:05.775095 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe25712-0e71-48a0-80fa-7237d5d12a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:05.775380 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe25712-0e71-48a0-80fa-7237d5d12a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:05.776090 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe25712-0e71-48a0-80fa-7237d5d12a2d admin admin] RBAC: Adding query filter params (name=member) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:05.776392 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe25712-0e71-48a0-80fa-7237d5d12a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:05.778045 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe25712-0e71-48a0-80fa-7237d5d12a2d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:05.786812 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 32/64] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Dec 16 14:22:05 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:05.792283 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76576abe-33be-4116-bacc-3502b34e13e8 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:05.802088 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76576abe-33be-4116-bacc-3502b34e13e8 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:05.806233 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347337a-64d0-466c-b288-6479d27ab4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:05.807027 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347337a-64d0-466c-b288-6479d27ab4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:05.807322 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347337a-64d0-466c-b288-6479d27ab4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:05.807612 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347337a-64d0-466c-b288-6479d27ab4e3 admin admin] PATH_INFO: `/v3/users/67f731571f024ec0a6d66107af3b9b7b` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:05.827359 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347337a-64d0-466c-b288-6479d27ab4e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=67f731571f024ec0a6d66107af3b9b7b)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:05.829610 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347337a-64d0-466c-b288-6479d27ab4e3 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:05.831800 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 33/65] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:22:05 2021] GET /identity/v3/users/67f731571f024ec0a6d66107af3b9b7b => generated 275 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:05.837401 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe25712-0e71-48a0-80fa-7237d5d12a2d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:05.846896 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe25712-0e71-48a0-80fa-7237d5d12a2d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:05.851072 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc6bbe-84ee-41e5-9e9c-236dae0255fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:05.851726 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc6bbe-84ee-41e5-9e9c-236dae0255fc admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:05.852094 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc6bbe-84ee-41e5-9e9c-236dae0255fc admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:05.852451 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc6bbe-84ee-41e5-9e9c-236dae0255fc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:05.860704 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc6bbe-84ee-41e5-9e9c-236dae0255fc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:05.862495 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc6bbe-84ee-41e5-9e9c-236dae0255fc admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:05.871021 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 33/66] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:22:05 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:22:05.877206 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347337a-64d0-466c-b288-6479d27ab4e3 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:05.886633 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347337a-64d0-466c-b288-6479d27ab4e3 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:05.890908 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd10d61-2851-4aa3-b5c5-1b4c28288770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:05.891706 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd10d61-2851-4aa3-b5c5-1b4c28288770 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:05.891999 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd10d61-2851-4aa3-b5c5-1b4c28288770 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:05.892855 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd10d61-2851-4aa3-b5c5-1b4c28288770 admin admin] PATH_INFO: `/v3/projects/9fcacc34d06d4718a100e858ed8da87e` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:05.893989 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd10d61-2851-4aa3-b5c5-1b4c28288770 admin admin] RBAC: Authorizing `identity:get_project(project_id=9fcacc34d06d4718a100e858ed8da87e)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:05.896084 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd10d61-2851-4aa3-b5c5-1b4c28288770 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:05.897675 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 34/67] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:22:05 2021] GET /identity/v3/projects/9fcacc34d06d4718a100e858ed8da87e => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:05.903651 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc6bbe-84ee-41e5-9e9c-236dae0255fc admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:05.912579 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc6bbe-84ee-41e5-9e9c-236dae0255fc admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:05.916694 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49487609-62a5-4bfb-bbb8-05aebbf41f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:05.917304 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49487609-62a5-4bfb-bbb8-05aebbf41f5b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:05.917600 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49487609-62a5-4bfb-bbb8-05aebbf41f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:05.917888 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49487609-62a5-4bfb-bbb8-05aebbf41f5b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:05.918670 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49487609-62a5-4bfb-bbb8-05aebbf41f5b admin admin] RBAC: Adding query filter params (role.id=0f176f9289ff497b8ed18a84bcfd34da, scope.project.id=9fcacc34d06d4718a100e858ed8da87e, user.id=67f731571f024ec0a6d66107af3b9b7b) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:05.918976 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49487609-62a5-4bfb-bbb8-05aebbf41f5b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:05.920835 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49487609-62a5-4bfb-bbb8-05aebbf41f5b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:05.926136 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 34/68] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:22:05 2021] GET /identity/v3/role_assignments?user.id=67f731571f024ec0a6d66107af3b9b7b&scope.project.id=9fcacc34d06d4718a100e858ed8da87e&role.id=0f176f9289ff497b8ed18a84bcfd34da => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:07.975536 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400613da-c469-4ac5-9971-fc3916d09080 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:07.976079 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400613da-c469-4ac5-9971-fc3916d09080 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:07.976178 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400613da-c469-4ac5-9971-fc3916d09080 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:07.977830 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 35/69] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:22:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:07.983016 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d52e4b-f707-40e6-8314-9dc6185b3348 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:07.983414 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d52e4b-f707-40e6-8314-9dc6185b3348 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:07.983586 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d52e4b-f707-40e6-8314-9dc6185b3348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:08.005705 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-d1d52e4b-f707-40e6-8314-9dc6185b3348 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:08.006838 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-d1d52e4b-f707-40e6-8314-9dc6185b3348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:08.013632 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 35/70] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:08.035792 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400613da-c469-4ac5-9971-fc3916d09080 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:08.047424 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400613da-c469-4ac5-9971-fc3916d09080 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:08.051981 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33902d61-fd29-41f9-b49e-c823ae7128b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:08.052697 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33902d61-fd29-41f9-b49e-c823ae7128b3 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:08.053023 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33902d61-fd29-41f9-b49e-c823ae7128b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:08.053314 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33902d61-fd29-41f9-b49e-c823ae7128b3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:08.064254 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33902d61-fd29-41f9-b49e-c823ae7128b3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:22:08.070669 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-33902d61-fd29-41f9-b49e-c823ae7128b3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:22:08.071754 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 36/71] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:22:08 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:08.077698 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d52e4b-f707-40e6-8314-9dc6185b3348 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:08.086191 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d52e4b-f707-40e6-8314-9dc6185b3348 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:08.090284 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af94362-90f1-486b-b6be-bcb0721c5eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:08.090878 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af94362-90f1-486b-b6be-bcb0721c5eab admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:08.091173 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af94362-90f1-486b-b6be-bcb0721c5eab admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:08.091459 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af94362-90f1-486b-b6be-bcb0721c5eab admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:08.092167 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af94362-90f1-486b-b6be-bcb0721c5eab admin admin] RBAC: Adding query filter params (name=member) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:08.092469 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af94362-90f1-486b-b6be-bcb0721c5eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:08.094083 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af94362-90f1-486b-b6be-bcb0721c5eab admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:08.102914 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 36/72] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Dec 16 14:22:08 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:08.108063 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33902d61-fd29-41f9-b49e-c823ae7128b3 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:08.118085 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33902d61-fd29-41f9-b49e-c823ae7128b3 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:08.122294 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afde49f-86f3-41b7-8a5e-47e61ee1b964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:08.123083 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afde49f-86f3-41b7-8a5e-47e61ee1b964 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:08.123372 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afde49f-86f3-41b7-8a5e-47e61ee1b964 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:08.123655 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afde49f-86f3-41b7-8a5e-47e61ee1b964 admin admin] PATH_INFO: `/v3/users/67f731571f024ec0a6d66107af3b9b7b` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:08.124805 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afde49f-86f3-41b7-8a5e-47e61ee1b964 admin admin] RBAC: Authorizing `identity:get_user(user_id=67f731571f024ec0a6d66107af3b9b7b)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:08.127444 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afde49f-86f3-41b7-8a5e-47e61ee1b964 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:08.128934 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 37/73] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:22:08 2021] GET /identity/v3/users/67f731571f024ec0a6d66107af3b9b7b => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:08.134897 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af94362-90f1-486b-b6be-bcb0721c5eab admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:08.145701 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af94362-90f1-486b-b6be-bcb0721c5eab admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:08.149731 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b4b6d-1eb2-4c40-b24b-754b0177c572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:08.150512 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b4b6d-1eb2-4c40-b24b-754b0177c572 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:08.150804 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b4b6d-1eb2-4c40-b24b-754b0177c572 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:08.151087 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b4b6d-1eb2-4c40-b24b-754b0177c572 admin admin] PATH_INFO: `/v3/projects/9fcacc34d06d4718a100e858ed8da87e` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:08.152168 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b4b6d-1eb2-4c40-b24b-754b0177c572 admin admin] RBAC: Authorizing `identity:get_project(project_id=9fcacc34d06d4718a100e858ed8da87e)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:08.154235 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b4b6d-1eb2-4c40-b24b-754b0177c572 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:08.155761 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 37/74] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:22:08 2021] GET /identity/v3/projects/9fcacc34d06d4718a100e858ed8da87e => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:08.162621 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afde49f-86f3-41b7-8a5e-47e61ee1b964 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:08.172026 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afde49f-86f3-41b7-8a5e-47e61ee1b964 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:08.176159 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8dfc2-54a9-4d19-92bb-356815928d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:08.177016 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8dfc2-54a9-4d19-92bb-356815928d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:08.177302 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8dfc2-54a9-4d19-92bb-356815928d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:08.177592 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8dfc2-54a9-4d19-92bb-356815928d44 admin admin] PATH_INFO: `/v3/projects/9fcacc34d06d4718a100e858ed8da87e/users/67f731571f024ec0a6d66107af3b9b7b/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:08.179349 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8dfc2-54a9-4d19-92bb-356815928d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fcacc34d06d4718a100e858ed8da87e, user_id=67f731571f024ec0a6d66107af3b9b7b, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:08.182048 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8dfc2-54a9-4d19-92bb-356815928d44 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:08.194855 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 38/75] 10.222.0.64 () {58 vars in 1460 bytes} [Thu Dec 16 14:22:08 2021] PUT /identity/v3/projects/9fcacc34d06d4718a100e858ed8da87e/users/67f731571f024ec0a6d66107af3b9b7b/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:22:10.284341 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc136bf1-3d2b-4f07-8e1e-79a425c1a191 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:10.284916 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc136bf1-3d2b-4f07-8e1e-79a425c1a191 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:10.285020 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc136bf1-3d2b-4f07-8e1e-79a425c1a191 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:10.286638 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 38/76] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:22:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:10.291739 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb76715-57fa-49c2-9999-a63e50f9f00d None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:10.292166 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb76715-57fa-49c2-9999-a63e50f9f00d None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:10.292316 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb76715-57fa-49c2-9999-a63e50f9f00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:10.313558 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-8eb76715-57fa-49c2-9999-a63e50f9f00d None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:10.315224 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-8eb76715-57fa-49c2-9999-a63e50f9f00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:10.381171 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 39/77] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:22:10.403885 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc136bf1-3d2b-4f07-8e1e-79a425c1a191 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:10.416079 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc136bf1-3d2b-4f07-8e1e-79a425c1a191 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:10.420023 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc7464-26bf-497d-bf00-e5c371473f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:10.420733 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc7464-26bf-497d-bf00-e5c371473f69 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:10.421071 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc7464-26bf-497d-bf00-e5c371473f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:10.421359 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc7464-26bf-497d-bf00-e5c371473f69 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:10.433225 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc7464-26bf-497d-bf00-e5c371473f69 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:22:10.439603 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-d1bc7464-26bf-497d-bf00-e5c371473f69 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:22:10.440684 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 39/78] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:22:10 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:10.446208 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb76715-57fa-49c2-9999-a63e50f9f00d None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:10.454914 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb76715-57fa-49c2-9999-a63e50f9f00d None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:10.458905 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1667acd-0a8c-4885-b0a8-e4263bc99d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:10.459501 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1667acd-0a8c-4885-b0a8-e4263bc99d44 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:10.459789 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1667acd-0a8c-4885-b0a8-e4263bc99d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:10.460071 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1667acd-0a8c-4885-b0a8-e4263bc99d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:10.460795 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1667acd-0a8c-4885-b0a8-e4263bc99d44 admin admin] RBAC: Adding query filter params (name=member) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:10.461103 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1667acd-0a8c-4885-b0a8-e4263bc99d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:10.462698 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1667acd-0a8c-4885-b0a8-e4263bc99d44 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:10.471479 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 40/79] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Dec 16 14:22:10 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:10.476744 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc7464-26bf-497d-bf00-e5c371473f69 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:10.486318 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc7464-26bf-497d-bf00-e5c371473f69 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:10.490358 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d48e9d-78d4-4bac-84a6-15b6ec5049c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:10.491131 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d48e9d-78d4-4bac-84a6-15b6ec5049c5 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:10.491421 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d48e9d-78d4-4bac-84a6-15b6ec5049c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:10.491702 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d48e9d-78d4-4bac-84a6-15b6ec5049c5 admin admin] PATH_INFO: `/v3/users/67f731571f024ec0a6d66107af3b9b7b` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:10.492802 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d48e9d-78d4-4bac-84a6-15b6ec5049c5 admin admin] RBAC: Authorizing `identity:get_user(user_id=67f731571f024ec0a6d66107af3b9b7b)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:10.494923 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d48e9d-78d4-4bac-84a6-15b6ec5049c5 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:10.496347 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 40/80] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:22:10 2021] GET /identity/v3/users/67f731571f024ec0a6d66107af3b9b7b => generated 275 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:10.501373 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1667acd-0a8c-4885-b0a8-e4263bc99d44 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:10.510439 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1667acd-0a8c-4885-b0a8-e4263bc99d44 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:10.514638 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed8767-7546-4bc5-ada3-7c57572b562f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:10.515219 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed8767-7546-4bc5-ada3-7c57572b562f admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:10.515517 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed8767-7546-4bc5-ada3-7c57572b562f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:10.515810 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed8767-7546-4bc5-ada3-7c57572b562f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:10.523493 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed8767-7546-4bc5-ada3-7c57572b562f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:10.525302 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed8767-7546-4bc5-ada3-7c57572b562f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:10.534089 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 41/81] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:22:10 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:22:10.539251 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d48e9d-78d4-4bac-84a6-15b6ec5049c5 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:10.548047 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d48e9d-78d4-4bac-84a6-15b6ec5049c5 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:10.552551 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3697a-5b60-4a21-901b-1a557609b0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:10.553341 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3697a-5b60-4a21-901b-1a557609b0fa admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:10.553635 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3697a-5b60-4a21-901b-1a557609b0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:10.553917 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3697a-5b60-4a21-901b-1a557609b0fa admin admin] PATH_INFO: `/v3/projects/9fcacc34d06d4718a100e858ed8da87e` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:10.554993 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3697a-5b60-4a21-901b-1a557609b0fa admin admin] RBAC: Authorizing `identity:get_project(project_id=9fcacc34d06d4718a100e858ed8da87e)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:10.557024 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3697a-5b60-4a21-901b-1a557609b0fa admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:10.558498 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 41/82] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:22:10 2021] GET /identity/v3/projects/9fcacc34d06d4718a100e858ed8da87e => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:22:10.564310 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed8767-7546-4bc5-ada3-7c57572b562f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:10.572716 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed8767-7546-4bc5-ada3-7c57572b562f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:10.577054 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde78c5-8ff8-4258-9416-41cb7ee52c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:10.577619 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde78c5-8ff8-4258-9416-41cb7ee52c2f admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:10.577910 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde78c5-8ff8-4258-9416-41cb7ee52c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:10.578193 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde78c5-8ff8-4258-9416-41cb7ee52c2f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:10.578954 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde78c5-8ff8-4258-9416-41cb7ee52c2f admin admin] RBAC: Adding query filter params (role.id=0f176f9289ff497b8ed18a84bcfd34da, scope.project.id=9fcacc34d06d4718a100e858ed8da87e, user.id=67f731571f024ec0a6d66107af3b9b7b) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:10.579256 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde78c5-8ff8-4258-9416-41cb7ee52c2f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:10.580738 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING py.warnings [None req-6cde78c5-8ff8-4258-9416-41cb7ee52c2f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:22:10.580738 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: warnings.warn(msg) Dec 16 14:22:10.580738 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: Dec 16 14:22:10.581900 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde78c5-8ff8-4258-9416-41cb7ee52c2f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:10.587466 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 42/83] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:22:10 2021] GET /identity/v3/role_assignments?user.id=67f731571f024ec0a6d66107af3b9b7b&scope.project.id=9fcacc34d06d4718a100e858ed8da87e&role.id=0f176f9289ff497b8ed18a84bcfd34da => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:12.767909 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488da4e-588a-49f8-bbcc-020269b30d71 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:12.768473 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488da4e-588a-49f8-bbcc-020269b30d71 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:12.768473 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488da4e-588a-49f8-bbcc-020269b30d71 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:12.770209 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 42/84] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:22:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:12.775512 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e9621-3511-4f2e-b99a-bec64fddd918 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:12.775913 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e9621-3511-4f2e-b99a-bec64fddd918 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:12.776086 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e9621-3511-4f2e-b99a-bec64fddd918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:12.798797 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-d54e9621-3511-4f2e-b99a-bec64fddd918 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:12.799936 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-d54e9621-3511-4f2e-b99a-bec64fddd918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:12.806659 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 43/85] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:12.828732 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488da4e-588a-49f8-bbcc-020269b30d71 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:12.840935 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488da4e-588a-49f8-bbcc-020269b30d71 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:12.845623 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6faf33c-f5be-444e-963b-a3b2b743bfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:12.846330 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faf33c-f5be-444e-963b-a3b2b743bfef admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:12.846626 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faf33c-f5be-444e-963b-a3b2b743bfef admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:12.846911 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faf33c-f5be-444e-963b-a3b2b743bfef admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:12.858520 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6faf33c-f5be-444e-963b-a3b2b743bfef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:22:12.865290 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-b6faf33c-f5be-444e-963b-a3b2b743bfef admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:22:12.866374 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 43/86] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:22:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:12.872317 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e9621-3511-4f2e-b99a-bec64fddd918 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:12.881402 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e9621-3511-4f2e-b99a-bec64fddd918 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:12.885419 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49763a-098e-4979-ab33-d3c298ea31c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:12.886011 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49763a-098e-4979-ab33-d3c298ea31c2 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:12.886300 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49763a-098e-4979-ab33-d3c298ea31c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:12.886583 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49763a-098e-4979-ab33-d3c298ea31c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:12.887292 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49763a-098e-4979-ab33-d3c298ea31c2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:12.887593 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49763a-098e-4979-ab33-d3c298ea31c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:12.889304 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49763a-098e-4979-ab33-d3c298ea31c2 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:12.897632 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 44/87] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:22:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:12.902880 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6faf33c-f5be-444e-963b-a3b2b743bfef admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:12.912089 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6faf33c-f5be-444e-963b-a3b2b743bfef admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:12.916143 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48e94f-86db-4ce9-a072-3bc57e573b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:12.916963 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48e94f-86db-4ce9-a072-3bc57e573b3c admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:12.917261 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48e94f-86db-4ce9-a072-3bc57e573b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:12.917551 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48e94f-86db-4ce9-a072-3bc57e573b3c admin admin] PATH_INFO: `/v3/users/8c2ac62eab7c4164bfd09ecc79a439aa` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:12.918649 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48e94f-86db-4ce9-a072-3bc57e573b3c admin admin] RBAC: Authorizing `identity:get_user(user_id=8c2ac62eab7c4164bfd09ecc79a439aa)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:12.920451 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48e94f-86db-4ce9-a072-3bc57e573b3c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:12.921937 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 44/88] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:22:12 2021] GET /identity/v3/users/8c2ac62eab7c4164bfd09ecc79a439aa => generated 247 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:12.927352 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49763a-098e-4979-ab33-d3c298ea31c2 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:12.936354 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49763a-098e-4979-ab33-d3c298ea31c2 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:12.941070 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381507a-5251-4e1a-8fcf-d7ce06496924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:12.941637 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381507a-5251-4e1a-8fcf-d7ce06496924 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:12.941927 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381507a-5251-4e1a-8fcf-d7ce06496924 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:12.942230 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381507a-5251-4e1a-8fcf-d7ce06496924 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:12.949943 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381507a-5251-4e1a-8fcf-d7ce06496924 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:12.951675 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381507a-5251-4e1a-8fcf-d7ce06496924 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:12.960059 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 45/89] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:22:12 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:22:12.965469 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48e94f-86db-4ce9-a072-3bc57e573b3c admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:12.974620 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48e94f-86db-4ce9-a072-3bc57e573b3c admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:12.978668 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e0a00-7c52-4e55-9445-6287963335ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:12.979431 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e0a00-7c52-4e55-9445-6287963335ee admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:12.979724 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e0a00-7c52-4e55-9445-6287963335ee admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:12.980013 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e0a00-7c52-4e55-9445-6287963335ee admin admin] PATH_INFO: `/v3/projects/9fcacc34d06d4718a100e858ed8da87e` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:12.981141 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e0a00-7c52-4e55-9445-6287963335ee admin admin] RBAC: Authorizing `identity:get_project(project_id=9fcacc34d06d4718a100e858ed8da87e)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:12.983175 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e0a00-7c52-4e55-9445-6287963335ee admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:12.984666 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 45/90] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:22:12 2021] GET /identity/v3/projects/9fcacc34d06d4718a100e858ed8da87e => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:12.990608 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381507a-5251-4e1a-8fcf-d7ce06496924 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:12.998978 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381507a-5251-4e1a-8fcf-d7ce06496924 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:13.003720 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f119d-09a7-4fce-a1d0-e360f0fd6f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:13.004290 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f119d-09a7-4fce-a1d0-e360f0fd6f78 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:13.004583 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f119d-09a7-4fce-a1d0-e360f0fd6f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:13.004903 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f119d-09a7-4fce-a1d0-e360f0fd6f78 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:13.005676 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f119d-09a7-4fce-a1d0-e360f0fd6f78 admin admin] RBAC: Adding query filter params (role.id=90166eb3dcfa41e58450e140b8b0fea3, scope.project.id=9fcacc34d06d4718a100e858ed8da87e, user.id=8c2ac62eab7c4164bfd09ecc79a439aa) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:13.005984 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f119d-09a7-4fce-a1d0-e360f0fd6f78 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:13.007826 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f119d-09a7-4fce-a1d0-e360f0fd6f78 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:13.013063 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 46/91] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:22:12 2021] GET /identity/v3/role_assignments?user.id=8c2ac62eab7c4164bfd09ecc79a439aa&scope.project.id=9fcacc34d06d4718a100e858ed8da87e&role.id=90166eb3dcfa41e58450e140b8b0fea3 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:15.042586 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60532b6-c0e4-454d-b91f-f885fd095d04 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:15.043126 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60532b6-c0e4-454d-b91f-f885fd095d04 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:15.043230 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60532b6-c0e4-454d-b91f-f885fd095d04 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:15.044857 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 46/92] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:22:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:15.050666 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472d1a6-7cde-4301-b2d8-dac43d0ffd04 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:15.051042 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472d1a6-7cde-4301-b2d8-dac43d0ffd04 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:15.051243 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472d1a6-7cde-4301-b2d8-dac43d0ffd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:15.073291 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-c472d1a6-7cde-4301-b2d8-dac43d0ffd04 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:15.074672 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-c472d1a6-7cde-4301-b2d8-dac43d0ffd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:15.081415 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 47/93] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:15.103130 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60532b6-c0e4-454d-b91f-f885fd095d04 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:15.115233 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60532b6-c0e4-454d-b91f-f885fd095d04 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:15.119282 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48487885-da26-48fd-82b7-4c4cc2354a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:15.119990 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48487885-da26-48fd-82b7-4c4cc2354a10 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:15.120286 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48487885-da26-48fd-82b7-4c4cc2354a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:15.120572 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48487885-da26-48fd-82b7-4c4cc2354a10 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:15.132176 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48487885-da26-48fd-82b7-4c4cc2354a10 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:22:15.138446 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-48487885-da26-48fd-82b7-4c4cc2354a10 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:22:15.139851 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 47/94] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:22:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:15.145668 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472d1a6-7cde-4301-b2d8-dac43d0ffd04 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:15.154340 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472d1a6-7cde-4301-b2d8-dac43d0ffd04 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:15.158403 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660ad73-3f76-464a-b187-0bf2aed6eb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:15.159013 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660ad73-3f76-464a-b187-0bf2aed6eb12 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:15.159309 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660ad73-3f76-464a-b187-0bf2aed6eb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:15.159598 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660ad73-3f76-464a-b187-0bf2aed6eb12 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:15.160318 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660ad73-3f76-464a-b187-0bf2aed6eb12 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:15.160624 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660ad73-3f76-464a-b187-0bf2aed6eb12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:15.162294 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660ad73-3f76-464a-b187-0bf2aed6eb12 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:15.170733 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 48/95] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:22:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:15.176612 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48487885-da26-48fd-82b7-4c4cc2354a10 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:15.186331 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48487885-da26-48fd-82b7-4c4cc2354a10 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:15.191010 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92382e36-9ade-412a-bbc6-6fd9b07a93de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:15.191791 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92382e36-9ade-412a-bbc6-6fd9b07a93de admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:15.192425 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92382e36-9ade-412a-bbc6-6fd9b07a93de admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:15.192723 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92382e36-9ade-412a-bbc6-6fd9b07a93de admin admin] PATH_INFO: `/v3/users/8c2ac62eab7c4164bfd09ecc79a439aa` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:15.193853 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92382e36-9ade-412a-bbc6-6fd9b07a93de admin admin] RBAC: Authorizing `identity:get_user(user_id=8c2ac62eab7c4164bfd09ecc79a439aa)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:15.195698 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92382e36-9ade-412a-bbc6-6fd9b07a93de admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:15.197177 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 48/96] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:22:15 2021] GET /identity/v3/users/8c2ac62eab7c4164bfd09ecc79a439aa => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:15.202551 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660ad73-3f76-464a-b187-0bf2aed6eb12 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:15.211736 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660ad73-3f76-464a-b187-0bf2aed6eb12 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:15.215775 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9077a56-0ee8-4f12-aea7-3c8e07920c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:15.216549 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9077a56-0ee8-4f12-aea7-3c8e07920c4f admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:15.216865 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9077a56-0ee8-4f12-aea7-3c8e07920c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:15.217151 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9077a56-0ee8-4f12-aea7-3c8e07920c4f admin admin] PATH_INFO: `/v3/projects/9fcacc34d06d4718a100e858ed8da87e` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:15.218236 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9077a56-0ee8-4f12-aea7-3c8e07920c4f admin admin] RBAC: Authorizing `identity:get_project(project_id=9fcacc34d06d4718a100e858ed8da87e)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:15.220288 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9077a56-0ee8-4f12-aea7-3c8e07920c4f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:15.221818 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 49/97] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:22:15 2021] GET /identity/v3/projects/9fcacc34d06d4718a100e858ed8da87e => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:22:15.227071 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92382e36-9ade-412a-bbc6-6fd9b07a93de admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:15.236823 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92382e36-9ade-412a-bbc6-6fd9b07a93de admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:15.240850 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7d66e-ceeb-45fe-b607-11ee0cd37efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:15.241650 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7d66e-ceeb-45fe-b607-11ee0cd37efd admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:15.241943 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7d66e-ceeb-45fe-b607-11ee0cd37efd admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:15.242227 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7d66e-ceeb-45fe-b607-11ee0cd37efd admin admin] PATH_INFO: `/v3/projects/9fcacc34d06d4718a100e858ed8da87e/users/8c2ac62eab7c4164bfd09ecc79a439aa/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:15.243977 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7d66e-ceeb-45fe-b607-11ee0cd37efd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fcacc34d06d4718a100e858ed8da87e, user_id=8c2ac62eab7c4164bfd09ecc79a439aa, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:15.244994 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING py.warnings [None req-75f7d66e-ceeb-45fe-b607-11ee0cd37efd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:22:15.244994 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: warnings.warn(msg) Dec 16 14:22:15.244994 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: Dec 16 14:22:15.247043 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7d66e-ceeb-45fe-b607-11ee0cd37efd admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:15.260716 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 49/98] 10.222.0.64 () {58 vars in 1460 bytes} [Thu Dec 16 14:22:15 2021] PUT /identity/v3/projects/9fcacc34d06d4718a100e858ed8da87e/users/8c2ac62eab7c4164bfd09ecc79a439aa/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:22:17.290830 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52443bd-8198-4120-af34-b21d7b15fca2 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:17.291377 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52443bd-8198-4120-af34-b21d7b15fca2 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:17.291623 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52443bd-8198-4120-af34-b21d7b15fca2 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:17.293892 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 50/99] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:22:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:17.299400 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3c087-d0fd-4f83-a995-283ef8c71c63 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:17.299784 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3c087-d0fd-4f83-a995-283ef8c71c63 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:17.299966 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3c087-d0fd-4f83-a995-283ef8c71c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:17.322032 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-6df3c087-d0fd-4f83-a995-283ef8c71c63 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:17.323150 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-6df3c087-d0fd-4f83-a995-283ef8c71c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:17.385313 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 50/100] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:17.407605 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52443bd-8198-4120-af34-b21d7b15fca2 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:17.419237 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52443bd-8198-4120-af34-b21d7b15fca2 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:17.423754 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffdf78-d6a0-4f21-aa58-f16a4dc5030d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:17.424463 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffdf78-d6a0-4f21-aa58-f16a4dc5030d admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:17.424759 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffdf78-d6a0-4f21-aa58-f16a4dc5030d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:17.425077 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffdf78-d6a0-4f21-aa58-f16a4dc5030d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:17.436434 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffdf78-d6a0-4f21-aa58-f16a4dc5030d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:22:17.443418 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-bbffdf78-d6a0-4f21-aa58-f16a4dc5030d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:22:17.444498 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 51/101] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:22:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:17.450438 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3c087-d0fd-4f83-a995-283ef8c71c63 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:17.458849 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3c087-d0fd-4f83-a995-283ef8c71c63 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:17.462929 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9732375-8149-40f3-b684-4c7dfcad8849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:17.463519 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9732375-8149-40f3-b684-4c7dfcad8849 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:17.463815 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9732375-8149-40f3-b684-4c7dfcad8849 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:17.464104 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9732375-8149-40f3-b684-4c7dfcad8849 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:17.464841 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9732375-8149-40f3-b684-4c7dfcad8849 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:17.465201 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9732375-8149-40f3-b684-4c7dfcad8849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:17.466813 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9732375-8149-40f3-b684-4c7dfcad8849 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:17.475091 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 51/102] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:22:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:17.480402 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffdf78-d6a0-4f21-aa58-f16a4dc5030d admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:17.490096 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffdf78-d6a0-4f21-aa58-f16a4dc5030d admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:17.494250 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03377fa-584d-4965-91a2-8fa4e0375a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:17.495029 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03377fa-584d-4965-91a2-8fa4e0375a1c admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:17.495322 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03377fa-584d-4965-91a2-8fa4e0375a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:17.495608 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03377fa-584d-4965-91a2-8fa4e0375a1c admin admin] PATH_INFO: `/v3/users/8c2ac62eab7c4164bfd09ecc79a439aa` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:17.496699 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03377fa-584d-4965-91a2-8fa4e0375a1c admin admin] RBAC: Authorizing `identity:get_user(user_id=8c2ac62eab7c4164bfd09ecc79a439aa)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:17.498571 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03377fa-584d-4965-91a2-8fa4e0375a1c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:17.500023 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 52/103] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:22:17 2021] GET /identity/v3/users/8c2ac62eab7c4164bfd09ecc79a439aa => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:17.505711 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9732375-8149-40f3-b684-4c7dfcad8849 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:17.514838 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9732375-8149-40f3-b684-4c7dfcad8849 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:17.518952 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4b46e-02ee-451e-b35e-baf7165b3bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:17.519522 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4b46e-02ee-451e-b35e-baf7165b3bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:17.519818 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4b46e-02ee-451e-b35e-baf7165b3bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:17.520108 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4b46e-02ee-451e-b35e-baf7165b3bc2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:17.527666 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4b46e-02ee-451e-b35e-baf7165b3bc2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:17.529449 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4b46e-02ee-451e-b35e-baf7165b3bc2 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:17.537656 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 52/104] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:22:17 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:22:17.542857 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03377fa-584d-4965-91a2-8fa4e0375a1c admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:17.552302 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03377fa-584d-4965-91a2-8fa4e0375a1c admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:17.556334 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b02c7-b65c-49a9-b578-6abaacdd7b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:17.557135 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b02c7-b65c-49a9-b578-6abaacdd7b33 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:17.557429 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b02c7-b65c-49a9-b578-6abaacdd7b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:17.557720 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b02c7-b65c-49a9-b578-6abaacdd7b33 admin admin] PATH_INFO: `/v3/projects/9fcacc34d06d4718a100e858ed8da87e` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:17.558805 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b02c7-b65c-49a9-b578-6abaacdd7b33 admin admin] RBAC: Authorizing `identity:get_project(project_id=9fcacc34d06d4718a100e858ed8da87e)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:17.560954 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b02c7-b65c-49a9-b578-6abaacdd7b33 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:17.562386 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 53/105] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:22:17 2021] GET /identity/v3/projects/9fcacc34d06d4718a100e858ed8da87e => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:17.569164 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4b46e-02ee-451e-b35e-baf7165b3bc2 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:17.578742 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4b46e-02ee-451e-b35e-baf7165b3bc2 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:17.583947 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5826d0-52f8-45cf-ad18-f611e6a2cf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:17.584616 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5826d0-52f8-45cf-ad18-f611e6a2cf2b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:17.585030 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5826d0-52f8-45cf-ad18-f611e6a2cf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:17.585400 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5826d0-52f8-45cf-ad18-f611e6a2cf2b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:17.586305 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5826d0-52f8-45cf-ad18-f611e6a2cf2b admin admin] RBAC: Adding query filter params (role.id=90166eb3dcfa41e58450e140b8b0fea3, scope.project.id=9fcacc34d06d4718a100e858ed8da87e, user.id=8c2ac62eab7c4164bfd09ecc79a439aa) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:17.586676 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5826d0-52f8-45cf-ad18-f611e6a2cf2b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:17.589040 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5826d0-52f8-45cf-ad18-f611e6a2cf2b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:17.596208 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 53/106] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:22:17 2021] GET /identity/v3/role_assignments?user.id=8c2ac62eab7c4164bfd09ecc79a439aa&scope.project.id=9fcacc34d06d4718a100e858ed8da87e&role.id=90166eb3dcfa41e58450e140b8b0fea3 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:19.819353 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1de25-0538-4346-bcde-6c88fe1f4357 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:19.819892 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1de25-0538-4346-bcde-6c88fe1f4357 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:19.819892 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1de25-0538-4346-bcde-6c88fe1f4357 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:19.821648 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 54/107] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:22:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:19.827171 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111a2e4-a462-45e2-8edb-7c69fc299abd None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:19.827575 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111a2e4-a462-45e2-8edb-7c69fc299abd None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:19.827812 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111a2e4-a462-45e2-8edb-7c69fc299abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:19.850817 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-8111a2e4-a462-45e2-8edb-7c69fc299abd None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:19.851955 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-8111a2e4-a462-45e2-8edb-7c69fc299abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:19.858946 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 54/108] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:19.881977 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1de25-0538-4346-bcde-6c88fe1f4357 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:19.894595 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1de25-0538-4346-bcde-6c88fe1f4357 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:19.898617 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4e9f0-b308-4baf-bd10-0e72bd093e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:19.899341 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4e9f0-b308-4baf-bd10-0e72bd093e09 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:19.899633 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4e9f0-b308-4baf-bd10-0e72bd093e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:19.899920 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4e9f0-b308-4baf-bd10-0e72bd093e09 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:19.911461 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4e9f0-b308-4baf-bd10-0e72bd093e09 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:22:19.918128 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-cab4e9f0-b308-4baf-bd10-0e72bd093e09 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 16 14:22:19.919200 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 55/109] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:22:19 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:19.925409 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111a2e4-a462-45e2-8edb-7c69fc299abd None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:19.934461 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111a2e4-a462-45e2-8edb-7c69fc299abd None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:19.938582 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2c43a-7ff5-4668-ac19-939d6b02a837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:19.939188 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2c43a-7ff5-4668-ac19-939d6b02a837 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:19.939478 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2c43a-7ff5-4668-ac19-939d6b02a837 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:19.939769 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2c43a-7ff5-4668-ac19-939d6b02a837 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:19.940482 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2c43a-7ff5-4668-ac19-939d6b02a837 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:19.940800 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2c43a-7ff5-4668-ac19-939d6b02a837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:19.942678 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2c43a-7ff5-4668-ac19-939d6b02a837 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:19.951358 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 55/110] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:22:19 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:19.956574 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4e9f0-b308-4baf-bd10-0e72bd093e09 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:19.966182 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4e9f0-b308-4baf-bd10-0e72bd093e09 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:19.970707 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ee893-70cc-427c-968c-f4a69acf8667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:19.971477 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ee893-70cc-427c-968c-f4a69acf8667 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:19.971768 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ee893-70cc-427c-968c-f4a69acf8667 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:19.972051 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ee893-70cc-427c-968c-f4a69acf8667 admin admin] PATH_INFO: `/v3/users/67f731571f024ec0a6d66107af3b9b7b` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:19.973169 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ee893-70cc-427c-968c-f4a69acf8667 admin admin] RBAC: Authorizing `identity:get_user(user_id=67f731571f024ec0a6d66107af3b9b7b)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:19.975290 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ee893-70cc-427c-968c-f4a69acf8667 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:19.976714 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 56/111] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:22:19 2021] GET /identity/v3/users/67f731571f024ec0a6d66107af3b9b7b => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:19.981777 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2c43a-7ff5-4668-ac19-939d6b02a837 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:19.991448 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2c43a-7ff5-4668-ac19-939d6b02a837 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:19.995541 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d6d03-5de2-47aa-8ca9-99490c075713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:19.996111 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d6d03-5de2-47aa-8ca9-99490c075713 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:19.996407 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d6d03-5de2-47aa-8ca9-99490c075713 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:19.996695 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d6d03-5de2-47aa-8ca9-99490c075713 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:20.004285 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d6d03-5de2-47aa-8ca9-99490c075713 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:20.006073 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d6d03-5de2-47aa-8ca9-99490c075713 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:20.014330 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 56/112] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:22:19 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:22:20.019429 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ee893-70cc-427c-968c-f4a69acf8667 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:20.028704 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ee893-70cc-427c-968c-f4a69acf8667 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:20.033377 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9e8f9-2804-4499-8f68-0e9eaf1b3ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:20.034136 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9e8f9-2804-4499-8f68-0e9eaf1b3ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:20.034430 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9e8f9-2804-4499-8f68-0e9eaf1b3ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:20.034714 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9e8f9-2804-4499-8f68-0e9eaf1b3ef4 admin admin] PATH_INFO: `/v3/projects/9fcacc34d06d4718a100e858ed8da87e` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:20.035790 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9e8f9-2804-4499-8f68-0e9eaf1b3ef4 admin admin] RBAC: Authorizing `identity:get_project(project_id=9fcacc34d06d4718a100e858ed8da87e)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:20.037886 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9e8f9-2804-4499-8f68-0e9eaf1b3ef4 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:20.039371 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 57/113] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:22:20 2021] GET /identity/v3/projects/9fcacc34d06d4718a100e858ed8da87e => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:20.044753 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d6d03-5de2-47aa-8ca9-99490c075713 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:20.053682 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d6d03-5de2-47aa-8ca9-99490c075713 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:20.057750 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6dea77-ae1f-4e4a-8474-22e36877f83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:20.058314 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dea77-ae1f-4e4a-8474-22e36877f83a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:20.058604 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dea77-ae1f-4e4a-8474-22e36877f83a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:20.058897 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dea77-ae1f-4e4a-8474-22e36877f83a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:20.059658 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6dea77-ae1f-4e4a-8474-22e36877f83a admin admin] RBAC: Adding query filter params (role.id=54d74c28321f47c3a3b68ea9f95925d8, scope.project.id=9fcacc34d06d4718a100e858ed8da87e, user.id=67f731571f024ec0a6d66107af3b9b7b) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:20.059964 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6dea77-ae1f-4e4a-8474-22e36877f83a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:20.061809 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6dea77-ae1f-4e4a-8474-22e36877f83a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:20.067030 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 57/114] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:22:20 2021] GET /identity/v3/role_assignments?user.id=67f731571f024ec0a6d66107af3b9b7b&scope.project.id=9fcacc34d06d4718a100e858ed8da87e&role.id=54d74c28321f47c3a3b68ea9f95925d8 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:22.117177 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79eae7-1e26-4839-8115-db1af4af6670 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:22.117660 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79eae7-1e26-4839-8115-db1af4af6670 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:22.117660 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79eae7-1e26-4839-8115-db1af4af6670 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:22.119353 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 58/115] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:22:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:22.124413 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13625d22-831b-4a2a-b3b6-061f8609b471 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:22.124802 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13625d22-831b-4a2a-b3b6-061f8609b471 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:22.125017 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13625d22-831b-4a2a-b3b6-061f8609b471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:22.146968 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-13625d22-831b-4a2a-b3b6-061f8609b471 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:22.148080 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-13625d22-831b-4a2a-b3b6-061f8609b471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:22.154813 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 58/116] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:22.176935 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79eae7-1e26-4839-8115-db1af4af6670 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:22.189136 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79eae7-1e26-4839-8115-db1af4af6670 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:22.193135 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5c4f6-0eba-44ac-a570-8ad75db88b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:22.193856 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5c4f6-0eba-44ac-a570-8ad75db88b28 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:22.194144 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5c4f6-0eba-44ac-a570-8ad75db88b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:22.194427 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5c4f6-0eba-44ac-a570-8ad75db88b28 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:22.206292 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5c4f6-0eba-44ac-a570-8ad75db88b28 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:22:22.212810 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-afd5c4f6-0eba-44ac-a570-8ad75db88b28 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 16 14:22:22.213886 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 59/117] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:22:22 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:22:22.219508 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13625d22-831b-4a2a-b3b6-061f8609b471 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:22.227934 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13625d22-831b-4a2a-b3b6-061f8609b471 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:22.231933 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c26c5-6b1b-4cdd-9e86-679e35b2dc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:22.232525 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c26c5-6b1b-4cdd-9e86-679e35b2dc52 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:22.232844 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c26c5-6b1b-4cdd-9e86-679e35b2dc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:22.233131 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c26c5-6b1b-4cdd-9e86-679e35b2dc52 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:22.233834 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c26c5-6b1b-4cdd-9e86-679e35b2dc52 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:22.234132 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c26c5-6b1b-4cdd-9e86-679e35b2dc52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:22.235712 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c26c5-6b1b-4cdd-9e86-679e35b2dc52 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:22.243816 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 59/118] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:22:22 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:22.249119 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5c4f6-0eba-44ac-a570-8ad75db88b28 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:22.259464 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5c4f6-0eba-44ac-a570-8ad75db88b28 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:22.263692 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff28a9-b970-47fc-9db6-a5e7e73e2b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:22.264476 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff28a9-b970-47fc-9db6-a5e7e73e2b5e admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:22.264773 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff28a9-b970-47fc-9db6-a5e7e73e2b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:22.265094 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff28a9-b970-47fc-9db6-a5e7e73e2b5e admin admin] PATH_INFO: `/v3/users/67f731571f024ec0a6d66107af3b9b7b` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:22.266837 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff28a9-b970-47fc-9db6-a5e7e73e2b5e admin admin] RBAC: Authorizing `identity:get_user(user_id=67f731571f024ec0a6d66107af3b9b7b)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:22.269046 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff28a9-b970-47fc-9db6-a5e7e73e2b5e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:22.270514 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 60/119] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:22:22 2021] GET /identity/v3/users/67f731571f024ec0a6d66107af3b9b7b => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:22.275965 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c26c5-6b1b-4cdd-9e86-679e35b2dc52 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:22.285335 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c26c5-6b1b-4cdd-9e86-679e35b2dc52 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:22.289313 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027490c9-cf43-4cca-b8a6-44686e94f5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:22.290087 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027490c9-cf43-4cca-b8a6-44686e94f5cb admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:22.290379 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027490c9-cf43-4cca-b8a6-44686e94f5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:22.290661 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027490c9-cf43-4cca-b8a6-44686e94f5cb admin admin] PATH_INFO: `/v3/projects/9fcacc34d06d4718a100e858ed8da87e` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:22.291737 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027490c9-cf43-4cca-b8a6-44686e94f5cb admin admin] RBAC: Authorizing `identity:get_project(project_id=9fcacc34d06d4718a100e858ed8da87e)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:22.293815 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027490c9-cf43-4cca-b8a6-44686e94f5cb admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:22.295311 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 60/120] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:22:22 2021] GET /identity/v3/projects/9fcacc34d06d4718a100e858ed8da87e => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:22.300806 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff28a9-b970-47fc-9db6-a5e7e73e2b5e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:22.310025 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff28a9-b970-47fc-9db6-a5e7e73e2b5e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:22.314585 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5dba45-4935-4dba-8374-a959dff855fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:22.315441 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dba45-4935-4dba-8374-a959dff855fd admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:22.315735 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dba45-4935-4dba-8374-a959dff855fd admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:22.316023 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dba45-4935-4dba-8374-a959dff855fd admin admin] PATH_INFO: `/v3/projects/9fcacc34d06d4718a100e858ed8da87e/users/67f731571f024ec0a6d66107af3b9b7b/roles/54d74c28321f47c3a3b68ea9f95925d8` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:22.318142 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5dba45-4935-4dba-8374-a959dff855fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fcacc34d06d4718a100e858ed8da87e, user_id=67f731571f024ec0a6d66107af3b9b7b, role_id=54d74c28321f47c3a3b68ea9f95925d8)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:22.320798 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5dba45-4935-4dba-8374-a959dff855fd admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:22.333316 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 61/121] 10.222.0.64 () {58 vars in 1460 bytes} [Thu Dec 16 14:22:22 2021] PUT /identity/v3/projects/9fcacc34d06d4718a100e858ed8da87e/users/67f731571f024ec0a6d66107af3b9b7b/roles/54d74c28321f47c3a3b68ea9f95925d8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:22:24.337328 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966a22f-04fc-4686-9c6a-85cbc62883bd None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:24.337840 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966a22f-04fc-4686-9c6a-85cbc62883bd None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:24.337953 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966a22f-04fc-4686-9c6a-85cbc62883bd None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:24.339551 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 61/122] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:22:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:24.345247 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c18340-0c64-4720-94f6-84d966cc7a7e None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:24.345608 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c18340-0c64-4720-94f6-84d966cc7a7e None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:24.345820 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c18340-0c64-4720-94f6-84d966cc7a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:24.368852 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-a7c18340-0c64-4720-94f6-84d966cc7a7e None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:24.370108 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-a7c18340-0c64-4720-94f6-84d966cc7a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:24.433126 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 62/123] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:24.457706 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966a22f-04fc-4686-9c6a-85cbc62883bd None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:24.469294 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966a22f-04fc-4686-9c6a-85cbc62883bd None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:24.473244 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c8c2f-21ca-4e69-bcb7-b2bede7e8aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:24.473967 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c8c2f-21ca-4e69-bcb7-b2bede7e8aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:24.474258 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c8c2f-21ca-4e69-bcb7-b2bede7e8aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:24.474542 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c8c2f-21ca-4e69-bcb7-b2bede7e8aa0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:24.485779 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c8c2f-21ca-4e69-bcb7-b2bede7e8aa0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:22:24.492384 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-2c9c8c2f-21ca-4e69-bcb7-b2bede7e8aa0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 16 14:22:24.493486 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 62/124] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:22:24 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:24.498963 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c18340-0c64-4720-94f6-84d966cc7a7e None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:24.507876 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c18340-0c64-4720-94f6-84d966cc7a7e None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:24.511984 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632b2bb-063d-410a-b55a-59e3c6f65e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:24.512570 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632b2bb-063d-410a-b55a-59e3c6f65e78 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:24.512899 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632b2bb-063d-410a-b55a-59e3c6f65e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:24.513186 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632b2bb-063d-410a-b55a-59e3c6f65e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:24.513893 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632b2bb-063d-410a-b55a-59e3c6f65e78 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:24.514198 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632b2bb-063d-410a-b55a-59e3c6f65e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:24.515796 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632b2bb-063d-410a-b55a-59e3c6f65e78 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:24.524591 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 63/125] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:22:24 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:24.529934 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c8c2f-21ca-4e69-bcb7-b2bede7e8aa0 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:24.539101 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c8c2f-21ca-4e69-bcb7-b2bede7e8aa0 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:24.543172 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878f0ac-66d3-4e40-817a-71e218c7e7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:24.543949 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878f0ac-66d3-4e40-817a-71e218c7e7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:24.544243 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878f0ac-66d3-4e40-817a-71e218c7e7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:24.544529 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878f0ac-66d3-4e40-817a-71e218c7e7b2 admin admin] PATH_INFO: `/v3/users/67f731571f024ec0a6d66107af3b9b7b` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:24.545667 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878f0ac-66d3-4e40-817a-71e218c7e7b2 admin admin] RBAC: Authorizing `identity:get_user(user_id=67f731571f024ec0a6d66107af3b9b7b)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:24.547802 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878f0ac-66d3-4e40-817a-71e218c7e7b2 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:24.549291 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 63/126] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:22:24 2021] GET /identity/v3/users/67f731571f024ec0a6d66107af3b9b7b => generated 275 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:24.554313 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632b2bb-063d-410a-b55a-59e3c6f65e78 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:24.563783 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632b2bb-063d-410a-b55a-59e3c6f65e78 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:24.567750 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b11385-d8c5-41c1-9031-99a047a85cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:24.568314 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b11385-d8c5-41c1-9031-99a047a85cfc admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:24.568601 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b11385-d8c5-41c1-9031-99a047a85cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:24.568919 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b11385-d8c5-41c1-9031-99a047a85cfc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:24.576588 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b11385-d8c5-41c1-9031-99a047a85cfc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:24.578339 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b11385-d8c5-41c1-9031-99a047a85cfc admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:24.587261 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 64/127] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:22:24 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:22:24.592462 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878f0ac-66d3-4e40-817a-71e218c7e7b2 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:24.601869 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878f0ac-66d3-4e40-817a-71e218c7e7b2 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:24.605922 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e66b3-e1cd-4953-bed4-30e2eb45a704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:24.606689 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e66b3-e1cd-4953-bed4-30e2eb45a704 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:24.606982 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e66b3-e1cd-4953-bed4-30e2eb45a704 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:24.607268 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e66b3-e1cd-4953-bed4-30e2eb45a704 admin admin] PATH_INFO: `/v3/projects/9fcacc34d06d4718a100e858ed8da87e` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:24.608349 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e66b3-e1cd-4953-bed4-30e2eb45a704 admin admin] RBAC: Authorizing `identity:get_project(project_id=9fcacc34d06d4718a100e858ed8da87e)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:24.610453 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e66b3-e1cd-4953-bed4-30e2eb45a704 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:24.611941 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 64/128] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:22:24 2021] GET /identity/v3/projects/9fcacc34d06d4718a100e858ed8da87e => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:24.617546 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b11385-d8c5-41c1-9031-99a047a85cfc admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:24.626551 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b11385-d8c5-41c1-9031-99a047a85cfc admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:24.630684 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f62113-bafd-408a-bea6-58bd4c296309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:24.631251 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f62113-bafd-408a-bea6-58bd4c296309 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:24.631545 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f62113-bafd-408a-bea6-58bd4c296309 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:24.631833 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f62113-bafd-408a-bea6-58bd4c296309 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:24.632606 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f62113-bafd-408a-bea6-58bd4c296309 admin admin] RBAC: Adding query filter params (role.id=54d74c28321f47c3a3b68ea9f95925d8, scope.project.id=9fcacc34d06d4718a100e858ed8da87e, user.id=67f731571f024ec0a6d66107af3b9b7b) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:24.632961 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f62113-bafd-408a-bea6-58bd4c296309 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:24.634796 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f62113-bafd-408a-bea6-58bd4c296309 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:24.640332 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 65/129] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:22:24 2021] GET /identity/v3/role_assignments?user.id=67f731571f024ec0a6d66107af3b9b7b&scope.project.id=9fcacc34d06d4718a100e858ed8da87e&role.id=54d74c28321f47c3a3b68ea9f95925d8 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:26.848753 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a296459-e2c6-43af-8759-8eb4832fb67d None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:26.849273 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a296459-e2c6-43af-8759-8eb4832fb67d None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:26.849354 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a296459-e2c6-43af-8759-8eb4832fb67d None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:26.851024 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 65/130] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:22:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:26.856197 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f13be-0791-4144-96c6-859ec91038df None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:26.856603 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f13be-0791-4144-96c6-859ec91038df None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:26.856766 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f13be-0791-4144-96c6-859ec91038df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:26.879077 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-d63f13be-0791-4144-96c6-859ec91038df None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:26.880317 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-d63f13be-0791-4144-96c6-859ec91038df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:26.887111 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 66/131] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:26.910182 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a296459-e2c6-43af-8759-8eb4832fb67d None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:26.921807 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a296459-e2c6-43af-8759-8eb4832fb67d None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:26.925795 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4f25b-15de-4ce2-8803-59c296fbcbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:26.926511 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4f25b-15de-4ce2-8803-59c296fbcbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:26.926803 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4f25b-15de-4ce2-8803-59c296fbcbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:26.927091 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4f25b-15de-4ce2-8803-59c296fbcbd9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:26.939896 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4f25b-15de-4ce2-8803-59c296fbcbd9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:22:26.946222 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-68d4f25b-15de-4ce2-8803-59c296fbcbd9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:22:26.947340 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 66/132] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:22:26 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:26.954038 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f13be-0791-4144-96c6-859ec91038df None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:26.962788 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f13be-0791-4144-96c6-859ec91038df None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:26.966827 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e664ec-35ef-49ec-bd97-39aad75c13f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:26.967421 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e664ec-35ef-49ec-bd97-39aad75c13f5 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:26.967711 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e664ec-35ef-49ec-bd97-39aad75c13f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:26.967996 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e664ec-35ef-49ec-bd97-39aad75c13f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:26.968710 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e664ec-35ef-49ec-bd97-39aad75c13f5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:26.969526 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e664ec-35ef-49ec-bd97-39aad75c13f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:26.971116 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e664ec-35ef-49ec-bd97-39aad75c13f5 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:26.979494 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 67/133] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Dec 16 14:22:26 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:26.985661 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4f25b-15de-4ce2-8803-59c296fbcbd9 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:26.996922 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4f25b-15de-4ce2-8803-59c296fbcbd9 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:27.001004 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16c11b-c6ac-404b-8c7c-05cf6f60fcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:27.001813 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16c11b-c6ac-404b-8c7c-05cf6f60fcc4 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:27.002076 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16c11b-c6ac-404b-8c7c-05cf6f60fcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:27.002359 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16c11b-c6ac-404b-8c7c-05cf6f60fcc4 admin admin] PATH_INFO: `/v3/users/67f731571f024ec0a6d66107af3b9b7b` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:27.003459 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16c11b-c6ac-404b-8c7c-05cf6f60fcc4 admin admin] RBAC: Authorizing `identity:get_user(user_id=67f731571f024ec0a6d66107af3b9b7b)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:27.005605 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16c11b-c6ac-404b-8c7c-05cf6f60fcc4 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:27.007053 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 67/134] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:22:26 2021] GET /identity/v3/users/67f731571f024ec0a6d66107af3b9b7b => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:27.012178 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e664ec-35ef-49ec-bd97-39aad75c13f5 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:27.021223 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e664ec-35ef-49ec-bd97-39aad75c13f5 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:27.025562 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685858d-5cc2-4616-89b6-7a10aac5e434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:27.026140 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685858d-5cc2-4616-89b6-7a10aac5e434 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:27.026510 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685858d-5cc2-4616-89b6-7a10aac5e434 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:27.026722 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685858d-5cc2-4616-89b6-7a10aac5e434 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:27.034766 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685858d-5cc2-4616-89b6-7a10aac5e434 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:27.036519 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685858d-5cc2-4616-89b6-7a10aac5e434 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:27.044735 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 68/135] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:22:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:22:27.050687 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16c11b-c6ac-404b-8c7c-05cf6f60fcc4 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:27.059717 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16c11b-c6ac-404b-8c7c-05cf6f60fcc4 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:27.063783 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954b832-1c89-4bf1-a3f2-dc009658fe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:27.065112 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954b832-1c89-4bf1-a3f2-dc009658fe33 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:27.065112 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954b832-1c89-4bf1-a3f2-dc009658fe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:27.065340 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954b832-1c89-4bf1-a3f2-dc009658fe33 admin admin] PATH_INFO: `/v3/projects/a8d01303259142829964b8d84896cd8b` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:27.066368 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954b832-1c89-4bf1-a3f2-dc009658fe33 admin admin] RBAC: Authorizing `identity:get_project(project_id=a8d01303259142829964b8d84896cd8b)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:27.068386 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954b832-1c89-4bf1-a3f2-dc009658fe33 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:27.069929 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 68/136] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:22:27 2021] GET /identity/v3/projects/a8d01303259142829964b8d84896cd8b => generated 312 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:27.075636 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685858d-5cc2-4616-89b6-7a10aac5e434 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:27.084459 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685858d-5cc2-4616-89b6-7a10aac5e434 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:27.088568 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614b729-1ae3-4f01-96d7-272f7bfeb7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:27.089206 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614b729-1ae3-4f01-96d7-272f7bfeb7bd admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:27.089502 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614b729-1ae3-4f01-96d7-272f7bfeb7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:27.089792 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614b729-1ae3-4f01-96d7-272f7bfeb7bd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:27.090576 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614b729-1ae3-4f01-96d7-272f7bfeb7bd admin admin] RBAC: Adding query filter params (role.id=0f176f9289ff497b8ed18a84bcfd34da, scope.project.id=a8d01303259142829964b8d84896cd8b, user.id=67f731571f024ec0a6d66107af3b9b7b) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:27.090889 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614b729-1ae3-4f01-96d7-272f7bfeb7bd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:27.092722 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614b729-1ae3-4f01-96d7-272f7bfeb7bd admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:27.097945 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 69/137] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:22:27 2021] GET /identity/v3/role_assignments?user.id=67f731571f024ec0a6d66107af3b9b7b&scope.project.id=a8d01303259142829964b8d84896cd8b&role.id=0f176f9289ff497b8ed18a84bcfd34da => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:29.103495 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ab1bb-8c38-4473-af62-997b96541fed None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:29.103990 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ab1bb-8c38-4473-af62-997b96541fed None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:29.103990 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ab1bb-8c38-4473-af62-997b96541fed None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:29.105663 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 69/138] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:22:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:29.110938 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3716fb-0586-4f31-b576-f6a507fd8145 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:29.111304 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3716fb-0586-4f31-b576-f6a507fd8145 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:29.111517 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3716fb-0586-4f31-b576-f6a507fd8145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:29.133454 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-3c3716fb-0586-4f31-b576-f6a507fd8145 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:29.134627 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-3c3716fb-0586-4f31-b576-f6a507fd8145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:29.142098 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 70/139] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:22:29.164069 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ab1bb-8c38-4473-af62-997b96541fed None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:29.176325 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ab1bb-8c38-4473-af62-997b96541fed None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:29.180345 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd2d5c-2acd-4a3b-9424-39f4622a3dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:29.181091 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd2d5c-2acd-4a3b-9424-39f4622a3dae admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:29.181387 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd2d5c-2acd-4a3b-9424-39f4622a3dae admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:29.181673 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd2d5c-2acd-4a3b-9424-39f4622a3dae admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:29.192918 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd2d5c-2acd-4a3b-9424-39f4622a3dae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:22:29.199506 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-40cd2d5c-2acd-4a3b-9424-39f4622a3dae admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:22:29.200623 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 70/140] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:22:29 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:29.206465 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3716fb-0586-4f31-b576-f6a507fd8145 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:29.215109 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3716fb-0586-4f31-b576-f6a507fd8145 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:29.219853 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b6ef0-26f0-41ea-ad23-889af332c06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:29.220445 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b6ef0-26f0-41ea-ad23-889af332c06e admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:29.220740 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b6ef0-26f0-41ea-ad23-889af332c06e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:29.221054 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b6ef0-26f0-41ea-ad23-889af332c06e admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:29.221771 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b6ef0-26f0-41ea-ad23-889af332c06e admin admin] RBAC: Adding query filter params (name=member) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:29.222070 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b6ef0-26f0-41ea-ad23-889af332c06e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:29.223671 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b6ef0-26f0-41ea-ad23-889af332c06e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:29.232056 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 71/141] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Dec 16 14:22:29 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:29.238045 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd2d5c-2acd-4a3b-9424-39f4622a3dae admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:29.249207 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd2d5c-2acd-4a3b-9424-39f4622a3dae admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:29.253434 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754ea64-c966-448c-8621-451a294b6ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:29.254231 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754ea64-c966-448c-8621-451a294b6ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:29.254530 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754ea64-c966-448c-8621-451a294b6ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:29.254820 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754ea64-c966-448c-8621-451a294b6ce0 admin admin] PATH_INFO: `/v3/users/67f731571f024ec0a6d66107af3b9b7b` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:29.256018 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754ea64-c966-448c-8621-451a294b6ce0 admin admin] RBAC: Authorizing `identity:get_user(user_id=67f731571f024ec0a6d66107af3b9b7b)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:29.258203 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754ea64-c966-448c-8621-451a294b6ce0 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:29.259680 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 71/142] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:22:29 2021] GET /identity/v3/users/67f731571f024ec0a6d66107af3b9b7b => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:29.265174 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b6ef0-26f0-41ea-ad23-889af332c06e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:29.274560 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b6ef0-26f0-41ea-ad23-889af332c06e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:29.278636 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe33b9-c6fa-40bd-a1ed-cdf68a95bd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:29.279419 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe33b9-c6fa-40bd-a1ed-cdf68a95bd3e admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:29.279714 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe33b9-c6fa-40bd-a1ed-cdf68a95bd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:29.280001 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe33b9-c6fa-40bd-a1ed-cdf68a95bd3e admin admin] PATH_INFO: `/v3/projects/a8d01303259142829964b8d84896cd8b` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:29.281138 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe33b9-c6fa-40bd-a1ed-cdf68a95bd3e admin admin] RBAC: Authorizing `identity:get_project(project_id=a8d01303259142829964b8d84896cd8b)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:29.283685 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe33b9-c6fa-40bd-a1ed-cdf68a95bd3e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:29.285257 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 72/143] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:22:29 2021] GET /identity/v3/projects/a8d01303259142829964b8d84896cd8b => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:29.290783 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754ea64-c966-448c-8621-451a294b6ce0 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:29.300648 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754ea64-c966-448c-8621-451a294b6ce0 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:29.304766 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dacc7d4-a3c4-438d-8cfd-5dbe58a3f232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:29.305595 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacc7d4-a3c4-438d-8cfd-5dbe58a3f232 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:29.305893 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacc7d4-a3c4-438d-8cfd-5dbe58a3f232 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:29.306182 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacc7d4-a3c4-438d-8cfd-5dbe58a3f232 admin admin] PATH_INFO: `/v3/projects/a8d01303259142829964b8d84896cd8b/users/67f731571f024ec0a6d66107af3b9b7b/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:29.307956 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dacc7d4-a3c4-438d-8cfd-5dbe58a3f232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8d01303259142829964b8d84896cd8b, user_id=67f731571f024ec0a6d66107af3b9b7b, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:29.310622 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dacc7d4-a3c4-438d-8cfd-5dbe58a3f232 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:29.322274 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 72/144] 10.222.0.64 () {58 vars in 1460 bytes} [Thu Dec 16 14:22:29 2021] PUT /identity/v3/projects/a8d01303259142829964b8d84896cd8b/users/67f731571f024ec0a6d66107af3b9b7b/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:22:31.370478 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd59c4-436e-4ea1-bad0-384837315b87 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:31.371065 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd59c4-436e-4ea1-bad0-384837315b87 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:31.371065 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd59c4-436e-4ea1-bad0-384837315b87 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:31.372693 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 73/145] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:22:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:31.378843 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58013a34-0d73-419b-be42-2d34e266ba89 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:31.379238 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58013a34-0d73-419b-be42-2d34e266ba89 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:31.379423 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58013a34-0d73-419b-be42-2d34e266ba89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:31.401535 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-58013a34-0d73-419b-be42-2d34e266ba89 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:31.402672 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-58013a34-0d73-419b-be42-2d34e266ba89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:31.464297 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 73/146] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:31.486938 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd59c4-436e-4ea1-bad0-384837315b87 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:31.498669 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd59c4-436e-4ea1-bad0-384837315b87 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:31.503233 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f1b2d-4340-42d3-b784-4cfab531b833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:31.503947 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f1b2d-4340-42d3-b784-4cfab531b833 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:31.504244 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f1b2d-4340-42d3-b784-4cfab531b833 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:31.504537 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f1b2d-4340-42d3-b784-4cfab531b833 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:31.516105 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f1b2d-4340-42d3-b784-4cfab531b833 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:22:31.522463 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-eb4f1b2d-4340-42d3-b784-4cfab531b833 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:22:31.523539 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 74/147] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:22:31 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:31.529052 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58013a34-0d73-419b-be42-2d34e266ba89 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:31.538108 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58013a34-0d73-419b-be42-2d34e266ba89 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:31.542294 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654792f0-bc9a-41f8-b368-362d749e2a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:31.542890 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654792f0-bc9a-41f8-b368-362d749e2a63 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:31.543189 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654792f0-bc9a-41f8-b368-362d749e2a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:31.543479 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654792f0-bc9a-41f8-b368-362d749e2a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:31.544194 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654792f0-bc9a-41f8-b368-362d749e2a63 admin admin] RBAC: Adding query filter params (name=member) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:31.544499 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654792f0-bc9a-41f8-b368-362d749e2a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:31.546134 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654792f0-bc9a-41f8-b368-362d749e2a63 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:31.555066 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 74/148] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Dec 16 14:22:31 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:31.560332 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f1b2d-4340-42d3-b784-4cfab531b833 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:31.569948 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f1b2d-4340-42d3-b784-4cfab531b833 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:31.574390 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f456910-7701-4c62-815e-ac98d5c5798f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:31.575192 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f456910-7701-4c62-815e-ac98d5c5798f admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:31.575488 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f456910-7701-4c62-815e-ac98d5c5798f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:31.575777 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f456910-7701-4c62-815e-ac98d5c5798f admin admin] PATH_INFO: `/v3/users/67f731571f024ec0a6d66107af3b9b7b` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:31.576926 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f456910-7701-4c62-815e-ac98d5c5798f admin admin] RBAC: Authorizing `identity:get_user(user_id=67f731571f024ec0a6d66107af3b9b7b)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:31.579583 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f456910-7701-4c62-815e-ac98d5c5798f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:31.581062 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 75/149] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:22:31 2021] GET /identity/v3/users/67f731571f024ec0a6d66107af3b9b7b => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:31.586122 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654792f0-bc9a-41f8-b368-362d749e2a63 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:31.595710 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654792f0-bc9a-41f8-b368-362d749e2a63 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:31.599800 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6a2b3-1c87-47b4-b528-ff50ca3b73c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:31.600367 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6a2b3-1c87-47b4-b528-ff50ca3b73c0 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:31.600665 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6a2b3-1c87-47b4-b528-ff50ca3b73c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:31.601000 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6a2b3-1c87-47b4-b528-ff50ca3b73c0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:31.608514 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6a2b3-1c87-47b4-b528-ff50ca3b73c0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:31.610283 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6a2b3-1c87-47b4-b528-ff50ca3b73c0 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:31.618536 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 75/150] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:22:31 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:22:31.623869 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f456910-7701-4c62-815e-ac98d5c5798f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:31.633312 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f456910-7701-4c62-815e-ac98d5c5798f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:31.637449 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8b567-d91a-47f2-bb6e-284c5a1af6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:31.638216 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8b567-d91a-47f2-bb6e-284c5a1af6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:31.638516 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8b567-d91a-47f2-bb6e-284c5a1af6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:31.638801 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8b567-d91a-47f2-bb6e-284c5a1af6c5 admin admin] PATH_INFO: `/v3/projects/a8d01303259142829964b8d84896cd8b` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:31.639895 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8b567-d91a-47f2-bb6e-284c5a1af6c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=a8d01303259142829964b8d84896cd8b)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:31.642485 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8b567-d91a-47f2-bb6e-284c5a1af6c5 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:31.643994 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 76/151] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:22:31 2021] GET /identity/v3/projects/a8d01303259142829964b8d84896cd8b => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:31.649483 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6a2b3-1c87-47b4-b528-ff50ca3b73c0 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:31.658409 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6a2b3-1c87-47b4-b528-ff50ca3b73c0 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:31.662560 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8e86e-0fa9-446b-bb7c-122be728df9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:31.663131 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8e86e-0fa9-446b-bb7c-122be728df9b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:31.663422 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8e86e-0fa9-446b-bb7c-122be728df9b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:31.663713 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8e86e-0fa9-446b-bb7c-122be728df9b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:31.664662 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8e86e-0fa9-446b-bb7c-122be728df9b admin admin] RBAC: Adding query filter params (role.id=0f176f9289ff497b8ed18a84bcfd34da, scope.project.id=a8d01303259142829964b8d84896cd8b, user.id=67f731571f024ec0a6d66107af3b9b7b) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:31.665010 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8e86e-0fa9-446b-bb7c-122be728df9b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:31.666834 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8e86e-0fa9-446b-bb7c-122be728df9b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:31.672523 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 76/152] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:22:31 2021] GET /identity/v3/role_assignments?user.id=67f731571f024ec0a6d66107af3b9b7b&scope.project.id=a8d01303259142829964b8d84896cd8b&role.id=0f176f9289ff497b8ed18a84bcfd34da => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:33.749146 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc3692-520b-49b2-b1c0-bf5d83737b6c None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:33.749668 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc3692-520b-49b2-b1c0-bf5d83737b6c None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:33.750272 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc3692-520b-49b2-b1c0-bf5d83737b6c None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:33.751953 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 77/153] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:22:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:33.757026 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a1eb4-f634-478f-9213-5415c1486d5f None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:33.757441 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a1eb4-f634-478f-9213-5415c1486d5f None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:33.757610 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a1eb4-f634-478f-9213-5415c1486d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:33.779756 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-9a1a1eb4-f634-478f-9213-5415c1486d5f None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:33.780922 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-9a1a1eb4-f634-478f-9213-5415c1486d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:33.787846 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 77/154] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:33.810618 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc3692-520b-49b2-b1c0-bf5d83737b6c None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:33.823225 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc3692-520b-49b2-b1c0-bf5d83737b6c None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:33.827206 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc531112-a1e0-47c5-8398-f7a5897057aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:33.827966 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc531112-a1e0-47c5-8398-f7a5897057aa admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:33.828262 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc531112-a1e0-47c5-8398-f7a5897057aa admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:33.828553 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc531112-a1e0-47c5-8398-f7a5897057aa admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:33.829670 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc531112-a1e0-47c5-8398-f7a5897057aa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:33.831371 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc531112-a1e0-47c5-8398-f7a5897057aa admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:33.832850 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 78/155] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:33 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:33.838307 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a1eb4-f634-478f-9213-5415c1486d5f None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:33.847057 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a1eb4-f634-478f-9213-5415c1486d5f None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:33.851158 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ea187-9cc0-4382-8356-2f5c8b72bd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:33.851743 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ea187-9cc0-4382-8356-2f5c8b72bd29 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:33.852037 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ea187-9cc0-4382-8356-2f5c8b72bd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:33.852325 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ea187-9cc0-4382-8356-2f5c8b72bd29 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:33.853019 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ea187-9cc0-4382-8356-2f5c8b72bd29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:33.854908 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ea187-9cc0-4382-8356-2f5c8b72bd29 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:33.881865 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 78/156] 10.222.0.64 () {60 vars in 1162 bytes} [Thu Dec 16 14:22:33 2021] POST /identity/v3/projects => generated 302 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:22:35.971868 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e573e2-2319-4e5d-8bc6-bb4b82ac100c None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:35.972409 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e573e2-2319-4e5d-8bc6-bb4b82ac100c None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:35.972409 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e573e2-2319-4e5d-8bc6-bb4b82ac100c None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:35.974153 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 79/157] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:22:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:35.979482 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa115780-e553-47f2-8feb-efd66aae8a6a None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:35.979876 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa115780-e553-47f2-8feb-efd66aae8a6a None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:35.980052 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa115780-e553-47f2-8feb-efd66aae8a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:36.001847 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-aa115780-e553-47f2-8feb-efd66aae8a6a None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:36.003230 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-aa115780-e553-47f2-8feb-efd66aae8a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:36.065708 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 79/158] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:36.089291 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e573e2-2319-4e5d-8bc6-bb4b82ac100c None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:36.100740 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e573e2-2319-4e5d-8bc6-bb4b82ac100c None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:36.104712 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b51b92-419c-43ab-859b-da4ad8e593da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:36.105386 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b51b92-419c-43ab-859b-da4ad8e593da admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:36.105674 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b51b92-419c-43ab-859b-da4ad8e593da admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:36.105955 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b51b92-419c-43ab-859b-da4ad8e593da admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:36.107008 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b51b92-419c-43ab-859b-da4ad8e593da admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:36.108673 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b51b92-419c-43ab-859b-da4ad8e593da admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:36.110631 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 80/159] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:36 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:36.115729 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa115780-e553-47f2-8feb-efd66aae8a6a None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:36.124133 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa115780-e553-47f2-8feb-efd66aae8a6a None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:36.129127 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d32224-f667-4970-b97f-4d05918d4029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:36.129712 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d32224-f667-4970-b97f-4d05918d4029 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:36.130000 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d32224-f667-4970-b97f-4d05918d4029 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:36.130283 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d32224-f667-4970-b97f-4d05918d4029 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:36.130925 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d32224-f667-4970-b97f-4d05918d4029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:36.132866 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d32224-f667-4970-b97f-4d05918d4029 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:36.151457 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 80/160] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Dec 16 14:22:36 2021] POST /identity/v3/users => generated 283 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:22:38.309322 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98892c52-0bd5-4433-9797-226153fde7a8 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:38.309863 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98892c52-0bd5-4433-9797-226153fde7a8 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:38.309863 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98892c52-0bd5-4433-9797-226153fde7a8 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:38.311563 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 81/161] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:22:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:38.317225 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef80d8-b95b-452c-afcb-d9fc02a55f21 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:38.317619 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef80d8-b95b-452c-afcb-d9fc02a55f21 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:38.317805 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef80d8-b95b-452c-afcb-d9fc02a55f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:38.339900 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-d8ef80d8-b95b-452c-afcb-d9fc02a55f21 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:38.341088 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-d8ef80d8-b95b-452c-afcb-d9fc02a55f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:38.347981 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 81/162] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:38.370946 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98892c52-0bd5-4433-9797-226153fde7a8 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:38.383592 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98892c52-0bd5-4433-9797-226153fde7a8 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:38.387636 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e693f8a-ccd1-4edc-8126-754f21f8d765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:38.388370 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e693f8a-ccd1-4edc-8126-754f21f8d765 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:38.388658 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e693f8a-ccd1-4edc-8126-754f21f8d765 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:38.388971 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e693f8a-ccd1-4edc-8126-754f21f8d765 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:38.400417 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e693f8a-ccd1-4edc-8126-754f21f8d765 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:22:38.406841 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-1e693f8a-ccd1-4edc-8126-754f21f8d765 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:22:38.407906 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 82/163] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:22:38 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:38.413523 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef80d8-b95b-452c-afcb-d9fc02a55f21 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:38.423397 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef80d8-b95b-452c-afcb-d9fc02a55f21 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:38.427517 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0afa8-881c-4f57-a6f3-1569da295b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:38.428110 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0afa8-881c-4f57-a6f3-1569da295b9b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:38.428404 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0afa8-881c-4f57-a6f3-1569da295b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:38.428691 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0afa8-881c-4f57-a6f3-1569da295b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:38.429485 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0afa8-881c-4f57-a6f3-1569da295b9b admin admin] RBAC: Adding query filter params (name=member) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:38.429790 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0afa8-881c-4f57-a6f3-1569da295b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:38.431369 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0afa8-881c-4f57-a6f3-1569da295b9b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:38.440323 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 82/164] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Dec 16 14:22:38 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:38.445721 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e693f8a-ccd1-4edc-8126-754f21f8d765 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:38.455332 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e693f8a-ccd1-4edc-8126-754f21f8d765 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:38.459409 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9851c9d-da22-4d44-abe7-cd7cd10585bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:38.460209 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9851c9d-da22-4d44-abe7-cd7cd10585bd admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:38.460497 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9851c9d-da22-4d44-abe7-cd7cd10585bd admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:38.460807 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9851c9d-da22-4d44-abe7-cd7cd10585bd admin admin] PATH_INFO: `/v3/users/8d8a1622bcd9425897519d9da0cbc520` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:38.479081 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9851c9d-da22-4d44-abe7-cd7cd10585bd admin admin] RBAC: Authorizing `identity:get_user(user_id=8d8a1622bcd9425897519d9da0cbc520)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:38.481333 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9851c9d-da22-4d44-abe7-cd7cd10585bd admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:38.482796 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 83/165] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:22:38 2021] GET /identity/v3/users/8d8a1622bcd9425897519d9da0cbc520 => generated 283 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:38.488484 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0afa8-881c-4f57-a6f3-1569da295b9b admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:38.497680 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0afa8-881c-4f57-a6f3-1569da295b9b admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:38.502321 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700dc78-e1fb-49d9-9806-4722b2f9ecd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:38.502887 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700dc78-e1fb-49d9-9806-4722b2f9ecd0 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:38.503181 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700dc78-e1fb-49d9-9806-4722b2f9ecd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:38.503468 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700dc78-e1fb-49d9-9806-4722b2f9ecd0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:38.511027 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700dc78-e1fb-49d9-9806-4722b2f9ecd0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:38.512761 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700dc78-e1fb-49d9-9806-4722b2f9ecd0 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:38.520997 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 83/166] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:22:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:22:38.526273 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9851c9d-da22-4d44-abe7-cd7cd10585bd admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:38.535336 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9851c9d-da22-4d44-abe7-cd7cd10585bd admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:38.539322 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6aadf-1784-4d09-a888-ab5e09f17db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:38.540087 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6aadf-1784-4d09-a888-ab5e09f17db1 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:38.540376 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6aadf-1784-4d09-a888-ab5e09f17db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:38.540658 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6aadf-1784-4d09-a888-ab5e09f17db1 admin admin] PATH_INFO: `/v3/projects/acd89025087841f89da0bfc29ec9d034` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:38.541773 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6aadf-1784-4d09-a888-ab5e09f17db1 admin admin] RBAC: Authorizing `identity:get_project(project_id=acd89025087841f89da0bfc29ec9d034)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:38.543776 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6aadf-1784-4d09-a888-ab5e09f17db1 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:38.545293 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 84/167] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:22:38 2021] GET /identity/v3/projects/acd89025087841f89da0bfc29ec9d034 => generated 302 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:38.551070 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700dc78-e1fb-49d9-9806-4722b2f9ecd0 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:38.559393 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700dc78-e1fb-49d9-9806-4722b2f9ecd0 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:38.564042 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2387072-bd25-4c83-b95a-8ca2b4db1be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:38.564603 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2387072-bd25-4c83-b95a-8ca2b4db1be2 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:38.564934 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2387072-bd25-4c83-b95a-8ca2b4db1be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:38.565222 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2387072-bd25-4c83-b95a-8ca2b4db1be2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:38.565993 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2387072-bd25-4c83-b95a-8ca2b4db1be2 admin admin] RBAC: Adding query filter params (role.id=0f176f9289ff497b8ed18a84bcfd34da, scope.project.id=acd89025087841f89da0bfc29ec9d034, user.id=8d8a1622bcd9425897519d9da0cbc520) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:38.566296 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2387072-bd25-4c83-b95a-8ca2b4db1be2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:38.568098 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2387072-bd25-4c83-b95a-8ca2b4db1be2 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:38.573527 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 84/168] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:22:38 2021] GET /identity/v3/role_assignments?user.id=8d8a1622bcd9425897519d9da0cbc520&scope.project.id=acd89025087841f89da0bfc29ec9d034&role.id=0f176f9289ff497b8ed18a84bcfd34da => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:40.599766 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5059de0-1ccd-4b88-95f8-e785065a96d7 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:40.600283 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5059de0-1ccd-4b88-95f8-e785065a96d7 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:40.600389 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5059de0-1ccd-4b88-95f8-e785065a96d7 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:40.602050 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 85/169] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:22:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:40.607467 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b020c6-5821-4af8-86bf-5d8641934a9f None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:40.607854 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b020c6-5821-4af8-86bf-5d8641934a9f None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:40.608030 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b020c6-5821-4af8-86bf-5d8641934a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:40.630601 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-42b020c6-5821-4af8-86bf-5d8641934a9f None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:40.631836 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-42b020c6-5821-4af8-86bf-5d8641934a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:40.638607 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 85/170] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:40.668620 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5059de0-1ccd-4b88-95f8-e785065a96d7 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:40.683256 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5059de0-1ccd-4b88-95f8-e785065a96d7 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:40.687999 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cf32d-f17b-4c93-b510-d37957cdb626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:40.689286 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cf32d-f17b-4c93-b510-d37957cdb626 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:40.689766 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cf32d-f17b-4c93-b510-d37957cdb626 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:40.690054 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cf32d-f17b-4c93-b510-d37957cdb626 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:40.706216 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cf32d-f17b-4c93-b510-d37957cdb626 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:22:40.714715 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-907cf32d-f17b-4c93-b510-d37957cdb626 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:22:40.716461 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 86/171] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:22:40 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:40.722636 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b020c6-5821-4af8-86bf-5d8641934a9f None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:40.731202 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b020c6-5821-4af8-86bf-5d8641934a9f None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:40.735892 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a10c4-d166-4f95-a6ea-5c15d801a8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:40.736480 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a10c4-d166-4f95-a6ea-5c15d801a8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:40.736776 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a10c4-d166-4f95-a6ea-5c15d801a8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:40.737100 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a10c4-d166-4f95-a6ea-5c15d801a8a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:40.737809 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a10c4-d166-4f95-a6ea-5c15d801a8a2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:40.738111 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a10c4-d166-4f95-a6ea-5c15d801a8a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:40.739691 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a10c4-d166-4f95-a6ea-5c15d801a8a2 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:40.748053 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 86/172] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Dec 16 14:22:40 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:40.754824 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cf32d-f17b-4c93-b510-d37957cdb626 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:40.764498 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cf32d-f17b-4c93-b510-d37957cdb626 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:40.768506 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5ba8a-eb64-4fa0-8f86-c1f43b5756dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:40.769354 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5ba8a-eb64-4fa0-8f86-c1f43b5756dd admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:40.769600 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5ba8a-eb64-4fa0-8f86-c1f43b5756dd admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:40.769876 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5ba8a-eb64-4fa0-8f86-c1f43b5756dd admin admin] PATH_INFO: `/v3/users/8d8a1622bcd9425897519d9da0cbc520` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:40.770953 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5ba8a-eb64-4fa0-8f86-c1f43b5756dd admin admin] RBAC: Authorizing `identity:get_user(user_id=8d8a1622bcd9425897519d9da0cbc520)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:40.773091 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5ba8a-eb64-4fa0-8f86-c1f43b5756dd admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:40.774519 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 87/173] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:22:40 2021] GET /identity/v3/users/8d8a1622bcd9425897519d9da0cbc520 => generated 283 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:40.779635 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a10c4-d166-4f95-a6ea-5c15d801a8a2 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:40.788867 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a10c4-d166-4f95-a6ea-5c15d801a8a2 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:40.792766 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f174f-2ef1-4ff2-9df8-0a18cdb5a1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:40.793566 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f174f-2ef1-4ff2-9df8-0a18cdb5a1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:40.793852 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f174f-2ef1-4ff2-9df8-0a18cdb5a1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:40.794138 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f174f-2ef1-4ff2-9df8-0a18cdb5a1e4 admin admin] PATH_INFO: `/v3/projects/acd89025087841f89da0bfc29ec9d034` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:40.795203 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f174f-2ef1-4ff2-9df8-0a18cdb5a1e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=acd89025087841f89da0bfc29ec9d034)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:40.797832 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f174f-2ef1-4ff2-9df8-0a18cdb5a1e4 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:40.799316 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 87/174] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:22:40 2021] GET /identity/v3/projects/acd89025087841f89da0bfc29ec9d034 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:40.804499 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5ba8a-eb64-4fa0-8f86-c1f43b5756dd admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:40.814038 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5ba8a-eb64-4fa0-8f86-c1f43b5756dd admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:40.818002 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8aeeb-77a6-4e5f-8f8c-6ea2de32e90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:40.818792 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8aeeb-77a6-4e5f-8f8c-6ea2de32e90b admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:40.819073 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8aeeb-77a6-4e5f-8f8c-6ea2de32e90b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:40.819352 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8aeeb-77a6-4e5f-8f8c-6ea2de32e90b admin admin] PATH_INFO: `/v3/projects/acd89025087841f89da0bfc29ec9d034/users/8d8a1622bcd9425897519d9da0cbc520/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:40.821120 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8aeeb-77a6-4e5f-8f8c-6ea2de32e90b admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd89025087841f89da0bfc29ec9d034, user_id=8d8a1622bcd9425897519d9da0cbc520, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:40.823962 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8aeeb-77a6-4e5f-8f8c-6ea2de32e90b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:40.835725 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 88/175] 10.222.0.64 () {58 vars in 1460 bytes} [Thu Dec 16 14:22:40 2021] PUT /identity/v3/projects/acd89025087841f89da0bfc29ec9d034/users/8d8a1622bcd9425897519d9da0cbc520/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:22:42.869701 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a28961-4ebd-419f-828e-7f4ff19ab637 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:42.870179 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a28961-4ebd-419f-828e-7f4ff19ab637 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:42.870280 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a28961-4ebd-419f-828e-7f4ff19ab637 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:42.871952 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 88/176] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:22:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:42.878105 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d02ec9-bb59-4d85-90c0-1b028e179e73 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:42.878548 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d02ec9-bb59-4d85-90c0-1b028e179e73 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:42.878671 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d02ec9-bb59-4d85-90c0-1b028e179e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:42.900274 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-68d02ec9-bb59-4d85-90c0-1b028e179e73 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:42.901443 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-68d02ec9-bb59-4d85-90c0-1b028e179e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:42.964905 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 89/177] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:42.988294 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a28961-4ebd-419f-828e-7f4ff19ab637 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:43.000469 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a28961-4ebd-419f-828e-7f4ff19ab637 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:43.004437 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e4253-82a8-4c91-8c2f-00e6f868b26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:43.005184 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e4253-82a8-4c91-8c2f-00e6f868b26a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:43.005473 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e4253-82a8-4c91-8c2f-00e6f868b26a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:43.005746 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e4253-82a8-4c91-8c2f-00e6f868b26a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:43.018409 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e4253-82a8-4c91-8c2f-00e6f868b26a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:22:43.024804 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-2d2e4253-82a8-4c91-8c2f-00e6f868b26a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:22:43.026460 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 89/178] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:22:42 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:43.032420 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d02ec9-bb59-4d85-90c0-1b028e179e73 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:43.041218 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d02ec9-bb59-4d85-90c0-1b028e179e73 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:43.045443 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5236b1e-654d-432a-8e67-b2c814eb8500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:43.046613 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5236b1e-654d-432a-8e67-b2c814eb8500 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:43.046892 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5236b1e-654d-432a-8e67-b2c814eb8500 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:43.047117 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5236b1e-654d-432a-8e67-b2c814eb8500 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:43.047829 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5236b1e-654d-432a-8e67-b2c814eb8500 admin admin] RBAC: Adding query filter params (name=member) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:43.048156 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5236b1e-654d-432a-8e67-b2c814eb8500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:43.049808 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5236b1e-654d-432a-8e67-b2c814eb8500 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:43.058290 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 90/179] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Dec 16 14:22:43 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:43.064300 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e4253-82a8-4c91-8c2f-00e6f868b26a admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:43.073939 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e4253-82a8-4c91-8c2f-00e6f868b26a admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:43.078022 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c50e6-2354-46e2-b5ea-995f80d11c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:43.078800 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c50e6-2354-46e2-b5ea-995f80d11c0e admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:43.079086 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c50e6-2354-46e2-b5ea-995f80d11c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:43.079361 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c50e6-2354-46e2-b5ea-995f80d11c0e admin admin] PATH_INFO: `/v3/users/8d8a1622bcd9425897519d9da0cbc520` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:43.080463 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c50e6-2354-46e2-b5ea-995f80d11c0e admin admin] RBAC: Authorizing `identity:get_user(user_id=8d8a1622bcd9425897519d9da0cbc520)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:43.082591 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c50e6-2354-46e2-b5ea-995f80d11c0e admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:43.084035 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 90/180] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:22:43 2021] GET /identity/v3/users/8d8a1622bcd9425897519d9da0cbc520 => generated 283 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:43.089334 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5236b1e-654d-432a-8e67-b2c814eb8500 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:43.098700 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5236b1e-654d-432a-8e67-b2c814eb8500 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:43.102717 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640d388-322c-4199-8834-892483fa94a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:43.103294 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640d388-322c-4199-8834-892483fa94a2 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:43.103586 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640d388-322c-4199-8834-892483fa94a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:43.103871 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640d388-322c-4199-8834-892483fa94a2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:43.111995 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640d388-322c-4199-8834-892483fa94a2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:43.113732 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640d388-322c-4199-8834-892483fa94a2 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:43.122007 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 91/181] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:22:43 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:22:43.127893 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c50e6-2354-46e2-b5ea-995f80d11c0e admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:43.137072 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c50e6-2354-46e2-b5ea-995f80d11c0e admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:43.141031 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76734c9-20a5-432c-8496-85101dd960e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:43.141791 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76734c9-20a5-432c-8496-85101dd960e8 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:43.142076 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76734c9-20a5-432c-8496-85101dd960e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:43.142355 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76734c9-20a5-432c-8496-85101dd960e8 admin admin] PATH_INFO: `/v3/projects/acd89025087841f89da0bfc29ec9d034` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:43.143452 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76734c9-20a5-432c-8496-85101dd960e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=acd89025087841f89da0bfc29ec9d034)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:43.145491 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76734c9-20a5-432c-8496-85101dd960e8 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:43.146977 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 91/182] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:22:43 2021] GET /identity/v3/projects/acd89025087841f89da0bfc29ec9d034 => generated 302 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:43.152711 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640d388-322c-4199-8834-892483fa94a2 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:43.161877 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640d388-322c-4199-8834-892483fa94a2 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:43.165934 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418cdd3b-7020-4fe1-805f-53cc2df49b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:43.166499 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cdd3b-7020-4fe1-805f-53cc2df49b2f admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:43.166787 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cdd3b-7020-4fe1-805f-53cc2df49b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:43.167068 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cdd3b-7020-4fe1-805f-53cc2df49b2f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:43.167838 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418cdd3b-7020-4fe1-805f-53cc2df49b2f admin admin] RBAC: Adding query filter params (role.id=0f176f9289ff497b8ed18a84bcfd34da, scope.project.id=acd89025087841f89da0bfc29ec9d034, user.id=8d8a1622bcd9425897519d9da0cbc520) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:43.168170 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418cdd3b-7020-4fe1-805f-53cc2df49b2f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:43.170000 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418cdd3b-7020-4fe1-805f-53cc2df49b2f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:43.176236 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 92/183] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:22:43 2021] GET /identity/v3/role_assignments?user.id=8d8a1622bcd9425897519d9da0cbc520&scope.project.id=acd89025087841f89da0bfc29ec9d034&role.id=0f176f9289ff497b8ed18a84bcfd34da => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:45.376099 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca0cff-965e-46b2-965a-dc9bb65a2033 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:45.376653 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca0cff-965e-46b2-965a-dc9bb65a2033 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:45.376754 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca0cff-965e-46b2-965a-dc9bb65a2033 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:45.378409 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 92/184] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:22:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:45.383544 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c13a9-d01b-42bb-9e99-930084e46d79 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:45.383971 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c13a9-d01b-42bb-9e99-930084e46d79 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:45.384112 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c13a9-d01b-42bb-9e99-930084e46d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:45.407920 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-9d7c13a9-d01b-42bb-9e99-930084e46d79 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:45.409065 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-9d7c13a9-d01b-42bb-9e99-930084e46d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:45.415681 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 93/185] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:45.438335 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca0cff-965e-46b2-965a-dc9bb65a2033 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:45.450186 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca0cff-965e-46b2-965a-dc9bb65a2033 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:45.454807 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a871d02-c240-49ad-be39-2da3b9e94114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:45.455510 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a871d02-c240-49ad-be39-2da3b9e94114 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:45.455801 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a871d02-c240-49ad-be39-2da3b9e94114 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:45.456081 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a871d02-c240-49ad-be39-2da3b9e94114 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:45.467174 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a871d02-c240-49ad-be39-2da3b9e94114 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:22:45.473498 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-0a871d02-c240-49ad-be39-2da3b9e94114 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:22:45.474563 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 93/186] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:22:45 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:45.480025 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c13a9-d01b-42bb-9e99-930084e46d79 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:45.488393 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c13a9-d01b-42bb-9e99-930084e46d79 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:45.492346 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef93b0-26a3-4239-8f70-0f11ef039dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:45.492966 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef93b0-26a3-4239-8f70-0f11ef039dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:45.493251 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef93b0-26a3-4239-8f70-0f11ef039dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:45.493525 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef93b0-26a3-4239-8f70-0f11ef039dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:45.494223 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef93b0-26a3-4239-8f70-0f11ef039dc1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:45.494515 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef93b0-26a3-4239-8f70-0f11ef039dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:45.496083 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef93b0-26a3-4239-8f70-0f11ef039dc1 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:45.504978 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 94/187] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:22:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:45.510118 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a871d02-c240-49ad-be39-2da3b9e94114 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:45.520348 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a871d02-c240-49ad-be39-2da3b9e94114 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:45.524345 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53dc5e0-de62-4694-a5cc-9adb9d0ef476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:45.525154 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dc5e0-de62-4694-a5cc-9adb9d0ef476 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:45.525446 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dc5e0-de62-4694-a5cc-9adb9d0ef476 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:45.525732 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dc5e0-de62-4694-a5cc-9adb9d0ef476 admin admin] PATH_INFO: `/v3/users/8c2ac62eab7c4164bfd09ecc79a439aa` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:45.526828 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53dc5e0-de62-4694-a5cc-9adb9d0ef476 admin admin] RBAC: Authorizing `identity:get_user(user_id=8c2ac62eab7c4164bfd09ecc79a439aa)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:45.528597 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53dc5e0-de62-4694-a5cc-9adb9d0ef476 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:45.530080 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 94/188] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:22:45 2021] GET /identity/v3/users/8c2ac62eab7c4164bfd09ecc79a439aa => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:45.535029 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef93b0-26a3-4239-8f70-0f11ef039dc1 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:45.544064 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef93b0-26a3-4239-8f70-0f11ef039dc1 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:45.548042 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb1244-9379-4e11-9973-c96c8fea68b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:45.548604 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb1244-9379-4e11-9973-c96c8fea68b8 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:45.548936 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb1244-9379-4e11-9973-c96c8fea68b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:45.549221 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb1244-9379-4e11-9973-c96c8fea68b8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:45.556674 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb1244-9379-4e11-9973-c96c8fea68b8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:45.558439 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb1244-9379-4e11-9973-c96c8fea68b8 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:45.567515 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 95/189] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:22:45 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:22:45.572962 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53dc5e0-de62-4694-a5cc-9adb9d0ef476 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:45.582625 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53dc5e0-de62-4694-a5cc-9adb9d0ef476 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:45.586636 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48411ac-088b-426c-8753-ff7777d5270a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:45.587390 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48411ac-088b-426c-8753-ff7777d5270a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:45.587683 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48411ac-088b-426c-8753-ff7777d5270a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:45.587967 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48411ac-088b-426c-8753-ff7777d5270a admin admin] PATH_INFO: `/v3/projects/acd89025087841f89da0bfc29ec9d034` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:45.589087 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48411ac-088b-426c-8753-ff7777d5270a admin admin] RBAC: Authorizing `identity:get_project(project_id=acd89025087841f89da0bfc29ec9d034)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:45.591083 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48411ac-088b-426c-8753-ff7777d5270a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:45.592565 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 95/190] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:22:45 2021] GET /identity/v3/projects/acd89025087841f89da0bfc29ec9d034 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:45.597697 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb1244-9379-4e11-9973-c96c8fea68b8 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:45.605863 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb1244-9379-4e11-9973-c96c8fea68b8 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:45.609891 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393b11f-b98b-4674-8d83-12829724536a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:45.610448 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393b11f-b98b-4674-8d83-12829724536a admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:45.610739 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393b11f-b98b-4674-8d83-12829724536a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:45.611020 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393b11f-b98b-4674-8d83-12829724536a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:45.611784 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393b11f-b98b-4674-8d83-12829724536a admin admin] RBAC: Adding query filter params (role.id=90166eb3dcfa41e58450e140b8b0fea3, scope.project.id=acd89025087841f89da0bfc29ec9d034, user.id=8c2ac62eab7c4164bfd09ecc79a439aa) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:45.612094 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393b11f-b98b-4674-8d83-12829724536a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:45.613924 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393b11f-b98b-4674-8d83-12829724536a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:45.619033 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 96/191] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:22:45 2021] GET /identity/v3/role_assignments?user.id=8c2ac62eab7c4164bfd09ecc79a439aa&scope.project.id=acd89025087841f89da0bfc29ec9d034&role.id=90166eb3dcfa41e58450e140b8b0fea3 => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:47.662853 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27657943-9e72-4595-a2ac-cd54784106d9 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:47.663375 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27657943-9e72-4595-a2ac-cd54784106d9 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:47.663461 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27657943-9e72-4595-a2ac-cd54784106d9 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:47.665103 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 96/192] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:22:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:47.670200 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5aa31-4b0c-4302-a48b-119502c0cd87 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:47.670573 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5aa31-4b0c-4302-a48b-119502c0cd87 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:47.670812 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5aa31-4b0c-4302-a48b-119502c0cd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:47.692691 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-97e5aa31-4b0c-4302-a48b-119502c0cd87 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:47.693835 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-97e5aa31-4b0c-4302-a48b-119502c0cd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:47.700941 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 97/193] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:47.722605 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27657943-9e72-4595-a2ac-cd54784106d9 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:47.734124 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27657943-9e72-4595-a2ac-cd54784106d9 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:47.737987 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e29a7-c684-4438-a507-249f39962f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:47.738688 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e29a7-c684-4438-a507-249f39962f02 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:47.738968 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e29a7-c684-4438-a507-249f39962f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:47.739247 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e29a7-c684-4438-a507-249f39962f02 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:47.750877 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e29a7-c684-4438-a507-249f39962f02 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:22:47.757209 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-d92e29a7-c684-4438-a507-249f39962f02 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:22:47.758293 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 97/194] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:22:47 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:47.763854 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5aa31-4b0c-4302-a48b-119502c0cd87 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:47.773033 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5aa31-4b0c-4302-a48b-119502c0cd87 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:47.777292 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccbf06-e577-4fb8-9446-feccf2c80c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:47.777895 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccbf06-e577-4fb8-9446-feccf2c80c08 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:47.778182 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccbf06-e577-4fb8-9446-feccf2c80c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:47.778459 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccbf06-e577-4fb8-9446-feccf2c80c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:47.779167 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccbf06-e577-4fb8-9446-feccf2c80c08 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:47.779463 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccbf06-e577-4fb8-9446-feccf2c80c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:47.781114 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccbf06-e577-4fb8-9446-feccf2c80c08 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:47.789769 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 98/195] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:22:47 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:47.795443 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e29a7-c684-4438-a507-249f39962f02 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:47.805238 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e29a7-c684-4438-a507-249f39962f02 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:47.809267 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5213a13-ba2e-4362-b5b6-c1ccf206c33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:47.810047 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5213a13-ba2e-4362-b5b6-c1ccf206c33a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:47.810340 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5213a13-ba2e-4362-b5b6-c1ccf206c33a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:47.810629 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5213a13-ba2e-4362-b5b6-c1ccf206c33a admin admin] PATH_INFO: `/v3/users/8c2ac62eab7c4164bfd09ecc79a439aa` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:47.812226 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5213a13-ba2e-4362-b5b6-c1ccf206c33a admin admin] RBAC: Authorizing `identity:get_user(user_id=8c2ac62eab7c4164bfd09ecc79a439aa)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:47.814035 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5213a13-ba2e-4362-b5b6-c1ccf206c33a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:47.815488 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 98/196] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:22:47 2021] GET /identity/v3/users/8c2ac62eab7c4164bfd09ecc79a439aa => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:47.820557 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccbf06-e577-4fb8-9446-feccf2c80c08 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:47.830578 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccbf06-e577-4fb8-9446-feccf2c80c08 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:47.834580 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a2923-2c74-454a-b806-def399411ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:47.835353 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a2923-2c74-454a-b806-def399411ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:47.835643 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a2923-2c74-454a-b806-def399411ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:47.835925 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a2923-2c74-454a-b806-def399411ec9 admin admin] PATH_INFO: `/v3/projects/acd89025087841f89da0bfc29ec9d034` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:47.837034 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a2923-2c74-454a-b806-def399411ec9 admin admin] RBAC: Authorizing `identity:get_project(project_id=acd89025087841f89da0bfc29ec9d034)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:47.840393 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a2923-2c74-454a-b806-def399411ec9 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:47.843287 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 99/197] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:22:47 2021] GET /identity/v3/projects/acd89025087841f89da0bfc29ec9d034 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:22:47.846487 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5213a13-ba2e-4362-b5b6-c1ccf206c33a admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:47.855827 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5213a13-ba2e-4362-b5b6-c1ccf206c33a admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:47.859855 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2539ccb-9299-421e-bc32-b912e55623c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:47.860659 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2539ccb-9299-421e-bc32-b912e55623c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:47.861004 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2539ccb-9299-421e-bc32-b912e55623c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:47.861296 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2539ccb-9299-421e-bc32-b912e55623c7 admin admin] PATH_INFO: `/v3/projects/acd89025087841f89da0bfc29ec9d034/users/8c2ac62eab7c4164bfd09ecc79a439aa/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:47.864002 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2539ccb-9299-421e-bc32-b912e55623c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd89025087841f89da0bfc29ec9d034, user_id=8c2ac62eab7c4164bfd09ecc79a439aa, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:47.866663 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2539ccb-9299-421e-bc32-b912e55623c7 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:47.879446 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 99/198] 10.222.0.64 () {58 vars in 1460 bytes} [Thu Dec 16 14:22:47 2021] PUT /identity/v3/projects/acd89025087841f89da0bfc29ec9d034/users/8c2ac62eab7c4164bfd09ecc79a439aa/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:22:49.951872 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df22ff-1113-464b-a559-455dfe0b9cc3 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:49.952384 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df22ff-1113-464b-a559-455dfe0b9cc3 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:49.952478 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df22ff-1113-464b-a559-455dfe0b9cc3 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:49.954170 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 100/199] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:22:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:49.959404 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949508a-2337-4e2d-80ab-c657bce90db7 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:49.959830 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949508a-2337-4e2d-80ab-c657bce90db7 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:49.959970 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949508a-2337-4e2d-80ab-c657bce90db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:49.981763 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-5949508a-2337-4e2d-80ab-c657bce90db7 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:49.982877 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-5949508a-2337-4e2d-80ab-c657bce90db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:50.044121 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 100/200] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:50.066951 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df22ff-1113-464b-a559-455dfe0b9cc3 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:50.079022 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df22ff-1113-464b-a559-455dfe0b9cc3 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:50.083027 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d4f43-0588-4828-8947-530c2ba712e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:50.083733 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d4f43-0588-4828-8947-530c2ba712e8 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:50.084022 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d4f43-0588-4828-8947-530c2ba712e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:50.084302 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d4f43-0588-4828-8947-530c2ba712e8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:50.096096 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d4f43-0588-4828-8947-530c2ba712e8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:22:50.102388 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-c02d4f43-0588-4828-8947-530c2ba712e8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:22:50.103449 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 101/201] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:22:50 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:50.109602 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949508a-2337-4e2d-80ab-c657bce90db7 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:50.117850 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949508a-2337-4e2d-80ab-c657bce90db7 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:50.121835 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a9236-d6e1-4366-9721-0753c4beced3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:50.122416 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a9236-d6e1-4366-9721-0753c4beced3 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:50.122702 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a9236-d6e1-4366-9721-0753c4beced3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:50.122980 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a9236-d6e1-4366-9721-0753c4beced3 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:50.123708 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a9236-d6e1-4366-9721-0753c4beced3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:50.124004 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a9236-d6e1-4366-9721-0753c4beced3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:50.125592 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a9236-d6e1-4366-9721-0753c4beced3 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:50.133902 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 101/202] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:22:50 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:50.139235 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d4f43-0588-4828-8947-530c2ba712e8 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:50.148347 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d4f43-0588-4828-8947-530c2ba712e8 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:50.152270 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1eb50-6e90-42a3-ad95-0fcea05dc405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:50.153080 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1eb50-6e90-42a3-ad95-0fcea05dc405 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:50.153368 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1eb50-6e90-42a3-ad95-0fcea05dc405 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:50.153651 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1eb50-6e90-42a3-ad95-0fcea05dc405 admin admin] PATH_INFO: `/v3/users/8c2ac62eab7c4164bfd09ecc79a439aa` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:50.154731 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1eb50-6e90-42a3-ad95-0fcea05dc405 admin admin] RBAC: Authorizing `identity:get_user(user_id=8c2ac62eab7c4164bfd09ecc79a439aa)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:50.157050 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1eb50-6e90-42a3-ad95-0fcea05dc405 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:50.158466 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 102/203] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:22:50 2021] GET /identity/v3/users/8c2ac62eab7c4164bfd09ecc79a439aa => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:50.163450 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a9236-d6e1-4366-9721-0753c4beced3 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:50.173198 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a9236-d6e1-4366-9721-0753c4beced3 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:50.177128 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c639f7-329c-4c60-b9ea-264647a0c8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:50.177685 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c639f7-329c-4c60-b9ea-264647a0c8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:50.177973 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c639f7-329c-4c60-b9ea-264647a0c8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:50.178254 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c639f7-329c-4c60-b9ea-264647a0c8e8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:50.185690 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c639f7-329c-4c60-b9ea-264647a0c8e8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:50.187425 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c639f7-329c-4c60-b9ea-264647a0c8e8 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:50.195579 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 102/204] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:22:50 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:22:50.201239 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1eb50-6e90-42a3-ad95-0fcea05dc405 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:50.210758 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1eb50-6e90-42a3-ad95-0fcea05dc405 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:50.214756 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7709a3d-e77d-4755-a740-ec5b11d46051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:50.215524 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7709a3d-e77d-4755-a740-ec5b11d46051 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:50.215813 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7709a3d-e77d-4755-a740-ec5b11d46051 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:50.216095 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7709a3d-e77d-4755-a740-ec5b11d46051 admin admin] PATH_INFO: `/v3/projects/acd89025087841f89da0bfc29ec9d034` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:50.217218 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7709a3d-e77d-4755-a740-ec5b11d46051 admin admin] RBAC: Authorizing `identity:get_project(project_id=acd89025087841f89da0bfc29ec9d034)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:50.219733 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7709a3d-e77d-4755-a740-ec5b11d46051 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:50.221279 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 103/205] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:22:50 2021] GET /identity/v3/projects/acd89025087841f89da0bfc29ec9d034 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:50.226704 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c639f7-329c-4c60-b9ea-264647a0c8e8 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:50.235502 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c639f7-329c-4c60-b9ea-264647a0c8e8 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:50.239463 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9362a-1d6a-4e1d-9abf-9729d10465c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:50.240023 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9362a-1d6a-4e1d-9abf-9729d10465c3 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:50.240309 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9362a-1d6a-4e1d-9abf-9729d10465c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:50.240590 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9362a-1d6a-4e1d-9abf-9729d10465c3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:50.241389 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc9362a-1d6a-4e1d-9abf-9729d10465c3 admin admin] RBAC: Adding query filter params (role.id=90166eb3dcfa41e58450e140b8b0fea3, scope.project.id=acd89025087841f89da0bfc29ec9d034, user.id=8c2ac62eab7c4164bfd09ecc79a439aa) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:50.241691 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc9362a-1d6a-4e1d-9abf-9729d10465c3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:50.243474 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc9362a-1d6a-4e1d-9abf-9729d10465c3 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:50.249329 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 103/206] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:22:50 2021] GET /identity/v3/role_assignments?user.id=8c2ac62eab7c4164bfd09ecc79a439aa&scope.project.id=acd89025087841f89da0bfc29ec9d034&role.id=90166eb3dcfa41e58450e140b8b0fea3 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:52.601634 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d46feb-dae0-4d81-8f2d-4b8518c3a6be None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:52.602198 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d46feb-dae0-4d81-8f2d-4b8518c3a6be None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:52.602198 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d46feb-dae0-4d81-8f2d-4b8518c3a6be None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:52.603852 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 104/207] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:22:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:52.610250 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077f0d1-61e6-4e74-b5a5-9a4469becdf0 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:52.610686 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077f0d1-61e6-4e74-b5a5-9a4469becdf0 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:52.610818 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077f0d1-61e6-4e74-b5a5-9a4469becdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:52.634459 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-f077f0d1-61e6-4e74-b5a5-9a4469becdf0 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:52.635622 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-f077f0d1-61e6-4e74-b5a5-9a4469becdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:52.642876 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 104/208] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:52.666921 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d46feb-dae0-4d81-8f2d-4b8518c3a6be None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:52.688231 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d46feb-dae0-4d81-8f2d-4b8518c3a6be None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:52.695068 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551b5c4-2fb9-4047-be3f-aa47c0b61d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:52.696391 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551b5c4-2fb9-4047-be3f-aa47c0b61d3a admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:52.697196 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551b5c4-2fb9-4047-be3f-aa47c0b61d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:52.697700 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551b5c4-2fb9-4047-be3f-aa47c0b61d3a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:52.719940 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551b5c4-2fb9-4047-be3f-aa47c0b61d3a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:22:52.734599 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-3551b5c4-2fb9-4047-be3f-aa47c0b61d3a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 16 14:22:52.736748 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 105/209] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:22:52 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:52.742768 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077f0d1-61e6-4e74-b5a5-9a4469becdf0 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:52.752279 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077f0d1-61e6-4e74-b5a5-9a4469becdf0 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:52.756691 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036bedb-cdc3-4a40-910d-d18a65916506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:52.757355 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036bedb-cdc3-4a40-910d-d18a65916506 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:52.757649 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036bedb-cdc3-4a40-910d-d18a65916506 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:52.757934 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036bedb-cdc3-4a40-910d-d18a65916506 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:52.758671 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036bedb-cdc3-4a40-910d-d18a65916506 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:52.758981 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036bedb-cdc3-4a40-910d-d18a65916506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:52.760596 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036bedb-cdc3-4a40-910d-d18a65916506 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:52.769970 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 105/210] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:22:52 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:52.775768 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551b5c4-2fb9-4047-be3f-aa47c0b61d3a admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:52.786005 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551b5c4-2fb9-4047-be3f-aa47c0b61d3a admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:52.790196 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea51398-4736-4338-934a-04aaf9b617eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:52.791009 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea51398-4736-4338-934a-04aaf9b617eb admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:52.791300 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea51398-4736-4338-934a-04aaf9b617eb admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:52.791584 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea51398-4736-4338-934a-04aaf9b617eb admin admin] PATH_INFO: `/v3/users/8d8a1622bcd9425897519d9da0cbc520` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:52.792948 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea51398-4736-4338-934a-04aaf9b617eb admin admin] RBAC: Authorizing `identity:get_user(user_id=8d8a1622bcd9425897519d9da0cbc520)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:52.795812 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea51398-4736-4338-934a-04aaf9b617eb admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:52.797477 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 106/211] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:22:52 2021] GET /identity/v3/users/8d8a1622bcd9425897519d9da0cbc520 => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:52.803592 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036bedb-cdc3-4a40-910d-d18a65916506 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:52.814528 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036bedb-cdc3-4a40-910d-d18a65916506 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:52.818660 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b30a63-3b3f-49ae-b754-7a4bca1b7b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:52.819248 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b30a63-3b3f-49ae-b754-7a4bca1b7b48 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:52.819542 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b30a63-3b3f-49ae-b754-7a4bca1b7b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:52.819871 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b30a63-3b3f-49ae-b754-7a4bca1b7b48 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:52.828737 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b30a63-3b3f-49ae-b754-7a4bca1b7b48 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:52.830507 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b30a63-3b3f-49ae-b754-7a4bca1b7b48 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:52.839743 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 106/212] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:22:52 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:22:52.845723 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea51398-4736-4338-934a-04aaf9b617eb admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:52.855593 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea51398-4736-4338-934a-04aaf9b617eb admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:52.860577 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b807e5-ddfa-487a-a8d6-742e4f1cf017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:52.861403 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b807e5-ddfa-487a-a8d6-742e4f1cf017 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:52.861697 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b807e5-ddfa-487a-a8d6-742e4f1cf017 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:52.861985 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b807e5-ddfa-487a-a8d6-742e4f1cf017 admin admin] PATH_INFO: `/v3/projects/acd89025087841f89da0bfc29ec9d034` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:52.863141 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b807e5-ddfa-487a-a8d6-742e4f1cf017 admin admin] RBAC: Authorizing `identity:get_project(project_id=acd89025087841f89da0bfc29ec9d034)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:52.865286 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b807e5-ddfa-487a-a8d6-742e4f1cf017 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:52.866974 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 107/213] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:22:52 2021] GET /identity/v3/projects/acd89025087841f89da0bfc29ec9d034 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:52.873174 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b30a63-3b3f-49ae-b754-7a4bca1b7b48 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:52.882732 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b30a63-3b3f-49ae-b754-7a4bca1b7b48 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:52.886953 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9885e6-5c82-44b5-b1c8-984fdcd36588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:52.887553 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9885e6-5c82-44b5-b1c8-984fdcd36588 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:52.887849 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9885e6-5c82-44b5-b1c8-984fdcd36588 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:52.888142 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9885e6-5c82-44b5-b1c8-984fdcd36588 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:52.888973 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9885e6-5c82-44b5-b1c8-984fdcd36588 admin admin] RBAC: Adding query filter params (role.id=54d74c28321f47c3a3b68ea9f95925d8, scope.project.id=acd89025087841f89da0bfc29ec9d034, user.id=8d8a1622bcd9425897519d9da0cbc520) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:52.889819 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9885e6-5c82-44b5-b1c8-984fdcd36588 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:52.891665 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9885e6-5c82-44b5-b1c8-984fdcd36588 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:52.897496 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 107/214] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:22:52 2021] GET /identity/v3/role_assignments?user.id=8d8a1622bcd9425897519d9da0cbc520&scope.project.id=acd89025087841f89da0bfc29ec9d034&role.id=54d74c28321f47c3a3b68ea9f95925d8 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:54.956872 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800e19c-29eb-4e08-84bd-2ac3b59443cf None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:54.957480 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800e19c-29eb-4e08-84bd-2ac3b59443cf None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:54.957480 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800e19c-29eb-4e08-84bd-2ac3b59443cf None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:54.959113 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 108/215] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:22:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:54.964417 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a681b-a0c9-4257-900c-552c9a84c219 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:54.964880 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a681b-a0c9-4257-900c-552c9a84c219 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:54.965028 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a681b-a0c9-4257-900c-552c9a84c219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:54.987696 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-725a681b-a0c9-4257-900c-552c9a84c219 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:54.988863 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-725a681b-a0c9-4257-900c-552c9a84c219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:54.995672 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 108/216] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:55.018477 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800e19c-29eb-4e08-84bd-2ac3b59443cf None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:55.030203 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800e19c-29eb-4e08-84bd-2ac3b59443cf None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:55.034180 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083322f4-d749-4489-944c-0397a45bd2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:55.034905 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083322f4-d749-4489-944c-0397a45bd2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:55.035196 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083322f4-d749-4489-944c-0397a45bd2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:55.035481 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083322f4-d749-4489-944c-0397a45bd2c9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:55.047160 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083322f4-d749-4489-944c-0397a45bd2c9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:22:55.054094 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-083322f4-d749-4489-944c-0397a45bd2c9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 16 14:22:55.055232 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 109/217] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:22:55 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:55.061718 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a681b-a0c9-4257-900c-552c9a84c219 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:55.070222 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a681b-a0c9-4257-900c-552c9a84c219 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:55.074524 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d4f5c-36cd-4699-bad0-4a3a172927ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:55.075111 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d4f5c-36cd-4699-bad0-4a3a172927ac admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:55.075400 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d4f5c-36cd-4699-bad0-4a3a172927ac admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:55.075683 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d4f5c-36cd-4699-bad0-4a3a172927ac admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:55.076415 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d4f5c-36cd-4699-bad0-4a3a172927ac admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:55.076686 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d4f5c-36cd-4699-bad0-4a3a172927ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:55.078286 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d4f5c-36cd-4699-bad0-4a3a172927ac admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:55.086397 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 109/218] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:22:55 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:55.091475 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083322f4-d749-4489-944c-0397a45bd2c9 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:55.101072 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083322f4-d749-4489-944c-0397a45bd2c9 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:55.105021 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2d508-8dd1-4634-85a6-86b9b1d43cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:55.105739 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2d508-8dd1-4634-85a6-86b9b1d43cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:55.106024 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2d508-8dd1-4634-85a6-86b9b1d43cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:55.106303 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2d508-8dd1-4634-85a6-86b9b1d43cf9 admin admin] PATH_INFO: `/v3/users/8d8a1622bcd9425897519d9da0cbc520` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:55.107375 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2d508-8dd1-4634-85a6-86b9b1d43cf9 admin admin] RBAC: Authorizing `identity:get_user(user_id=8d8a1622bcd9425897519d9da0cbc520)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:55.110021 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2d508-8dd1-4634-85a6-86b9b1d43cf9 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:55.111433 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 110/219] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:22:55 2021] GET /identity/v3/users/8d8a1622bcd9425897519d9da0cbc520 => generated 283 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:55.116677 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d4f5c-36cd-4699-bad0-4a3a172927ac admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:55.126337 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d4f5c-36cd-4699-bad0-4a3a172927ac admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:55.130397 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf1f65-075d-409d-8aa8-5b28340325e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:55.131173 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf1f65-075d-409d-8aa8-5b28340325e2 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:55.131462 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf1f65-075d-409d-8aa8-5b28340325e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:55.131745 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf1f65-075d-409d-8aa8-5b28340325e2 admin admin] PATH_INFO: `/v3/projects/acd89025087841f89da0bfc29ec9d034` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:55.132886 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf1f65-075d-409d-8aa8-5b28340325e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=acd89025087841f89da0bfc29ec9d034)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:55.134905 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf1f65-075d-409d-8aa8-5b28340325e2 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:55.136431 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 110/220] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:22:55 2021] GET /identity/v3/projects/acd89025087841f89da0bfc29ec9d034 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:55.142478 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2d508-8dd1-4634-85a6-86b9b1d43cf9 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:55.151839 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2d508-8dd1-4634-85a6-86b9b1d43cf9 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:55.156271 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83ac8c-e87f-427c-8c92-77dbf12dc002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:55.157103 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83ac8c-e87f-427c-8c92-77dbf12dc002 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:55.157391 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83ac8c-e87f-427c-8c92-77dbf12dc002 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:55.157667 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83ac8c-e87f-427c-8c92-77dbf12dc002 admin admin] PATH_INFO: `/v3/projects/acd89025087841f89da0bfc29ec9d034/users/8d8a1622bcd9425897519d9da0cbc520/roles/54d74c28321f47c3a3b68ea9f95925d8` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:55.159632 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83ac8c-e87f-427c-8c92-77dbf12dc002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd89025087841f89da0bfc29ec9d034, user_id=8d8a1622bcd9425897519d9da0cbc520, role_id=54d74c28321f47c3a3b68ea9f95925d8)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:55.162289 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83ac8c-e87f-427c-8c92-77dbf12dc002 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:55.174641 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 111/221] 10.222.0.64 () {58 vars in 1460 bytes} [Thu Dec 16 14:22:55 2021] PUT /identity/v3/projects/acd89025087841f89da0bfc29ec9d034/users/8d8a1622bcd9425897519d9da0cbc520/roles/54d74c28321f47c3a3b68ea9f95925d8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:22:57.230042 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9d08f-cf02-45ad-9853-38a1f5a91e37 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:57.230561 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9d08f-cf02-45ad-9853-38a1f5a91e37 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:57.230650 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9d08f-cf02-45ad-9853-38a1f5a91e37 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:57.232255 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 111/222] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:22:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:57.238362 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b910d-e596-406f-863c-65e61d35de86 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:57.238853 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b910d-e596-406f-863c-65e61d35de86 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:57.238949 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b910d-e596-406f-863c-65e61d35de86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:57.261508 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-e22b910d-e596-406f-863c-65e61d35de86 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:57.262645 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e22b910d-e596-406f-863c-65e61d35de86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:57.326383 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 112/223] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:57.349616 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9d08f-cf02-45ad-9853-38a1f5a91e37 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:57.362080 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9d08f-cf02-45ad-9853-38a1f5a91e37 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:57.366027 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67706c-39f0-4086-910f-58c1862b4ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:57.366761 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67706c-39f0-4086-910f-58c1862b4ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:57.367045 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67706c-39f0-4086-910f-58c1862b4ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:57.367328 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67706c-39f0-4086-910f-58c1862b4ea4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:57.380185 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67706c-39f0-4086-910f-58c1862b4ea4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:22:57.386926 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-2d67706c-39f0-4086-910f-58c1862b4ea4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 16 14:22:57.388061 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 112/224] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:22:57 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:57.394422 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b910d-e596-406f-863c-65e61d35de86 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:57.403193 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b910d-e596-406f-863c-65e61d35de86 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:57.407878 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c869899-f495-441f-b4e9-42993f5432b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:57.408480 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c869899-f495-441f-b4e9-42993f5432b1 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:57.408765 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c869899-f495-441f-b4e9-42993f5432b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:57.409072 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c869899-f495-441f-b4e9-42993f5432b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:57.409790 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c869899-f495-441f-b4e9-42993f5432b1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:57.410089 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c869899-f495-441f-b4e9-42993f5432b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:57.411687 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c869899-f495-441f-b4e9-42993f5432b1 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:57.421018 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 113/225] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:22:57 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:57.426709 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67706c-39f0-4086-910f-58c1862b4ea4 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:57.436098 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67706c-39f0-4086-910f-58c1862b4ea4 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:57.440399 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74cb8f-375d-4db9-9d0b-ad2677fcc030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:57.441245 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74cb8f-375d-4db9-9d0b-ad2677fcc030 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:57.441537 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74cb8f-375d-4db9-9d0b-ad2677fcc030 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:57.441823 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74cb8f-375d-4db9-9d0b-ad2677fcc030 admin admin] PATH_INFO: `/v3/users/8d8a1622bcd9425897519d9da0cbc520` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:57.442970 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74cb8f-375d-4db9-9d0b-ad2677fcc030 admin admin] RBAC: Authorizing `identity:get_user(user_id=8d8a1622bcd9425897519d9da0cbc520)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:57.445136 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74cb8f-375d-4db9-9d0b-ad2677fcc030 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:57.446921 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 113/226] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:22:57 2021] GET /identity/v3/users/8d8a1622bcd9425897519d9da0cbc520 => generated 283 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:57.452837 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c869899-f495-441f-b4e9-42993f5432b1 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:57.462619 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c869899-f495-441f-b4e9-42993f5432b1 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:57.467339 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227c41a-491e-4175-91e0-37639364a2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:57.467954 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227c41a-491e-4175-91e0-37639364a2bb admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:57.468247 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227c41a-491e-4175-91e0-37639364a2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:57.468530 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227c41a-491e-4175-91e0-37639364a2bb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:57.477817 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227c41a-491e-4175-91e0-37639364a2bb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:57.479033 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227c41a-491e-4175-91e0-37639364a2bb admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:57.489175 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 114/227] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:22:57 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:22:57.494934 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74cb8f-375d-4db9-9d0b-ad2677fcc030 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:57.504585 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74cb8f-375d-4db9-9d0b-ad2677fcc030 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:57.508853 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de47c28-a3c4-4efa-b857-cf54c36f7a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:57.509522 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de47c28-a3c4-4efa-b857-cf54c36f7a01 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:57.509814 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de47c28-a3c4-4efa-b857-cf54c36f7a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:57.510101 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de47c28-a3c4-4efa-b857-cf54c36f7a01 admin admin] PATH_INFO: `/v3/projects/acd89025087841f89da0bfc29ec9d034` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:57.511259 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de47c28-a3c4-4efa-b857-cf54c36f7a01 admin admin] RBAC: Authorizing `identity:get_project(project_id=acd89025087841f89da0bfc29ec9d034)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:57.513380 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de47c28-a3c4-4efa-b857-cf54c36f7a01 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:57.514963 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 114/228] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:22:57 2021] GET /identity/v3/projects/acd89025087841f89da0bfc29ec9d034 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:57.520928 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227c41a-491e-4175-91e0-37639364a2bb admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:57.530433 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227c41a-491e-4175-91e0-37639364a2bb admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:57.534673 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa9437-1709-4c2e-977b-6ea17b2622a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:57.535274 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa9437-1709-4c2e-977b-6ea17b2622a7 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:57.535566 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa9437-1709-4c2e-977b-6ea17b2622a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:57.535849 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa9437-1709-4c2e-977b-6ea17b2622a7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:57.536649 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa9437-1709-4c2e-977b-6ea17b2622a7 admin admin] RBAC: Adding query filter params (role.id=54d74c28321f47c3a3b68ea9f95925d8, scope.project.id=acd89025087841f89da0bfc29ec9d034, user.id=8d8a1622bcd9425897519d9da0cbc520) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:22:57.536994 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa9437-1709-4c2e-977b-6ea17b2622a7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:57.538888 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa9437-1709-4c2e-977b-6ea17b2622a7 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:57.544950 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 115/229] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:22:57 2021] GET /identity/v3/role_assignments?user.id=8d8a1622bcd9425897519d9da0cbc520&scope.project.id=acd89025087841f89da0bfc29ec9d034&role.id=54d74c28321f47c3a3b68ea9f95925d8 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:59.653089 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09f094-55e8-476e-bb8d-2a96444de00a None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:59.653614 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09f094-55e8-476e-bb8d-2a96444de00a None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:59.653700 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09f094-55e8-476e-bb8d-2a96444de00a None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:59.655943 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 115/230] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:22:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:59.661055 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2a2ca-217c-4ffd-97bc-4c7829b43e25 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:59.661453 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2a2ca-217c-4ffd-97bc-4c7829b43e25 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:59.661629 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2a2ca-217c-4ffd-97bc-4c7829b43e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:59.683126 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-d5b2a2ca-217c-4ffd-97bc-4c7829b43e25 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:59.684267 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-d5b2a2ca-217c-4ffd-97bc-4c7829b43e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:59.691585 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 116/231] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:59.714331 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09f094-55e8-476e-bb8d-2a96444de00a None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:59.725873 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09f094-55e8-476e-bb8d-2a96444de00a None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:59.729781 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fecc14-713d-4cf5-952a-20ca6c2750ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:59.730478 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fecc14-713d-4cf5-952a-20ca6c2750ae admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:59.730766 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fecc14-713d-4cf5-952a-20ca6c2750ae admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:59.731043 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fecc14-713d-4cf5-952a-20ca6c2750ae admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:59.732100 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fecc14-713d-4cf5-952a-20ca6c2750ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:59.733792 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fecc14-713d-4cf5-952a-20ca6c2750ae admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:59.735239 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 116/232] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:59 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:59.740323 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2a2ca-217c-4ffd-97bc-4c7829b43e25 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:59.749450 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2a2ca-217c-4ffd-97bc-4c7829b43e25 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:59.753475 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b7c83-9b02-41e0-8dcf-68235bc1912b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:59.754064 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b7c83-9b02-41e0-8dcf-68235bc1912b admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:59.754353 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b7c83-9b02-41e0-8dcf-68235bc1912b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:59.754640 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b7c83-9b02-41e0-8dcf-68235bc1912b admin admin] PATH_INFO: `/v3/groups` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:59.755268 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b7c83-9b02-41e0-8dcf-68235bc1912b admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:59.756276 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING py.warnings [None req-b44b7c83-9b02-41e0-8dcf-68235bc1912b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:22:59.756276 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: warnings.warn(msg) Dec 16 14:22:59.756276 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: Dec 16 14:22:59.757498 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b7c83-9b02-41e0-8dcf-68235bc1912b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:22:59.771402 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 117/233] 10.222.0.64 () {60 vars in 1155 bytes} [Thu Dec 16 14:22:59 2021] POST /identity/v3/groups => generated 229 bytes in 31 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:23:01.874609 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2bebc-3b36-46b9-8940-90ea83d52300 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:01.875354 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2bebc-3b36-46b9-8940-90ea83d52300 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:01.875354 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2bebc-3b36-46b9-8940-90ea83d52300 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:01.876877 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 117/234] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:23:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:01.882478 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad92e3a-2c28-46c9-9741-34cb081c8427 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:01.882960 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad92e3a-2c28-46c9-9741-34cb081c8427 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:01.883065 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad92e3a-2c28-46c9-9741-34cb081c8427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:01.905905 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-5ad92e3a-2c28-46c9-9741-34cb081c8427 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:01.907086 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-5ad92e3a-2c28-46c9-9741-34cb081c8427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:01.914148 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 118/235] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:01.937705 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2bebc-3b36-46b9-8940-90ea83d52300 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:01.950205 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2bebc-3b36-46b9-8940-90ea83d52300 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:01.954394 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e18abb-9503-4348-bcad-278b6b6f516c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:01.955130 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e18abb-9503-4348-bcad-278b6b6f516c admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:01.955465 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e18abb-9503-4348-bcad-278b6b6f516c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:01.955778 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e18abb-9503-4348-bcad-278b6b6f516c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:01.956957 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e18abb-9503-4348-bcad-278b6b6f516c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:01.958750 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e18abb-9503-4348-bcad-278b6b6f516c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:01.960347 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 118/236] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:01 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:01.967514 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad92e3a-2c28-46c9-9741-34cb081c8427 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:01.980665 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad92e3a-2c28-46c9-9741-34cb081c8427 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:01.985498 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e4892-9736-4454-865a-7ee4d28faa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:01.986111 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e4892-9736-4454-865a-7ee4d28faa87 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:01.986403 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e4892-9736-4454-865a-7ee4d28faa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:01.986686 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e4892-9736-4454-865a-7ee4d28faa87 admin admin] PATH_INFO: `/v3/groups` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:01.987328 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e4892-9736-4454-865a-7ee4d28faa87 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:01.989291 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e4892-9736-4454-865a-7ee4d28faa87 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:02.002281 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 119/237] 10.222.0.64 () {60 vars in 1155 bytes} [Thu Dec 16 14:23:01 2021] POST /identity/v3/groups => generated 226 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:23:04.195272 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825dbba-d38c-4162-942c-5bddf95542f9 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:04.195857 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825dbba-d38c-4162-942c-5bddf95542f9 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:04.195857 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825dbba-d38c-4162-942c-5bddf95542f9 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:04.197819 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 119/238] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:23:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 16 14:23:04.204935 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5e480-9c4c-4f30-9845-52347918752b None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:04.205513 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5e480-9c4c-4f30-9845-52347918752b None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:04.205641 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5e480-9c4c-4f30-9845-52347918752b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:04.232814 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-d6f5e480-9c4c-4f30-9845-52347918752b None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:04.233957 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-d6f5e480-9c4c-4f30-9845-52347918752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:04.240910 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 120/239] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:04.264920 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825dbba-d38c-4162-942c-5bddf95542f9 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:04.277879 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825dbba-d38c-4162-942c-5bddf95542f9 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:04.282345 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b8265-9221-4bd8-9d3e-27bcb9f87d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:04.283156 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b8265-9221-4bd8-9d3e-27bcb9f87d77 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:04.283619 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b8265-9221-4bd8-9d3e-27bcb9f87d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:04.283920 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b8265-9221-4bd8-9d3e-27bcb9f87d77 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:04.297377 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b8265-9221-4bd8-9d3e-27bcb9f87d77 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:23:04.303755 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-1a5b8265-9221-4bd8-9d3e-27bcb9f87d77 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:23:04.304885 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 120/240] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:23:04 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:04.311478 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5e480-9c4c-4f30-9845-52347918752b None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:04.320314 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5e480-9c4c-4f30-9845-52347918752b None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:04.324575 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40632fd-9fcb-409b-b06f-038224518f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:04.325211 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40632fd-9fcb-409b-b06f-038224518f4f admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:04.325499 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40632fd-9fcb-409b-b06f-038224518f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:04.325796 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40632fd-9fcb-409b-b06f-038224518f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:04.327056 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40632fd-9fcb-409b-b06f-038224518f4f admin admin] RBAC: Adding query filter params (name=member) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:04.327355 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40632fd-9fcb-409b-b06f-038224518f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:04.328981 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40632fd-9fcb-409b-b06f-038224518f4f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:04.337606 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 121/241] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Dec 16 14:23:04 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:04.343333 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b8265-9221-4bd8-9d3e-27bcb9f87d77 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:04.352641 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b8265-9221-4bd8-9d3e-27bcb9f87d77 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:04.356683 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c678d3-3bb7-4b82-95eb-660e0792a5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:04.357293 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c678d3-3bb7-4b82-95eb-660e0792a5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:04.357587 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c678d3-3bb7-4b82-95eb-660e0792a5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:04.357874 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c678d3-3bb7-4b82-95eb-660e0792a5f2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:04.365389 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c678d3-3bb7-4b82-95eb-660e0792a5f2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:04.367113 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c678d3-3bb7-4b82-95eb-660e0792a5f2 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:04.376720 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 121/242] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:23:04 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:23:04.382322 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40632fd-9fcb-409b-b06f-038224518f4f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:04.392041 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40632fd-9fcb-409b-b06f-038224518f4f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:04.395984 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f391af2-7186-43b3-a1bd-6bd7110cd89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:04.396805 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f391af2-7186-43b3-a1bd-6bd7110cd89d admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:04.397106 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f391af2-7186-43b3-a1bd-6bd7110cd89d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:04.397390 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f391af2-7186-43b3-a1bd-6bd7110cd89d admin admin] PATH_INFO: `/v3/projects/9fcacc34d06d4718a100e858ed8da87e` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:04.398477 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f391af2-7186-43b3-a1bd-6bd7110cd89d admin admin] RBAC: Authorizing `identity:get_project(project_id=9fcacc34d06d4718a100e858ed8da87e)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:04.400519 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f391af2-7186-43b3-a1bd-6bd7110cd89d admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:04.402057 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 122/243] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:23:04 2021] GET /identity/v3/projects/9fcacc34d06d4718a100e858ed8da87e => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:04.407374 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c678d3-3bb7-4b82-95eb-660e0792a5f2 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:04.415730 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c678d3-3bb7-4b82-95eb-660e0792a5f2 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:04.419877 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935ff36-a123-424a-8e0d-6bae4f244d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:04.420636 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935ff36-a123-424a-8e0d-6bae4f244d9f admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:04.420967 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935ff36-a123-424a-8e0d-6bae4f244d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:04.421255 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935ff36-a123-424a-8e0d-6bae4f244d9f admin admin] PATH_INFO: `/v3/groups/9e5e320948d444a49eae3f4d6eb62601` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:04.425986 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935ff36-a123-424a-8e0d-6bae4f244d9f admin admin] RBAC: Authorizing `identity:get_group(group_id=9e5e320948d444a49eae3f4d6eb62601)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:04.427021 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING py.warnings [None req-8935ff36-a123-424a-8e0d-6bae4f244d9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:23:04.427021 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: warnings.warn(msg) Dec 16 14:23:04.427021 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: Dec 16 14:23:04.428230 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935ff36-a123-424a-8e0d-6bae4f244d9f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:04.429706 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 122/244] 10.222.0.64 () {56 vars in 1201 bytes} [Thu Dec 16 14:23:04 2021] GET /identity/v3/groups/9e5e320948d444a49eae3f4d6eb62601 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:23:04.435093 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f391af2-7186-43b3-a1bd-6bd7110cd89d admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:04.444612 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f391af2-7186-43b3-a1bd-6bd7110cd89d admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:04.448882 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f79ea6-6c70-450f-878a-2eab0471d3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:04.449397 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f79ea6-6c70-450f-878a-2eab0471d3bd admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:04.449689 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f79ea6-6c70-450f-878a-2eab0471d3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:04.449974 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f79ea6-6c70-450f-878a-2eab0471d3bd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:04.450743 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f79ea6-6c70-450f-878a-2eab0471d3bd admin admin] RBAC: Adding query filter params (group.id=9e5e320948d444a49eae3f4d6eb62601, role.id=0f176f9289ff497b8ed18a84bcfd34da, scope.project.id=9fcacc34d06d4718a100e858ed8da87e) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:04.451597 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f79ea6-6c70-450f-878a-2eab0471d3bd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:04.453437 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f79ea6-6c70-450f-878a-2eab0471d3bd admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:04.458571 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 123/245] 10.222.0.64 () {56 vars in 1397 bytes} [Thu Dec 16 14:23:04 2021] GET /identity/v3/role_assignments?group.id=9e5e320948d444a49eae3f4d6eb62601&scope.project.id=9fcacc34d06d4718a100e858ed8da87e&role.id=0f176f9289ff497b8ed18a84bcfd34da => generated 260 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:06.509903 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d54ce9-4571-4a41-88ce-dbdb9ee06d34 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:06.510466 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d54ce9-4571-4a41-88ce-dbdb9ee06d34 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:06.510466 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d54ce9-4571-4a41-88ce-dbdb9ee06d34 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:06.512173 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 123/246] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:23:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 16 14:23:06.519353 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30249bb-9c05-44de-a6dc-fbb7bddf26e5 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:06.519866 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30249bb-9c05-44de-a6dc-fbb7bddf26e5 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:06.519953 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30249bb-9c05-44de-a6dc-fbb7bddf26e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:06.543607 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-d30249bb-9c05-44de-a6dc-fbb7bddf26e5 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:06.545453 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-d30249bb-9c05-44de-a6dc-fbb7bddf26e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:06.552570 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 124/247] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:23:06.576640 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d54ce9-4571-4a41-88ce-dbdb9ee06d34 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:06.589650 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d54ce9-4571-4a41-88ce-dbdb9ee06d34 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:06.593819 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4cdee-3af3-4bcc-b4f8-c291127f50fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:06.594556 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4cdee-3af3-4bcc-b4f8-c291127f50fb admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:06.594850 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4cdee-3af3-4bcc-b4f8-c291127f50fb admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:06.595134 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4cdee-3af3-4bcc-b4f8-c291127f50fb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:06.607999 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4cdee-3af3-4bcc-b4f8-c291127f50fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:23:06.614583 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-90e4cdee-3af3-4bcc-b4f8-c291127f50fb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:23:06.615789 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 124/248] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:23:06 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:06.622142 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30249bb-9c05-44de-a6dc-fbb7bddf26e5 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:06.631761 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30249bb-9c05-44de-a6dc-fbb7bddf26e5 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:06.635970 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebaf9c0-5e6b-44f0-b1ff-c777d9e5fa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:06.636598 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebaf9c0-5e6b-44f0-b1ff-c777d9e5fa6f admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:06.636928 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebaf9c0-5e6b-44f0-b1ff-c777d9e5fa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:06.637215 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebaf9c0-5e6b-44f0-b1ff-c777d9e5fa6f admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:06.638025 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebaf9c0-5e6b-44f0-b1ff-c777d9e5fa6f admin admin] RBAC: Adding query filter params (name=member) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:06.638812 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebaf9c0-5e6b-44f0-b1ff-c777d9e5fa6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:06.640421 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebaf9c0-5e6b-44f0-b1ff-c777d9e5fa6f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:06.650108 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 125/249] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Dec 16 14:23:06 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:06.656045 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4cdee-3af3-4bcc-b4f8-c291127f50fb admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:06.669299 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4cdee-3af3-4bcc-b4f8-c291127f50fb admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:06.676333 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc9741-553a-4977-a20f-2b8d37dff212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:06.677803 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc9741-553a-4977-a20f-2b8d37dff212 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:06.678322 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc9741-553a-4977-a20f-2b8d37dff212 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:06.678841 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc9741-553a-4977-a20f-2b8d37dff212 admin admin] PATH_INFO: `/v3/groups/9e5e320948d444a49eae3f4d6eb62601` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:06.680967 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc9741-553a-4977-a20f-2b8d37dff212 admin admin] RBAC: Authorizing `identity:get_group(group_id=9e5e320948d444a49eae3f4d6eb62601)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:06.684857 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc9741-553a-4977-a20f-2b8d37dff212 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:06.688375 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 125/250] 10.222.0.64 () {56 vars in 1201 bytes} [Thu Dec 16 14:23:06 2021] GET /identity/v3/groups/9e5e320948d444a49eae3f4d6eb62601 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:06.694238 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebaf9c0-5e6b-44f0-b1ff-c777d9e5fa6f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:06.705149 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebaf9c0-5e6b-44f0-b1ff-c777d9e5fa6f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:06.709642 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7277e-55a1-4e53-84eb-e132a5af989c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:06.710455 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7277e-55a1-4e53-84eb-e132a5af989c admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:06.710744 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7277e-55a1-4e53-84eb-e132a5af989c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:06.711057 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7277e-55a1-4e53-84eb-e132a5af989c admin admin] PATH_INFO: `/v3/projects/9fcacc34d06d4718a100e858ed8da87e` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:06.712217 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7277e-55a1-4e53-84eb-e132a5af989c admin admin] RBAC: Authorizing `identity:get_project(project_id=9fcacc34d06d4718a100e858ed8da87e)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:06.714387 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7277e-55a1-4e53-84eb-e132a5af989c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:06.716045 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 126/251] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:23:06 2021] GET /identity/v3/projects/9fcacc34d06d4718a100e858ed8da87e => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:06.722105 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc9741-553a-4977-a20f-2b8d37dff212 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:06.731712 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc9741-553a-4977-a20f-2b8d37dff212 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:06.736009 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20f07d-113d-47ee-b615-eb79989ad490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:06.736865 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20f07d-113d-47ee-b615-eb79989ad490 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:06.737152 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20f07d-113d-47ee-b615-eb79989ad490 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:06.737429 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20f07d-113d-47ee-b615-eb79989ad490 admin admin] PATH_INFO: `/v3/projects/9fcacc34d06d4718a100e858ed8da87e/groups/9e5e320948d444a49eae3f4d6eb62601/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:06.739229 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20f07d-113d-47ee-b615-eb79989ad490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fcacc34d06d4718a100e858ed8da87e, group_id=9e5e320948d444a49eae3f4d6eb62601, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:06.741939 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20f07d-113d-47ee-b615-eb79989ad490 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:06.756464 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 126/252] 10.222.0.64 () {58 vars in 1463 bytes} [Thu Dec 16 14:23:06 2021] PUT /identity/v3/projects/9fcacc34d06d4718a100e858ed8da87e/groups/9e5e320948d444a49eae3f4d6eb62601/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:23:08.863983 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49fcde-bfac-4d85-8310-a59a45ef8e7f None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:08.864532 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49fcde-bfac-4d85-8310-a59a45ef8e7f None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:08.864628 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49fcde-bfac-4d85-8310-a59a45ef8e7f None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:08.866351 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 127/253] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:23:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:08.872119 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246dbd4-aece-4e68-8cf1-096ab789dc8e None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:08.872698 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246dbd4-aece-4e68-8cf1-096ab789dc8e None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:08.872818 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246dbd4-aece-4e68-8cf1-096ab789dc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:08.896359 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-7246dbd4-aece-4e68-8cf1-096ab789dc8e None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:08.897585 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-7246dbd4-aece-4e68-8cf1-096ab789dc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:08.965965 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 127/254] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:08.990346 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49fcde-bfac-4d85-8310-a59a45ef8e7f None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:09.002521 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49fcde-bfac-4d85-8310-a59a45ef8e7f None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:09.006586 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5353ebf-15f9-4177-985d-d6941ec04736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:09.007320 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5353ebf-15f9-4177-985d-d6941ec04736 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:09.007609 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5353ebf-15f9-4177-985d-d6941ec04736 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:09.007888 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5353ebf-15f9-4177-985d-d6941ec04736 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:09.021568 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5353ebf-15f9-4177-985d-d6941ec04736 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:23:09.027956 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-a5353ebf-15f9-4177-985d-d6941ec04736 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:23:09.029656 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 128/255] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:23:08 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:09.035964 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246dbd4-aece-4e68-8cf1-096ab789dc8e None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:09.046043 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246dbd4-aece-4e68-8cf1-096ab789dc8e None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:09.052892 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52de5a-da39-42e1-b09c-27c33a368a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:09.052892 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52de5a-da39-42e1-b09c-27c33a368a1c admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:09.052892 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52de5a-da39-42e1-b09c-27c33a368a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:09.052892 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52de5a-da39-42e1-b09c-27c33a368a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:09.056067 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52de5a-da39-42e1-b09c-27c33a368a1c admin admin] RBAC: Adding query filter params (name=member) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:09.056067 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52de5a-da39-42e1-b09c-27c33a368a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:09.056067 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52de5a-da39-42e1-b09c-27c33a368a1c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:09.065647 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 128/256] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Dec 16 14:23:09 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:09.071722 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5353ebf-15f9-4177-985d-d6941ec04736 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:09.081928 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5353ebf-15f9-4177-985d-d6941ec04736 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:09.086102 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e008642-b13a-4c04-84e6-138863313651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:09.086693 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e008642-b13a-4c04-84e6-138863313651 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:09.086986 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e008642-b13a-4c04-84e6-138863313651 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:09.087268 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e008642-b13a-4c04-84e6-138863313651 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:09.096711 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e008642-b13a-4c04-84e6-138863313651 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:09.098510 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e008642-b13a-4c04-84e6-138863313651 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:09.107523 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 129/257] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:23:09 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:23:09.113618 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52de5a-da39-42e1-b09c-27c33a368a1c admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:09.123117 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52de5a-da39-42e1-b09c-27c33a368a1c admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:09.127277 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d3f51-3f77-4590-bde7-711553376f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:09.128068 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d3f51-3f77-4590-bde7-711553376f5b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:09.128359 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d3f51-3f77-4590-bde7-711553376f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:09.128641 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d3f51-3f77-4590-bde7-711553376f5b admin admin] PATH_INFO: `/v3/projects/9fcacc34d06d4718a100e858ed8da87e` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:09.129797 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d3f51-3f77-4590-bde7-711553376f5b admin admin] RBAC: Authorizing `identity:get_project(project_id=9fcacc34d06d4718a100e858ed8da87e)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:09.131840 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d3f51-3f77-4590-bde7-711553376f5b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:09.133451 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 129/258] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:23:09 2021] GET /identity/v3/projects/9fcacc34d06d4718a100e858ed8da87e => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:09.139573 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e008642-b13a-4c04-84e6-138863313651 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:09.148423 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e008642-b13a-4c04-84e6-138863313651 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:09.152545 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb3097-8581-4d04-ab54-5a0e58f99176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:09.153379 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb3097-8581-4d04-ab54-5a0e58f99176 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:09.154274 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb3097-8581-4d04-ab54-5a0e58f99176 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:09.154569 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb3097-8581-4d04-ab54-5a0e58f99176 admin admin] PATH_INFO: `/v3/groups/9e5e320948d444a49eae3f4d6eb62601` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:09.155694 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb3097-8581-4d04-ab54-5a0e58f99176 admin admin] RBAC: Authorizing `identity:get_group(group_id=9e5e320948d444a49eae3f4d6eb62601)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:09.156711 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING py.warnings [None req-dfeb3097-8581-4d04-ab54-5a0e58f99176 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:23:09.156711 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: warnings.warn(msg) Dec 16 14:23:09.156711 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: Dec 16 14:23:09.157941 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb3097-8581-4d04-ab54-5a0e58f99176 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:09.159443 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 130/259] 10.222.0.64 () {56 vars in 1201 bytes} [Thu Dec 16 14:23:09 2021] GET /identity/v3/groups/9e5e320948d444a49eae3f4d6eb62601 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:09.165375 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d3f51-3f77-4590-bde7-711553376f5b admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:09.174784 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d3f51-3f77-4590-bde7-711553376f5b admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:09.179619 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cf4cd-1867-4aa2-9064-50e5732c671d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:09.180197 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cf4cd-1867-4aa2-9064-50e5732c671d admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:09.180487 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cf4cd-1867-4aa2-9064-50e5732c671d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:09.180768 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cf4cd-1867-4aa2-9064-50e5732c671d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:09.181571 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9cf4cd-1867-4aa2-9064-50e5732c671d admin admin] RBAC: Adding query filter params (group.id=9e5e320948d444a49eae3f4d6eb62601, role.id=0f176f9289ff497b8ed18a84bcfd34da, scope.project.id=9fcacc34d06d4718a100e858ed8da87e) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:09.181873 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9cf4cd-1867-4aa2-9064-50e5732c671d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:09.183692 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9cf4cd-1867-4aa2-9064-50e5732c671d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:09.189670 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 130/260] 10.222.0.64 () {56 vars in 1397 bytes} [Thu Dec 16 14:23:09 2021] GET /identity/v3/role_assignments?group.id=9e5e320948d444a49eae3f4d6eb62601&scope.project.id=9fcacc34d06d4718a100e858ed8da87e&role.id=0f176f9289ff497b8ed18a84bcfd34da => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:11.410328 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f6d92-e2ed-41c6-9109-2c64d4da2585 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:11.410923 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f6d92-e2ed-41c6-9109-2c64d4da2585 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:11.410923 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f6d92-e2ed-41c6-9109-2c64d4da2585 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:11.412582 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 131/261] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:23:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:11.418551 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fa093-180b-4b2c-9d44-2c6f887a4e0a None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:11.419145 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fa093-180b-4b2c-9d44-2c6f887a4e0a None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:11.419145 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fa093-180b-4b2c-9d44-2c6f887a4e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:11.441910 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-cc2fa093-180b-4b2c-9d44-2c6f887a4e0a None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:11.443068 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-cc2fa093-180b-4b2c-9d44-2c6f887a4e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:11.450109 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 131/262] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:11.474296 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f6d92-e2ed-41c6-9109-2c64d4da2585 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:11.486749 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f6d92-e2ed-41c6-9109-2c64d4da2585 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:11.490969 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa39bd-09dc-43ca-b1c2-d0ebb3553742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:11.491712 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa39bd-09dc-43ca-b1c2-d0ebb3553742 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:11.491988 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa39bd-09dc-43ca-b1c2-d0ebb3553742 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:11.492265 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa39bd-09dc-43ca-b1c2-d0ebb3553742 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:11.504665 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa39bd-09dc-43ca-b1c2-d0ebb3553742 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:23:11.511598 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-1daa39bd-09dc-43ca-b1c2-d0ebb3553742 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 16 14:23:11.512769 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 132/263] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:23:11 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:11.519516 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fa093-180b-4b2c-9d44-2c6f887a4e0a None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:11.528351 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fa093-180b-4b2c-9d44-2c6f887a4e0a None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:11.533209 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e4648-04a3-442d-a8ab-0d1ae3d4e701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:11.533827 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e4648-04a3-442d-a8ab-0d1ae3d4e701 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:11.534114 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e4648-04a3-442d-a8ab-0d1ae3d4e701 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:11.534391 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e4648-04a3-442d-a8ab-0d1ae3d4e701 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:11.535109 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e4648-04a3-442d-a8ab-0d1ae3d4e701 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:11.535406 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e4648-04a3-442d-a8ab-0d1ae3d4e701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:11.537030 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e4648-04a3-442d-a8ab-0d1ae3d4e701 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:11.546129 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 132/264] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:23:11 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:11.552308 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa39bd-09dc-43ca-b1c2-d0ebb3553742 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:11.562985 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa39bd-09dc-43ca-b1c2-d0ebb3553742 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:11.567409 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4dfdd-42e6-4a67-80b3-1bf36f882084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:11.568014 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4dfdd-42e6-4a67-80b3-1bf36f882084 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:11.568306 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4dfdd-42e6-4a67-80b3-1bf36f882084 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:11.568593 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4dfdd-42e6-4a67-80b3-1bf36f882084 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:11.578140 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4dfdd-42e6-4a67-80b3-1bf36f882084 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:11.579922 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4dfdd-42e6-4a67-80b3-1bf36f882084 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:11.589974 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 133/265] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:23:11 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:23:11.597123 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e4648-04a3-442d-a8ab-0d1ae3d4e701 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:11.607499 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e4648-04a3-442d-a8ab-0d1ae3d4e701 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:11.611661 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21610130-4739-466b-88de-d1f273ce6654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:11.612458 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21610130-4739-466b-88de-d1f273ce6654 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:11.612746 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21610130-4739-466b-88de-d1f273ce6654 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:11.613065 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21610130-4739-466b-88de-d1f273ce6654 admin admin] PATH_INFO: `/v3/projects/9fcacc34d06d4718a100e858ed8da87e` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:11.614192 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21610130-4739-466b-88de-d1f273ce6654 admin admin] RBAC: Authorizing `identity:get_project(project_id=9fcacc34d06d4718a100e858ed8da87e)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:11.616259 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21610130-4739-466b-88de-d1f273ce6654 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:11.617913 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 133/266] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:23:11 2021] GET /identity/v3/projects/9fcacc34d06d4718a100e858ed8da87e => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:23:11.624337 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4dfdd-42e6-4a67-80b3-1bf36f882084 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:11.633598 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4dfdd-42e6-4a67-80b3-1bf36f882084 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:11.637718 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68e876-c9dd-4e46-b9ea-cb17201f5ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:11.639003 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68e876-c9dd-4e46-b9ea-cb17201f5ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:11.639286 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68e876-c9dd-4e46-b9ea-cb17201f5ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:11.639571 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68e876-c9dd-4e46-b9ea-cb17201f5ab1 admin admin] PATH_INFO: `/v3/groups/9e5e320948d444a49eae3f4d6eb62601` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:11.640693 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68e876-c9dd-4e46-b9ea-cb17201f5ab1 admin admin] RBAC: Authorizing `identity:get_group(group_id=9e5e320948d444a49eae3f4d6eb62601)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:11.642631 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68e876-c9dd-4e46-b9ea-cb17201f5ab1 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:11.644168 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 134/267] 10.222.0.64 () {56 vars in 1201 bytes} [Thu Dec 16 14:23:11 2021] GET /identity/v3/groups/9e5e320948d444a49eae3f4d6eb62601 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:23:11.650696 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21610130-4739-466b-88de-d1f273ce6654 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:11.666757 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21610130-4739-466b-88de-d1f273ce6654 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:11.672537 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10ecdc-e9fb-40a4-8c45-f2d773989136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:11.673370 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10ecdc-e9fb-40a4-8c45-f2d773989136 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:11.673665 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10ecdc-e9fb-40a4-8c45-f2d773989136 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:11.673951 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10ecdc-e9fb-40a4-8c45-f2d773989136 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:11.674742 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10ecdc-e9fb-40a4-8c45-f2d773989136 admin admin] RBAC: Adding query filter params (group.id=9e5e320948d444a49eae3f4d6eb62601, role.id=54d74c28321f47c3a3b68ea9f95925d8, scope.project.id=9fcacc34d06d4718a100e858ed8da87e) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:11.675052 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10ecdc-e9fb-40a4-8c45-f2d773989136 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:11.676986 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10ecdc-e9fb-40a4-8c45-f2d773989136 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:11.683169 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 134/268] 10.222.0.64 () {56 vars in 1397 bytes} [Thu Dec 16 14:23:11 2021] GET /identity/v3/role_assignments?group.id=9e5e320948d444a49eae3f4d6eb62601&scope.project.id=9fcacc34d06d4718a100e858ed8da87e&role.id=54d74c28321f47c3a3b68ea9f95925d8 => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:13.845495 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dadf3-a3e9-4faa-9b82-83ac6eb19a65 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:13.846050 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dadf3-a3e9-4faa-9b82-83ac6eb19a65 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:13.846050 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dadf3-a3e9-4faa-9b82-83ac6eb19a65 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:13.847828 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 135/269] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:23:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:13.854490 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c770be9-4021-43c9-98fb-783d69b98f64 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:13.855414 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c770be9-4021-43c9-98fb-783d69b98f64 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:13.855543 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c770be9-4021-43c9-98fb-783d69b98f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:13.895204 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-4c770be9-4021-43c9-98fb-783d69b98f64 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:13.897186 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-4c770be9-4021-43c9-98fb-783d69b98f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:13.909546 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 135/270] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:13.931896 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dadf3-a3e9-4faa-9b82-83ac6eb19a65 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:13.944542 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dadf3-a3e9-4faa-9b82-83ac6eb19a65 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:13.950018 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500349f-7b8d-41f8-9950-728947a2c02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:13.951544 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500349f-7b8d-41f8-9950-728947a2c02c admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:13.951830 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500349f-7b8d-41f8-9950-728947a2c02c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:13.952116 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500349f-7b8d-41f8-9950-728947a2c02c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:13.964442 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500349f-7b8d-41f8-9950-728947a2c02c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:23:13.971458 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-0500349f-7b8d-41f8-9950-728947a2c02c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 16 14:23:13.972652 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 136/271] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:23:13 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:13.979680 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c770be9-4021-43c9-98fb-783d69b98f64 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:13.988825 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c770be9-4021-43c9-98fb-783d69b98f64 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:13.992882 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f7b09-d3a8-43a7-bc67-5ff436ef8722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:13.993497 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f7b09-d3a8-43a7-bc67-5ff436ef8722 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:13.993784 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f7b09-d3a8-43a7-bc67-5ff436ef8722 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:13.994064 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f7b09-d3a8-43a7-bc67-5ff436ef8722 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:13.994779 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f7b09-d3a8-43a7-bc67-5ff436ef8722 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:13.995075 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f7b09-d3a8-43a7-bc67-5ff436ef8722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:13.996646 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f7b09-d3a8-43a7-bc67-5ff436ef8722 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:14.006266 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 136/272] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:23:13 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:23:14.012141 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500349f-7b8d-41f8-9950-728947a2c02c admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:14.024612 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500349f-7b8d-41f8-9950-728947a2c02c admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:14.029245 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71a865-886d-44a3-88af-d3235c1ef13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:14.030027 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71a865-886d-44a3-88af-d3235c1ef13f admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:14.030315 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71a865-886d-44a3-88af-d3235c1ef13f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:14.030595 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71a865-886d-44a3-88af-d3235c1ef13f admin admin] PATH_INFO: `/v3/groups/9e5e320948d444a49eae3f4d6eb62601` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:14.031694 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71a865-886d-44a3-88af-d3235c1ef13f admin admin] RBAC: Authorizing `identity:get_group(group_id=9e5e320948d444a49eae3f4d6eb62601)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:14.033654 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71a865-886d-44a3-88af-d3235c1ef13f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:14.035176 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 137/273] 10.222.0.64 () {56 vars in 1201 bytes} [Thu Dec 16 14:23:14 2021] GET /identity/v3/groups/9e5e320948d444a49eae3f4d6eb62601 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:14.041288 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f7b09-d3a8-43a7-bc67-5ff436ef8722 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:14.052379 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f7b09-d3a8-43a7-bc67-5ff436ef8722 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:14.056472 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd0f4e-6ac5-41c9-bae9-805afd63dc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:14.057305 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd0f4e-6ac5-41c9-bae9-805afd63dc29 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:14.057585 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd0f4e-6ac5-41c9-bae9-805afd63dc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:14.057859 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd0f4e-6ac5-41c9-bae9-805afd63dc29 admin admin] PATH_INFO: `/v3/projects/9fcacc34d06d4718a100e858ed8da87e` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:14.058972 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd0f4e-6ac5-41c9-bae9-805afd63dc29 admin admin] RBAC: Authorizing `identity:get_project(project_id=9fcacc34d06d4718a100e858ed8da87e)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:14.061139 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd0f4e-6ac5-41c9-bae9-805afd63dc29 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:14.062709 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 137/274] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:23:14 2021] GET /identity/v3/projects/9fcacc34d06d4718a100e858ed8da87e => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:14.069041 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71a865-886d-44a3-88af-d3235c1ef13f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:14.080676 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71a865-886d-44a3-88af-d3235c1ef13f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:14.085075 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b4782-24e6-4239-b586-85fcfb70e51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:14.085897 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b4782-24e6-4239-b586-85fcfb70e51c admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:14.086188 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b4782-24e6-4239-b586-85fcfb70e51c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:14.086474 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b4782-24e6-4239-b586-85fcfb70e51c admin admin] PATH_INFO: `/v3/projects/9fcacc34d06d4718a100e858ed8da87e/groups/9e5e320948d444a49eae3f4d6eb62601/roles/54d74c28321f47c3a3b68ea9f95925d8` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:14.088574 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b4782-24e6-4239-b586-85fcfb70e51c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fcacc34d06d4718a100e858ed8da87e, group_id=9e5e320948d444a49eae3f4d6eb62601, role_id=54d74c28321f47c3a3b68ea9f95925d8)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:14.091786 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b4782-24e6-4239-b586-85fcfb70e51c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:14.106468 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 138/275] 10.222.0.64 () {58 vars in 1463 bytes} [Thu Dec 16 14:23:14 2021] PUT /identity/v3/projects/9fcacc34d06d4718a100e858ed8da87e/groups/9e5e320948d444a49eae3f4d6eb62601/roles/54d74c28321f47c3a3b68ea9f95925d8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:23:16.255733 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74551084-3187-4ab1-a120-026a1da1f5ee None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:16.256315 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74551084-3187-4ab1-a120-026a1da1f5ee None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:16.256315 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74551084-3187-4ab1-a120-026a1da1f5ee None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:16.258055 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 138/276] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:23:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:16.263680 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef1a0b-35ca-4ded-b028-9daf4ec705ff None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:16.264166 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef1a0b-35ca-4ded-b028-9daf4ec705ff None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:16.264254 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef1a0b-35ca-4ded-b028-9daf4ec705ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:16.292183 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-4cef1a0b-35ca-4ded-b028-9daf4ec705ff None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:16.293394 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-4cef1a0b-35ca-4ded-b028-9daf4ec705ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:16.359666 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 139/277] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:16.384002 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74551084-3187-4ab1-a120-026a1da1f5ee None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:16.399081 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74551084-3187-4ab1-a120-026a1da1f5ee None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:16.403803 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793e003-7726-4f75-907d-1e0b48dc8777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:16.404948 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793e003-7726-4f75-907d-1e0b48dc8777 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:16.405388 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793e003-7726-4f75-907d-1e0b48dc8777 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:16.405852 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793e003-7726-4f75-907d-1e0b48dc8777 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:16.421531 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793e003-7726-4f75-907d-1e0b48dc8777 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:23:16.434244 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-8793e003-7726-4f75-907d-1e0b48dc8777 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 16 14:23:16.436914 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 139/278] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:23:16 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:23:16.443158 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef1a0b-35ca-4ded-b028-9daf4ec705ff None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:16.453246 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef1a0b-35ca-4ded-b028-9daf4ec705ff None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:16.457448 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b97e0-eff8-4525-bf83-ac823b5262d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:16.458070 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b97e0-eff8-4525-bf83-ac823b5262d6 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:16.458358 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b97e0-eff8-4525-bf83-ac823b5262d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:16.458650 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b97e0-eff8-4525-bf83-ac823b5262d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:16.459381 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b97e0-eff8-4525-bf83-ac823b5262d6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:16.459684 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b97e0-eff8-4525-bf83-ac823b5262d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:16.461338 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b97e0-eff8-4525-bf83-ac823b5262d6 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:16.470751 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 140/279] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:23:16 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:16.476688 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793e003-7726-4f75-907d-1e0b48dc8777 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:16.486681 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793e003-7726-4f75-907d-1e0b48dc8777 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:16.491477 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ce3d2-d61b-4237-8a6f-a0c87b8c4792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:16.492113 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ce3d2-d61b-4237-8a6f-a0c87b8c4792 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:16.492407 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ce3d2-d61b-4237-8a6f-a0c87b8c4792 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:16.492691 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ce3d2-d61b-4237-8a6f-a0c87b8c4792 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:16.502188 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ce3d2-d61b-4237-8a6f-a0c87b8c4792 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:16.503974 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ce3d2-d61b-4237-8a6f-a0c87b8c4792 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:16.514159 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 140/280] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:23:16 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:23:16.519922 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b97e0-eff8-4525-bf83-ac823b5262d6 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:16.530094 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b97e0-eff8-4525-bf83-ac823b5262d6 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:16.534586 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4c551-72cf-41c1-8a3a-11bad58461a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:16.535925 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4c551-72cf-41c1-8a3a-11bad58461a1 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:16.536224 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4c551-72cf-41c1-8a3a-11bad58461a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:16.536513 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4c551-72cf-41c1-8a3a-11bad58461a1 admin admin] PATH_INFO: `/v3/projects/9fcacc34d06d4718a100e858ed8da87e` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:16.537875 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4c551-72cf-41c1-8a3a-11bad58461a1 admin admin] RBAC: Authorizing `identity:get_project(project_id=9fcacc34d06d4718a100e858ed8da87e)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:16.539975 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4c551-72cf-41c1-8a3a-11bad58461a1 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:16.541817 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 141/281] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:23:16 2021] GET /identity/v3/projects/9fcacc34d06d4718a100e858ed8da87e => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:16.548185 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ce3d2-d61b-4237-8a6f-a0c87b8c4792 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:16.557203 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ce3d2-d61b-4237-8a6f-a0c87b8c4792 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:16.562224 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aee86e-c1a3-4d78-8e5b-88841ff68680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:16.563031 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aee86e-c1a3-4d78-8e5b-88841ff68680 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:16.563336 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aee86e-c1a3-4d78-8e5b-88841ff68680 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:16.563612 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aee86e-c1a3-4d78-8e5b-88841ff68680 admin admin] PATH_INFO: `/v3/groups/9e5e320948d444a49eae3f4d6eb62601` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:16.564908 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aee86e-c1a3-4d78-8e5b-88841ff68680 admin admin] RBAC: Authorizing `identity:get_group(group_id=9e5e320948d444a49eae3f4d6eb62601)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:16.566934 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aee86e-c1a3-4d78-8e5b-88841ff68680 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:16.568568 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 141/282] 10.222.0.64 () {56 vars in 1201 bytes} [Thu Dec 16 14:23:16 2021] GET /identity/v3/groups/9e5e320948d444a49eae3f4d6eb62601 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:16.574885 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4c551-72cf-41c1-8a3a-11bad58461a1 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:16.584740 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4c551-72cf-41c1-8a3a-11bad58461a1 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:16.588973 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415780d-0053-4627-9bec-e1bea9a9d59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:16.589573 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415780d-0053-4627-9bec-e1bea9a9d59c admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:16.589862 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415780d-0053-4627-9bec-e1bea9a9d59c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:16.590147 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415780d-0053-4627-9bec-e1bea9a9d59c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:16.590942 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415780d-0053-4627-9bec-e1bea9a9d59c admin admin] RBAC: Adding query filter params (group.id=9e5e320948d444a49eae3f4d6eb62601, role.id=54d74c28321f47c3a3b68ea9f95925d8, scope.project.id=9fcacc34d06d4718a100e858ed8da87e) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:16.591248 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415780d-0053-4627-9bec-e1bea9a9d59c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:16.593148 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415780d-0053-4627-9bec-e1bea9a9d59c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:16.599499 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 142/283] 10.222.0.64 () {56 vars in 1397 bytes} [Thu Dec 16 14:23:16 2021] GET /identity/v3/role_assignments?group.id=9e5e320948d444a49eae3f4d6eb62601&scope.project.id=9fcacc34d06d4718a100e858ed8da87e&role.id=54d74c28321f47c3a3b68ea9f95925d8 => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:23:18.790648 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91134488-b6c9-4762-9312-cdfca3134e28 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:18.791186 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91134488-b6c9-4762-9312-cdfca3134e28 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:18.791330 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91134488-b6c9-4762-9312-cdfca3134e28 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:18.794832 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 142/284] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:23:18 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:18.802768 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc73ee-3046-4efb-ae9b-e2a7a63b12e4 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:18.803269 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc73ee-3046-4efb-ae9b-e2a7a63b12e4 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:18.803358 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc73ee-3046-4efb-ae9b-e2a7a63b12e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:18.826857 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-e5bc73ee-3046-4efb-ae9b-e2a7a63b12e4 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:18.828029 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e5bc73ee-3046-4efb-ae9b-e2a7a63b12e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:18.835442 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 143/285] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:18.858608 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91134488-b6c9-4762-9312-cdfca3134e28 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:18.870597 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91134488-b6c9-4762-9312-cdfca3134e28 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:18.882757 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff6f7f-475b-4a60-9fe4-9645f1cdc105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:18.883616 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff6f7f-475b-4a60-9fe4-9645f1cdc105 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:18.884218 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff6f7f-475b-4a60-9fe4-9645f1cdc105 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:18.884619 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff6f7f-475b-4a60-9fe4-9645f1cdc105 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:18.897683 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff6f7f-475b-4a60-9fe4-9645f1cdc105 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:23:18.904616 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-3dff6f7f-475b-4a60-9fe4-9645f1cdc105 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:23:18.905815 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 143/286] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:23:18 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:18.911675 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc73ee-3046-4efb-ae9b-e2a7a63b12e4 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:18.921346 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc73ee-3046-4efb-ae9b-e2a7a63b12e4 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:18.925515 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917f038-3e11-4a5e-9f1e-9f502a77ef19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:18.926121 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917f038-3e11-4a5e-9f1e-9f502a77ef19 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:18.926407 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917f038-3e11-4a5e-9f1e-9f502a77ef19 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:18.926685 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917f038-3e11-4a5e-9f1e-9f502a77ef19 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:18.927402 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917f038-3e11-4a5e-9f1e-9f502a77ef19 admin admin] RBAC: Adding query filter params (name=member) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:18.927700 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917f038-3e11-4a5e-9f1e-9f502a77ef19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:18.929342 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917f038-3e11-4a5e-9f1e-9f502a77ef19 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:18.939313 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 144/287] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Dec 16 14:23:18 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:18.945084 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff6f7f-475b-4a60-9fe4-9645f1cdc105 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:18.955557 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff6f7f-475b-4a60-9fe4-9645f1cdc105 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:18.959633 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc642ca3-1c65-4925-8b57-405a67b21bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:18.960208 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc642ca3-1c65-4925-8b57-405a67b21bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:18.960499 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc642ca3-1c65-4925-8b57-405a67b21bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:18.960797 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc642ca3-1c65-4925-8b57-405a67b21bd8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:18.968956 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc642ca3-1c65-4925-8b57-405a67b21bd8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:18.970695 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc642ca3-1c65-4925-8b57-405a67b21bd8 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:18.979226 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 144/288] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:23:18 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:23:18.985442 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917f038-3e11-4a5e-9f1e-9f502a77ef19 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:18.994917 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917f038-3e11-4a5e-9f1e-9f502a77ef19 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:18.999970 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a68bf-bd6f-4ce8-aa8a-312606f88ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:19.000754 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a68bf-bd6f-4ce8-aa8a-312606f88ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:19.001065 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a68bf-bd6f-4ce8-aa8a-312606f88ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:19.001343 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a68bf-bd6f-4ce8-aa8a-312606f88ac0 admin admin] PATH_INFO: `/v3/projects/acd89025087841f89da0bfc29ec9d034` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:19.002435 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a68bf-bd6f-4ce8-aa8a-312606f88ac0 admin admin] RBAC: Authorizing `identity:get_project(project_id=acd89025087841f89da0bfc29ec9d034)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:19.004477 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a68bf-bd6f-4ce8-aa8a-312606f88ac0 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:19.006060 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 145/289] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:23:18 2021] GET /identity/v3/projects/acd89025087841f89da0bfc29ec9d034 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:19.011592 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc642ca3-1c65-4925-8b57-405a67b21bd8 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:19.020253 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc642ca3-1c65-4925-8b57-405a67b21bd8 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:19.024444 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5f6c4-d293-4c0a-aadf-5b51e18e2806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:19.025253 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5f6c4-d293-4c0a-aadf-5b51e18e2806 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:19.025544 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5f6c4-d293-4c0a-aadf-5b51e18e2806 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:19.025827 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5f6c4-d293-4c0a-aadf-5b51e18e2806 admin admin] PATH_INFO: `/v3/groups/9e5e320948d444a49eae3f4d6eb62601` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:19.026900 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5f6c4-d293-4c0a-aadf-5b51e18e2806 admin admin] RBAC: Authorizing `identity:get_group(group_id=9e5e320948d444a49eae3f4d6eb62601)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:19.028812 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5f6c4-d293-4c0a-aadf-5b51e18e2806 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:19.030282 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 145/290] 10.222.0.64 () {56 vars in 1201 bytes} [Thu Dec 16 14:23:19 2021] GET /identity/v3/groups/9e5e320948d444a49eae3f4d6eb62601 => generated 226 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:19.036011 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a68bf-bd6f-4ce8-aa8a-312606f88ac0 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:19.046072 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a68bf-bd6f-4ce8-aa8a-312606f88ac0 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:19.050082 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d551a-cf74-4e8a-aad6-59b574584104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:19.050668 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d551a-cf74-4e8a-aad6-59b574584104 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:19.050960 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d551a-cf74-4e8a-aad6-59b574584104 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:19.051246 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d551a-cf74-4e8a-aad6-59b574584104 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:19.052029 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d551a-cf74-4e8a-aad6-59b574584104 admin admin] RBAC: Adding query filter params (group.id=9e5e320948d444a49eae3f4d6eb62601, role.id=0f176f9289ff497b8ed18a84bcfd34da, scope.project.id=acd89025087841f89da0bfc29ec9d034) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:19.052335 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d551a-cf74-4e8a-aad6-59b574584104 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:19.054269 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d551a-cf74-4e8a-aad6-59b574584104 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:19.060832 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 146/291] 10.222.0.64 () {56 vars in 1397 bytes} [Thu Dec 16 14:23:19 2021] GET /identity/v3/role_assignments?group.id=9e5e320948d444a49eae3f4d6eb62601&scope.project.id=acd89025087841f89da0bfc29ec9d034&role.id=0f176f9289ff497b8ed18a84bcfd34da => generated 260 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:21.124582 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bd6b2-0080-46d5-b934-549a755d6801 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:21.125106 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bd6b2-0080-46d5-b934-549a755d6801 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:21.125106 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bd6b2-0080-46d5-b934-549a755d6801 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:21.126776 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 146/292] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:23:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:21.133978 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af432dc-14cf-4c82-ab43-c6d25acebbf5 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:21.134493 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af432dc-14cf-4c82-ab43-c6d25acebbf5 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:21.134584 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af432dc-14cf-4c82-ab43-c6d25acebbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:21.157346 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-9af432dc-14cf-4c82-ab43-c6d25acebbf5 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:21.158498 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-9af432dc-14cf-4c82-ab43-c6d25acebbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:21.165352 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 147/293] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:21.188033 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bd6b2-0080-46d5-b934-549a755d6801 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:21.201255 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bd6b2-0080-46d5-b934-549a755d6801 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:21.205263 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a49977-6690-4610-9f10-4c2c8d7d560b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:21.206033 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a49977-6690-4610-9f10-4c2c8d7d560b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:21.206326 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a49977-6690-4610-9f10-4c2c8d7d560b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:21.206637 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a49977-6690-4610-9f10-4c2c8d7d560b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:21.224101 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a49977-6690-4610-9f10-4c2c8d7d560b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:23:21.230491 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-b6a49977-6690-4610-9f10-4c2c8d7d560b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:23:21.231681 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 147/294] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:23:21 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:21.237632 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af432dc-14cf-4c82-ab43-c6d25acebbf5 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:21.246953 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af432dc-14cf-4c82-ab43-c6d25acebbf5 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:21.251166 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cdce9-bb27-4f30-8688-737865417328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:21.251777 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cdce9-bb27-4f30-8688-737865417328 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:21.252069 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cdce9-bb27-4f30-8688-737865417328 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:21.252353 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cdce9-bb27-4f30-8688-737865417328 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:21.253104 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0cdce9-bb27-4f30-8688-737865417328 admin admin] RBAC: Adding query filter params (name=member) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:21.253409 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0cdce9-bb27-4f30-8688-737865417328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:21.255007 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0cdce9-bb27-4f30-8688-737865417328 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:21.265264 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 148/295] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Dec 16 14:23:21 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:21.270959 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a49977-6690-4610-9f10-4c2c8d7d560b admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:21.284162 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a49977-6690-4610-9f10-4c2c8d7d560b admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:21.288165 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdf25d-5906-4fc7-8e96-2e79a69266c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:21.288973 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdf25d-5906-4fc7-8e96-2e79a69266c9 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:21.289260 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdf25d-5906-4fc7-8e96-2e79a69266c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:21.289533 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdf25d-5906-4fc7-8e96-2e79a69266c9 admin admin] PATH_INFO: `/v3/groups/9e5e320948d444a49eae3f4d6eb62601` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:21.290600 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdf25d-5906-4fc7-8e96-2e79a69266c9 admin admin] RBAC: Authorizing `identity:get_group(group_id=9e5e320948d444a49eae3f4d6eb62601)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:21.292467 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdf25d-5906-4fc7-8e96-2e79a69266c9 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:21.293942 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 148/296] 10.222.0.64 () {56 vars in 1201 bytes} [Thu Dec 16 14:23:21 2021] GET /identity/v3/groups/9e5e320948d444a49eae3f4d6eb62601 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:21.299361 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cdce9-bb27-4f30-8688-737865417328 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:21.308608 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cdce9-bb27-4f30-8688-737865417328 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:21.312581 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b13422-682c-4811-b843-5dce07a667ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:21.313380 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b13422-682c-4811-b843-5dce07a667ff admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:21.313669 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b13422-682c-4811-b843-5dce07a667ff admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:21.313952 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b13422-682c-4811-b843-5dce07a667ff admin admin] PATH_INFO: `/v3/projects/acd89025087841f89da0bfc29ec9d034` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:21.315038 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b13422-682c-4811-b843-5dce07a667ff admin admin] RBAC: Authorizing `identity:get_project(project_id=acd89025087841f89da0bfc29ec9d034)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:21.317091 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b13422-682c-4811-b843-5dce07a667ff admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:21.318584 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 149/297] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:23:21 2021] GET /identity/v3/projects/acd89025087841f89da0bfc29ec9d034 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:21.324068 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdf25d-5906-4fc7-8e96-2e79a69266c9 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:21.333759 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdf25d-5906-4fc7-8e96-2e79a69266c9 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:21.337753 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69cb73-8094-4691-a9d3-1c5ae8bc3c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:21.338545 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69cb73-8094-4691-a9d3-1c5ae8bc3c79 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:21.338836 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69cb73-8094-4691-a9d3-1c5ae8bc3c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:21.339119 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69cb73-8094-4691-a9d3-1c5ae8bc3c79 admin admin] PATH_INFO: `/v3/projects/acd89025087841f89da0bfc29ec9d034/groups/9e5e320948d444a49eae3f4d6eb62601/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:21.341568 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69cb73-8094-4691-a9d3-1c5ae8bc3c79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd89025087841f89da0bfc29ec9d034, group_id=9e5e320948d444a49eae3f4d6eb62601, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:21.344153 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69cb73-8094-4691-a9d3-1c5ae8bc3c79 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:21.357102 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 149/298] 10.222.0.64 () {58 vars in 1463 bytes} [Thu Dec 16 14:23:21 2021] PUT /identity/v3/projects/acd89025087841f89da0bfc29ec9d034/groups/9e5e320948d444a49eae3f4d6eb62601/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:23:23.416137 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f077f-9281-492b-b9a8-81e535ace899 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:23.416698 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f077f-9281-492b-b9a8-81e535ace899 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:23.416698 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f077f-9281-492b-b9a8-81e535ace899 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:23.418900 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 150/299] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:23:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:23.424220 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a5717-19f0-424f-b765-f781faa680cb None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:23.424619 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a5717-19f0-424f-b765-f781faa680cb None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:23.424808 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a5717-19f0-424f-b765-f781faa680cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:23.447372 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-ff7a5717-19f0-424f-b765-f781faa680cb None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:23.448523 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-ff7a5717-19f0-424f-b765-f781faa680cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:23.514228 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 150/300] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:23.537072 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f077f-9281-492b-b9a8-81e535ace899 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:23.549643 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f077f-9281-492b-b9a8-81e535ace899 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:23.553708 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b7455-46ae-4fb1-9d30-5e06402adf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:23.554429 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b7455-46ae-4fb1-9d30-5e06402adf9c admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:23.554721 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b7455-46ae-4fb1-9d30-5e06402adf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:23.555008 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b7455-46ae-4fb1-9d30-5e06402adf9c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:23.567593 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b7455-46ae-4fb1-9d30-5e06402adf9c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:23:23.574226 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-de3b7455-46ae-4fb1-9d30-5e06402adf9c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:23:23.575391 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 151/301] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:23:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:23.581335 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a5717-19f0-424f-b765-f781faa680cb None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:23.590019 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a5717-19f0-424f-b765-f781faa680cb None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:23.594194 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030ec0a-e382-4ae9-9e8c-28351e22865b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:23.594802 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030ec0a-e382-4ae9-9e8c-28351e22865b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:23.595093 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030ec0a-e382-4ae9-9e8c-28351e22865b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:23.595375 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030ec0a-e382-4ae9-9e8c-28351e22865b admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:23.596096 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030ec0a-e382-4ae9-9e8c-28351e22865b admin admin] RBAC: Adding query filter params (name=member) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:23.596399 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030ec0a-e382-4ae9-9e8c-28351e22865b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:23.598061 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030ec0a-e382-4ae9-9e8c-28351e22865b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:23.607665 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 151/302] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Dec 16 14:23:23 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:23.613270 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b7455-46ae-4fb1-9d30-5e06402adf9c admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:23.623113 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b7455-46ae-4fb1-9d30-5e06402adf9c admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:23.627114 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c1301-1802-4f62-84b7-cd7bfda7cf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:23.627679 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c1301-1802-4f62-84b7-cd7bfda7cf5d admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:23.627965 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c1301-1802-4f62-84b7-cd7bfda7cf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:23.628245 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c1301-1802-4f62-84b7-cd7bfda7cf5d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:23.635706 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c1301-1802-4f62-84b7-cd7bfda7cf5d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:23.637472 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c1301-1802-4f62-84b7-cd7bfda7cf5d admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:23.645682 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 152/303] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:23:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:23:23.651430 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030ec0a-e382-4ae9-9e8c-28351e22865b admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:23.661512 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030ec0a-e382-4ae9-9e8c-28351e22865b admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:23.665570 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf755a-fa33-432c-aa1a-aedc3e7b5964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:23.666398 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf755a-fa33-432c-aa1a-aedc3e7b5964 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:23.666638 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf755a-fa33-432c-aa1a-aedc3e7b5964 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:23.666921 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf755a-fa33-432c-aa1a-aedc3e7b5964 admin admin] PATH_INFO: `/v3/projects/acd89025087841f89da0bfc29ec9d034` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:23.668004 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf755a-fa33-432c-aa1a-aedc3e7b5964 admin admin] RBAC: Authorizing `identity:get_project(project_id=acd89025087841f89da0bfc29ec9d034)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:23.670613 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf755a-fa33-432c-aa1a-aedc3e7b5964 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:23.672137 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 152/304] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:23:23 2021] GET /identity/v3/projects/acd89025087841f89da0bfc29ec9d034 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:23.677622 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c1301-1802-4f62-84b7-cd7bfda7cf5d admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:23.686901 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c1301-1802-4f62-84b7-cd7bfda7cf5d admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:23.690931 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ff08e-371a-437b-a16e-1e3d4d590cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:23.691695 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ff08e-371a-437b-a16e-1e3d4d590cbc admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:23.691979 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ff08e-371a-437b-a16e-1e3d4d590cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:23.692252 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ff08e-371a-437b-a16e-1e3d4d590cbc admin admin] PATH_INFO: `/v3/groups/9e5e320948d444a49eae3f4d6eb62601` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:23.693344 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ff08e-371a-437b-a16e-1e3d4d590cbc admin admin] RBAC: Authorizing `identity:get_group(group_id=9e5e320948d444a49eae3f4d6eb62601)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:23.695468 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ff08e-371a-437b-a16e-1e3d4d590cbc admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:23.696920 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 153/305] 10.222.0.64 () {56 vars in 1201 bytes} [Thu Dec 16 14:23:23 2021] GET /identity/v3/groups/9e5e320948d444a49eae3f4d6eb62601 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:23.702439 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf755a-fa33-432c-aa1a-aedc3e7b5964 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:23.711849 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf755a-fa33-432c-aa1a-aedc3e7b5964 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:23.716297 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284e581-6636-43ac-97d2-b1dd69aaec62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:23.716903 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284e581-6636-43ac-97d2-b1dd69aaec62 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:23.717200 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284e581-6636-43ac-97d2-b1dd69aaec62 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:23.717488 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284e581-6636-43ac-97d2-b1dd69aaec62 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:23.718267 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284e581-6636-43ac-97d2-b1dd69aaec62 admin admin] RBAC: Adding query filter params (group.id=9e5e320948d444a49eae3f4d6eb62601, role.id=0f176f9289ff497b8ed18a84bcfd34da, scope.project.id=acd89025087841f89da0bfc29ec9d034) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:23.718574 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284e581-6636-43ac-97d2-b1dd69aaec62 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:23.720384 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284e581-6636-43ac-97d2-b1dd69aaec62 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:23.726140 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 153/306] 10.222.0.64 () {56 vars in 1397 bytes} [Thu Dec 16 14:23:23 2021] GET /identity/v3/role_assignments?group.id=9e5e320948d444a49eae3f4d6eb62601&scope.project.id=acd89025087841f89da0bfc29ec9d034&role.id=0f176f9289ff497b8ed18a84bcfd34da => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:25.909046 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b1f7a-65ed-443d-b8f1-d7212ec7e4b6 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:25.909572 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b1f7a-65ed-443d-b8f1-d7212ec7e4b6 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:25.909683 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b1f7a-65ed-443d-b8f1-d7212ec7e4b6 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:25.911298 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 154/307] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:23:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:25.916591 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b21b3-a79d-4ac6-b2a3-67cf03857152 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:25.917041 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b21b3-a79d-4ac6-b2a3-67cf03857152 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:25.917189 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b21b3-a79d-4ac6-b2a3-67cf03857152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:25.940036 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-441b21b3-a79d-4ac6-b2a3-67cf03857152 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:25.941201 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-441b21b3-a79d-4ac6-b2a3-67cf03857152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:25.948260 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 154/308] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:23:25.971352 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b1f7a-65ed-443d-b8f1-d7212ec7e4b6 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:25.983775 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b1f7a-65ed-443d-b8f1-d7212ec7e4b6 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:25.987766 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966913de-f870-4878-8d75-892816289ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:25.988501 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966913de-f870-4878-8d75-892816289ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:25.988803 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966913de-f870-4878-8d75-892816289ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:25.989103 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966913de-f870-4878-8d75-892816289ae4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:26.001174 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966913de-f870-4878-8d75-892816289ae4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:23:26.007973 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-966913de-f870-4878-8d75-892816289ae4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 16 14:23:26.009190 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 155/309] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:23:25 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:26.015219 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b21b3-a79d-4ac6-b2a3-67cf03857152 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:26.023743 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b21b3-a79d-4ac6-b2a3-67cf03857152 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:26.028000 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfc0bb-a9e0-4154-9036-3f8b8cfcc19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:26.028588 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfc0bb-a9e0-4154-9036-3f8b8cfcc19d admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:26.028913 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfc0bb-a9e0-4154-9036-3f8b8cfcc19d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:26.029196 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfc0bb-a9e0-4154-9036-3f8b8cfcc19d admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:26.029899 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfc0bb-a9e0-4154-9036-3f8b8cfcc19d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:26.030198 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfc0bb-a9e0-4154-9036-3f8b8cfcc19d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:26.031771 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfc0bb-a9e0-4154-9036-3f8b8cfcc19d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:26.040327 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 155/310] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:23:26 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:26.046454 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966913de-f870-4878-8d75-892816289ae4 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:26.056513 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966913de-f870-4878-8d75-892816289ae4 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:26.061357 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66d5f7-a253-424a-b33f-b772186e4ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:26.061950 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66d5f7-a253-424a-b33f-b772186e4ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:26.062239 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66d5f7-a253-424a-b33f-b772186e4ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:26.062520 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66d5f7-a253-424a-b33f-b772186e4ad3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:26.071284 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66d5f7-a253-424a-b33f-b772186e4ad3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:26.073058 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66d5f7-a253-424a-b33f-b772186e4ad3 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:26.081615 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 156/311] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:23:26 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:23:26.087428 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfc0bb-a9e0-4154-9036-3f8b8cfcc19d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:26.097021 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfc0bb-a9e0-4154-9036-3f8b8cfcc19d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:26.101293 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923ee34-4c47-4156-8d1b-4dfab720b1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:26.102080 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923ee34-4c47-4156-8d1b-4dfab720b1bb admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:26.102371 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923ee34-4c47-4156-8d1b-4dfab720b1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:26.102659 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923ee34-4c47-4156-8d1b-4dfab720b1bb admin admin] PATH_INFO: `/v3/projects/acd89025087841f89da0bfc29ec9d034` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:26.103785 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923ee34-4c47-4156-8d1b-4dfab720b1bb admin admin] RBAC: Authorizing `identity:get_project(project_id=acd89025087841f89da0bfc29ec9d034)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:26.106434 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923ee34-4c47-4156-8d1b-4dfab720b1bb admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:26.107904 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 156/312] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:23:26 2021] GET /identity/v3/projects/acd89025087841f89da0bfc29ec9d034 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:26.113377 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66d5f7-a253-424a-b33f-b772186e4ad3 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:26.122623 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66d5f7-a253-424a-b33f-b772186e4ad3 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:26.126734 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35b1dd-f46a-4ef9-8979-d3e5fa9a223f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:26.127515 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35b1dd-f46a-4ef9-8979-d3e5fa9a223f admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:26.127805 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35b1dd-f46a-4ef9-8979-d3e5fa9a223f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:26.128087 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35b1dd-f46a-4ef9-8979-d3e5fa9a223f admin admin] PATH_INFO: `/v3/groups/9e5e320948d444a49eae3f4d6eb62601` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:26.129188 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35b1dd-f46a-4ef9-8979-d3e5fa9a223f admin admin] RBAC: Authorizing `identity:get_group(group_id=9e5e320948d444a49eae3f4d6eb62601)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:26.131078 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35b1dd-f46a-4ef9-8979-d3e5fa9a223f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:26.132551 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 157/313] 10.222.0.64 () {56 vars in 1201 bytes} [Thu Dec 16 14:23:26 2021] GET /identity/v3/groups/9e5e320948d444a49eae3f4d6eb62601 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:26.138387 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923ee34-4c47-4156-8d1b-4dfab720b1bb admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:26.147809 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923ee34-4c47-4156-8d1b-4dfab720b1bb admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:26.151907 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99e8d0-7653-4560-adf4-0e76eb52e47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:26.152482 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99e8d0-7653-4560-adf4-0e76eb52e47f admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:26.152769 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99e8d0-7653-4560-adf4-0e76eb52e47f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:26.153088 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99e8d0-7653-4560-adf4-0e76eb52e47f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:26.153859 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99e8d0-7653-4560-adf4-0e76eb52e47f admin admin] RBAC: Adding query filter params (group.id=9e5e320948d444a49eae3f4d6eb62601, role.id=54d74c28321f47c3a3b68ea9f95925d8, scope.project.id=acd89025087841f89da0bfc29ec9d034) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:26.154163 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99e8d0-7653-4560-adf4-0e76eb52e47f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:26.156023 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99e8d0-7653-4560-adf4-0e76eb52e47f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:26.161567 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 157/314] 10.222.0.64 () {56 vars in 1397 bytes} [Thu Dec 16 14:23:26 2021] GET /identity/v3/role_assignments?group.id=9e5e320948d444a49eae3f4d6eb62601&scope.project.id=acd89025087841f89da0bfc29ec9d034&role.id=54d74c28321f47c3a3b68ea9f95925d8 => generated 260 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:28.231910 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a28851-ee3e-4839-bf46-fbc8f93d2786 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:28.232440 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a28851-ee3e-4839-bf46-fbc8f93d2786 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:28.232524 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a28851-ee3e-4839-bf46-fbc8f93d2786 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:28.234161 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 158/315] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:23:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:28.239286 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796eb4ba-0d3c-4332-8e35-9dc340c071c0 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:28.239656 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796eb4ba-0d3c-4332-8e35-9dc340c071c0 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:28.239862 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796eb4ba-0d3c-4332-8e35-9dc340c071c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:28.263309 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-796eb4ba-0d3c-4332-8e35-9dc340c071c0 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:28.264444 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-796eb4ba-0d3c-4332-8e35-9dc340c071c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:28.271449 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 158/316] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:28.293858 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a28851-ee3e-4839-bf46-fbc8f93d2786 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:28.305502 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a28851-ee3e-4839-bf46-fbc8f93d2786 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:28.310132 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c33c00-9eb2-4327-be4d-cee0eab2d1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:28.310852 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c33c00-9eb2-4327-be4d-cee0eab2d1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:28.311142 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c33c00-9eb2-4327-be4d-cee0eab2d1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:28.311432 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c33c00-9eb2-4327-be4d-cee0eab2d1a0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:28.322700 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c33c00-9eb2-4327-be4d-cee0eab2d1a0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:23:28.329454 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-25c33c00-9eb2-4327-be4d-cee0eab2d1a0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 16 14:23:28.330519 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 159/317] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:23:28 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:28.335976 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796eb4ba-0d3c-4332-8e35-9dc340c071c0 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:28.344487 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796eb4ba-0d3c-4332-8e35-9dc340c071c0 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:28.348566 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b362b1c-13d2-4dc2-afdd-d0003d4e62ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:28.349196 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b362b1c-13d2-4dc2-afdd-d0003d4e62ee admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:28.349489 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b362b1c-13d2-4dc2-afdd-d0003d4e62ee admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:28.349772 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b362b1c-13d2-4dc2-afdd-d0003d4e62ee admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:28.350483 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b362b1c-13d2-4dc2-afdd-d0003d4e62ee admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:28.350783 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b362b1c-13d2-4dc2-afdd-d0003d4e62ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:28.352358 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b362b1c-13d2-4dc2-afdd-d0003d4e62ee admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:28.361081 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 159/318] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:23:28 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:28.366116 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c33c00-9eb2-4327-be4d-cee0eab2d1a0 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:28.376696 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c33c00-9eb2-4327-be4d-cee0eab2d1a0 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:28.380906 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4cb80-157d-41c6-8386-3c528c4b87fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:28.381671 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4cb80-157d-41c6-8386-3c528c4b87fa admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:28.381961 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4cb80-157d-41c6-8386-3c528c4b87fa admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:28.382244 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4cb80-157d-41c6-8386-3c528c4b87fa admin admin] PATH_INFO: `/v3/groups/9e5e320948d444a49eae3f4d6eb62601` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:28.383308 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4cb80-157d-41c6-8386-3c528c4b87fa admin admin] RBAC: Authorizing `identity:get_group(group_id=9e5e320948d444a49eae3f4d6eb62601)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:28.385246 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4cb80-157d-41c6-8386-3c528c4b87fa admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:28.386688 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 160/319] 10.222.0.64 () {56 vars in 1201 bytes} [Thu Dec 16 14:23:28 2021] GET /identity/v3/groups/9e5e320948d444a49eae3f4d6eb62601 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:28.392227 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b362b1c-13d2-4dc2-afdd-d0003d4e62ee admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:28.401378 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b362b1c-13d2-4dc2-afdd-d0003d4e62ee admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:28.405322 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979a46e-5565-42b1-bd33-6fc51831f18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:28.406089 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979a46e-5565-42b1-bd33-6fc51831f18b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:28.406377 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979a46e-5565-42b1-bd33-6fc51831f18b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:28.406658 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979a46e-5565-42b1-bd33-6fc51831f18b admin admin] PATH_INFO: `/v3/projects/acd89025087841f89da0bfc29ec9d034` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:28.407723 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979a46e-5565-42b1-bd33-6fc51831f18b admin admin] RBAC: Authorizing `identity:get_project(project_id=acd89025087841f89da0bfc29ec9d034)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:28.409758 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979a46e-5565-42b1-bd33-6fc51831f18b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:28.411238 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 160/320] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:23:28 2021] GET /identity/v3/projects/acd89025087841f89da0bfc29ec9d034 => generated 302 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:28.416328 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4cb80-157d-41c6-8386-3c528c4b87fa admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:28.425835 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4cb80-157d-41c6-8386-3c528c4b87fa admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:28.429831 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd5475-e263-4fbf-a7f7-d82ce399c9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:28.430612 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd5475-e263-4fbf-a7f7-d82ce399c9a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:28.430900 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd5475-e263-4fbf-a7f7-d82ce399c9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:28.431185 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd5475-e263-4fbf-a7f7-d82ce399c9a6 admin admin] PATH_INFO: `/v3/projects/acd89025087841f89da0bfc29ec9d034/groups/9e5e320948d444a49eae3f4d6eb62601/roles/54d74c28321f47c3a3b68ea9f95925d8` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:28.433190 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd5475-e263-4fbf-a7f7-d82ce399c9a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd89025087841f89da0bfc29ec9d034, group_id=9e5e320948d444a49eae3f4d6eb62601, role_id=54d74c28321f47c3a3b68ea9f95925d8)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:28.436357 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd5475-e263-4fbf-a7f7-d82ce399c9a6 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:28.448128 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 161/321] 10.222.0.64 () {58 vars in 1463 bytes} [Thu Dec 16 14:23:28 2021] PUT /identity/v3/projects/acd89025087841f89da0bfc29ec9d034/groups/9e5e320948d444a49eae3f4d6eb62601/roles/54d74c28321f47c3a3b68ea9f95925d8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:23:30.504334 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a0e09-0da6-4c59-8c00-f2793bc6e165 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:30.504874 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a0e09-0da6-4c59-8c00-f2793bc6e165 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:30.504961 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a0e09-0da6-4c59-8c00-f2793bc6e165 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:30.506605 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 161/322] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:23:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:30.512159 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd4b3e-607f-42e2-83a0-1d25f87a94ce None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:30.512575 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd4b3e-607f-42e2-83a0-1d25f87a94ce None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:30.512728 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd4b3e-607f-42e2-83a0-1d25f87a94ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:30.534915 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-bbdd4b3e-607f-42e2-83a0-1d25f87a94ce None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:30.536044 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-bbdd4b3e-607f-42e2-83a0-1d25f87a94ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:30.599699 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 162/323] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:30.623310 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a0e09-0da6-4c59-8c00-f2793bc6e165 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:30.635039 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a0e09-0da6-4c59-8c00-f2793bc6e165 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:30.639661 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59d3fa-60dd-4ba9-896f-228f417f8f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:30.640369 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59d3fa-60dd-4ba9-896f-228f417f8f9b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:30.640655 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59d3fa-60dd-4ba9-896f-228f417f8f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:30.640992 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59d3fa-60dd-4ba9-896f-228f417f8f9b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:30.653926 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59d3fa-60dd-4ba9-896f-228f417f8f9b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:23:30.660408 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-6e59d3fa-60dd-4ba9-896f-228f417f8f9b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 16 14:23:30.661489 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 162/324] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:23:30 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:30.667143 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd4b3e-607f-42e2-83a0-1d25f87a94ce None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:30.675658 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd4b3e-607f-42e2-83a0-1d25f87a94ce None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:30.679676 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b43df5-bf81-4cad-8da5-61a969def408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:30.680268 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b43df5-bf81-4cad-8da5-61a969def408 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:30.680559 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b43df5-bf81-4cad-8da5-61a969def408 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:30.680880 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b43df5-bf81-4cad-8da5-61a969def408 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:30.681592 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b43df5-bf81-4cad-8da5-61a969def408 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:30.681894 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b43df5-bf81-4cad-8da5-61a969def408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:30.683504 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b43df5-bf81-4cad-8da5-61a969def408 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:30.691727 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 163/325] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:23:30 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:30.697509 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59d3fa-60dd-4ba9-896f-228f417f8f9b admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:30.707179 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59d3fa-60dd-4ba9-896f-228f417f8f9b admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:30.711273 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453aad3-1e8b-410f-b561-eae575343fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:30.711829 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453aad3-1e8b-410f-b561-eae575343fee admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:30.712112 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453aad3-1e8b-410f-b561-eae575343fee admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:30.712385 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453aad3-1e8b-410f-b561-eae575343fee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:30.720417 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453aad3-1e8b-410f-b561-eae575343fee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:30.722170 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453aad3-1e8b-410f-b561-eae575343fee admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:30.730255 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 163/326] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:23:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:23:30.736072 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b43df5-bf81-4cad-8da5-61a969def408 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:30.745210 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b43df5-bf81-4cad-8da5-61a969def408 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:30.749834 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c9003-c8af-4fa7-a07b-9401c837a811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:30.750606 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c9003-c8af-4fa7-a07b-9401c837a811 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:30.750897 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c9003-c8af-4fa7-a07b-9401c837a811 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:30.751182 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c9003-c8af-4fa7-a07b-9401c837a811 admin admin] PATH_INFO: `/v3/projects/acd89025087841f89da0bfc29ec9d034` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:30.752265 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c9003-c8af-4fa7-a07b-9401c837a811 admin admin] RBAC: Authorizing `identity:get_project(project_id=acd89025087841f89da0bfc29ec9d034)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:30.754403 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c9003-c8af-4fa7-a07b-9401c837a811 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:30.755861 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 164/327] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:23:30 2021] GET /identity/v3/projects/acd89025087841f89da0bfc29ec9d034 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:23:30.761039 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453aad3-1e8b-410f-b561-eae575343fee admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:30.769650 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453aad3-1e8b-410f-b561-eae575343fee admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:30.773695 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e30bfe-c4d5-4447-a419-e4da247f1e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:30.774446 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e30bfe-c4d5-4447-a419-e4da247f1e94 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:30.774730 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e30bfe-c4d5-4447-a419-e4da247f1e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:30.775006 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e30bfe-c4d5-4447-a419-e4da247f1e94 admin admin] PATH_INFO: `/v3/groups/9e5e320948d444a49eae3f4d6eb62601` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:30.776073 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e30bfe-c4d5-4447-a419-e4da247f1e94 admin admin] RBAC: Authorizing `identity:get_group(group_id=9e5e320948d444a49eae3f4d6eb62601)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:30.777961 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e30bfe-c4d5-4447-a419-e4da247f1e94 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:30.779389 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 164/328] 10.222.0.64 () {56 vars in 1201 bytes} [Thu Dec 16 14:23:30 2021] GET /identity/v3/groups/9e5e320948d444a49eae3f4d6eb62601 => generated 226 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:30.784980 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c9003-c8af-4fa7-a07b-9401c837a811 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:30.794597 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c9003-c8af-4fa7-a07b-9401c837a811 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:30.798625 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e558810-6679-4732-b97c-15b230591259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:30.799200 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e558810-6679-4732-b97c-15b230591259 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:30.799490 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e558810-6679-4732-b97c-15b230591259 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:30.799777 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e558810-6679-4732-b97c-15b230591259 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:30.800563 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e558810-6679-4732-b97c-15b230591259 admin admin] RBAC: Adding query filter params (group.id=9e5e320948d444a49eae3f4d6eb62601, role.id=54d74c28321f47c3a3b68ea9f95925d8, scope.project.id=acd89025087841f89da0bfc29ec9d034) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:30.800903 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e558810-6679-4732-b97c-15b230591259 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:30.802729 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e558810-6679-4732-b97c-15b230591259 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:30.808271 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 165/329] 10.222.0.64 () {56 vars in 1397 bytes} [Thu Dec 16 14:23:30 2021] GET /identity/v3/role_assignments?group.id=9e5e320948d444a49eae3f4d6eb62601&scope.project.id=acd89025087841f89da0bfc29ec9d034&role.id=54d74c28321f47c3a3b68ea9f95925d8 => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:32.982317 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb4c8e-2231-4ae7-9a25-3773b50d02f8 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:32.982882 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb4c8e-2231-4ae7-9a25-3773b50d02f8 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:32.982882 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb4c8e-2231-4ae7-9a25-3773b50d02f8 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:32.984511 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 165/330] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:23:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 16 14:23:32.989620 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad04258-16a2-4523-9f0e-f0b22f95a8f4 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:32.990006 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad04258-16a2-4523-9f0e-f0b22f95a8f4 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:32.990191 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad04258-16a2-4523-9f0e-f0b22f95a8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:33.012184 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-2ad04258-16a2-4523-9f0e-f0b22f95a8f4 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:33.013338 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-2ad04258-16a2-4523-9f0e-f0b22f95a8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:33.020026 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 166/331] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:33.042223 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb4c8e-2231-4ae7-9a25-3773b50d02f8 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:33.054155 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb4c8e-2231-4ae7-9a25-3773b50d02f8 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:33.058011 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d531626-2322-472f-b26d-2ff2ceac1df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:33.059315 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d531626-2322-472f-b26d-2ff2ceac1df1 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:33.059595 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d531626-2322-472f-b26d-2ff2ceac1df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:33.059868 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d531626-2322-472f-b26d-2ff2ceac1df1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:33.070925 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d531626-2322-472f-b26d-2ff2ceac1df1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:23:33.077121 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-0d531626-2322-472f-b26d-2ff2ceac1df1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:23:33.078179 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 166/332] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:23:33 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:33.083667 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad04258-16a2-4523-9f0e-f0b22f95a8f4 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:33.092666 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad04258-16a2-4523-9f0e-f0b22f95a8f4 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:33.096760 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6a2fc-9a23-4402-a966-eaa132f8c7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:33.097374 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6a2fc-9a23-4402-a966-eaa132f8c7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:33.097667 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6a2fc-9a23-4402-a966-eaa132f8c7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:33.097952 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6a2fc-9a23-4402-a966-eaa132f8c7e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:33.098658 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6a2fc-9a23-4402-a966-eaa132f8c7e8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:33.098959 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6a2fc-9a23-4402-a966-eaa132f8c7e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:33.100532 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6a2fc-9a23-4402-a966-eaa132f8c7e8 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:33.109556 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 167/333] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:23:33 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:33.114836 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d531626-2322-472f-b26d-2ff2ceac1df1 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:33.124457 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d531626-2322-472f-b26d-2ff2ceac1df1 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:33.128475 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb7c00-31bb-455d-9e17-d2ea4392ed80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:33.129066 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb7c00-31bb-455d-9e17-d2ea4392ed80 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:33.129355 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb7c00-31bb-455d-9e17-d2ea4392ed80 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:33.129635 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb7c00-31bb-455d-9e17-d2ea4392ed80 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:33.137130 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb7c00-31bb-455d-9e17-d2ea4392ed80 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:33.138844 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb7c00-31bb-455d-9e17-d2ea4392ed80 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:33.147048 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 167/334] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:23:33 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:23:33.152721 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6a2fc-9a23-4402-a966-eaa132f8c7e8 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:33.161762 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6a2fc-9a23-4402-a966-eaa132f8c7e8 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:33.165731 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157d0f1-b3f5-4e6e-bcdc-4e3dc30393ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:33.166499 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157d0f1-b3f5-4e6e-bcdc-4e3dc30393ca admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:33.166781 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157d0f1-b3f5-4e6e-bcdc-4e3dc30393ca admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:33.167110 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157d0f1-b3f5-4e6e-bcdc-4e3dc30393ca admin admin] PATH_INFO: `/v3/projects/4379b60ef2094a39988c4f13a32f6cb0` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:33.168718 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157d0f1-b3f5-4e6e-bcdc-4e3dc30393ca admin admin] RBAC: Authorizing `identity:get_project(project_id=4379b60ef2094a39988c4f13a32f6cb0)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:33.170497 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157d0f1-b3f5-4e6e-bcdc-4e3dc30393ca admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:33.171979 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 168/335] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:23:33 2021] GET /identity/v3/projects/4379b60ef2094a39988c4f13a32f6cb0 => generated 344 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:33.177205 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb7c00-31bb-455d-9e17-d2ea4392ed80 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:33.185467 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb7c00-31bb-455d-9e17-d2ea4392ed80 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:33.189692 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55810935-f290-46cb-8c23-c2511ac10097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:33.190279 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55810935-f290-46cb-8c23-c2511ac10097 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:33.190567 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55810935-f290-46cb-8c23-c2511ac10097 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:33.190844 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55810935-f290-46cb-8c23-c2511ac10097 admin admin] PATH_INFO: `/v3/groups/9be923dd0e5b4231beae586b4cf61434` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:33.195656 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55810935-f290-46cb-8c23-c2511ac10097 admin admin] RBAC: Authorizing `identity:get_group(group_id=9be923dd0e5b4231beae586b4cf61434)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:33.197551 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55810935-f290-46cb-8c23-c2511ac10097 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:33.199145 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 168/336] 10.222.0.64 () {56 vars in 1201 bytes} [Thu Dec 16 14:23:33 2021] GET /identity/v3/groups/9be923dd0e5b4231beae586b4cf61434 => generated 229 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:33.204395 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157d0f1-b3f5-4e6e-bcdc-4e3dc30393ca admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:33.213432 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157d0f1-b3f5-4e6e-bcdc-4e3dc30393ca admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:33.218028 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf0468-67be-4f8b-8125-b1562d29be6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:33.218593 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf0468-67be-4f8b-8125-b1562d29be6e admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:33.218880 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf0468-67be-4f8b-8125-b1562d29be6e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:33.219163 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf0468-67be-4f8b-8125-b1562d29be6e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:33.219924 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf0468-67be-4f8b-8125-b1562d29be6e admin admin] RBAC: Adding query filter params (group.id=9be923dd0e5b4231beae586b4cf61434, role.id=90166eb3dcfa41e58450e140b8b0fea3, scope.project.id=4379b60ef2094a39988c4f13a32f6cb0) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:33.220226 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf0468-67be-4f8b-8125-b1562d29be6e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:33.222055 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf0468-67be-4f8b-8125-b1562d29be6e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:33.227168 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 169/337] 10.222.0.64 () {56 vars in 1397 bytes} [Thu Dec 16 14:23:33 2021] GET /identity/v3/role_assignments?group.id=9be923dd0e5b4231beae586b4cf61434&scope.project.id=4379b60ef2094a39988c4f13a32f6cb0&role.id=90166eb3dcfa41e58450e140b8b0fea3 => generated 260 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:35.282340 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b276c-d79b-4f1b-9282-6db15b1139bd None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:35.282897 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b276c-d79b-4f1b-9282-6db15b1139bd None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:35.282897 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b276c-d79b-4f1b-9282-6db15b1139bd None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:35.284554 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 169/338] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:23:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:35.289759 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c87903-f7e1-4232-80a4-4bde962bb808 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:35.290177 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c87903-f7e1-4232-80a4-4bde962bb808 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:35.290332 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c87903-f7e1-4232-80a4-4bde962bb808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:35.313059 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-45c87903-f7e1-4232-80a4-4bde962bb808 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:35.314192 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-45c87903-f7e1-4232-80a4-4bde962bb808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:35.321235 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 170/339] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:35.343644 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b276c-d79b-4f1b-9282-6db15b1139bd None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:35.355884 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b276c-d79b-4f1b-9282-6db15b1139bd None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:35.359871 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c01b8-85f3-45d9-a2cb-39e8cd2801e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:35.360580 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c01b8-85f3-45d9-a2cb-39e8cd2801e9 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:35.360910 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c01b8-85f3-45d9-a2cb-39e8cd2801e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:35.361196 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c01b8-85f3-45d9-a2cb-39e8cd2801e9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:35.372302 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c01b8-85f3-45d9-a2cb-39e8cd2801e9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:23:35.378626 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-730c01b8-85f3-45d9-a2cb-39e8cd2801e9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:23:35.379757 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 170/340] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:23:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:35.386074 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c87903-f7e1-4232-80a4-4bde962bb808 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:35.394694 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c87903-f7e1-4232-80a4-4bde962bb808 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:35.398820 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bdeab-4738-4b04-8370-819244652552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:35.399417 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bdeab-4738-4b04-8370-819244652552 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:35.399707 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bdeab-4738-4b04-8370-819244652552 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:35.399997 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bdeab-4738-4b04-8370-819244652552 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:35.400702 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bdeab-4738-4b04-8370-819244652552 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:35.401039 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bdeab-4738-4b04-8370-819244652552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:35.403122 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bdeab-4738-4b04-8370-819244652552 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:35.411416 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 171/341] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:23:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:35.416767 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c01b8-85f3-45d9-a2cb-39e8cd2801e9 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:35.426974 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c01b8-85f3-45d9-a2cb-39e8cd2801e9 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:35.431236 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb9e56-2505-40f7-81b6-5ebcfb7a53c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:35.431996 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb9e56-2505-40f7-81b6-5ebcfb7a53c5 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:35.432277 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb9e56-2505-40f7-81b6-5ebcfb7a53c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:35.432553 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb9e56-2505-40f7-81b6-5ebcfb7a53c5 admin admin] PATH_INFO: `/v3/groups/9be923dd0e5b4231beae586b4cf61434` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:35.433664 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb9e56-2505-40f7-81b6-5ebcfb7a53c5 admin admin] RBAC: Authorizing `identity:get_group(group_id=9be923dd0e5b4231beae586b4cf61434)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:35.435516 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb9e56-2505-40f7-81b6-5ebcfb7a53c5 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:35.436968 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 171/342] 10.222.0.64 () {56 vars in 1201 bytes} [Thu Dec 16 14:23:35 2021] GET /identity/v3/groups/9be923dd0e5b4231beae586b4cf61434 => generated 229 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:35.442126 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bdeab-4738-4b04-8370-819244652552 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:35.451436 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bdeab-4738-4b04-8370-819244652552 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:35.455474 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4bf88-1d54-4c09-9607-09bfe9362780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:35.456238 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4bf88-1d54-4c09-9607-09bfe9362780 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:35.456527 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4bf88-1d54-4c09-9607-09bfe9362780 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:35.456839 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4bf88-1d54-4c09-9607-09bfe9362780 admin admin] PATH_INFO: `/v3/projects/4379b60ef2094a39988c4f13a32f6cb0` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:35.457931 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4bf88-1d54-4c09-9607-09bfe9362780 admin admin] RBAC: Authorizing `identity:get_project(project_id=4379b60ef2094a39988c4f13a32f6cb0)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:35.459684 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4bf88-1d54-4c09-9607-09bfe9362780 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:35.461212 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 172/343] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:23:35 2021] GET /identity/v3/projects/4379b60ef2094a39988c4f13a32f6cb0 => generated 344 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:35.466820 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb9e56-2505-40f7-81b6-5ebcfb7a53c5 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:35.475873 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb9e56-2505-40f7-81b6-5ebcfb7a53c5 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:35.479939 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dda138-012f-411c-96c5-40979d15b596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:35.481321 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dda138-012f-411c-96c5-40979d15b596 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:35.481612 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dda138-012f-411c-96c5-40979d15b596 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:35.481897 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dda138-012f-411c-96c5-40979d15b596 admin admin] PATH_INFO: `/v3/projects/4379b60ef2094a39988c4f13a32f6cb0/groups/9be923dd0e5b4231beae586b4cf61434/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:35.483682 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dda138-012f-411c-96c5-40979d15b596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4379b60ef2094a39988c4f13a32f6cb0, group_id=9be923dd0e5b4231beae586b4cf61434, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:35.486325 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dda138-012f-411c-96c5-40979d15b596 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:35.498693 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 172/344] 10.222.0.64 () {58 vars in 1463 bytes} [Thu Dec 16 14:23:35 2021] PUT /identity/v3/projects/4379b60ef2094a39988c4f13a32f6cb0/groups/9be923dd0e5b4231beae586b4cf61434/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:23:37.530496 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700ae4e-7bd8-437d-a1e3-f874c5cc203c None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:37.531018 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700ae4e-7bd8-437d-a1e3-f874c5cc203c None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:37.531133 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700ae4e-7bd8-437d-a1e3-f874c5cc203c None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:37.532711 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 173/345] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:23:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:37.537680 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140f014-b4d6-4c1d-b5b1-5b8976ecacf1 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:37.538095 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140f014-b4d6-4c1d-b5b1-5b8976ecacf1 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:37.538258 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140f014-b4d6-4c1d-b5b1-5b8976ecacf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:37.560982 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-d140f014-b4d6-4c1d-b5b1-5b8976ecacf1 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:37.562113 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-d140f014-b4d6-4c1d-b5b1-5b8976ecacf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:37.626167 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 173/346] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:37.648513 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700ae4e-7bd8-437d-a1e3-f874c5cc203c None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:37.660813 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700ae4e-7bd8-437d-a1e3-f874c5cc203c None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:37.664721 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41259b8a-d23c-44f9-a015-7d2aa633fd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:37.665457 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41259b8a-d23c-44f9-a015-7d2aa633fd2f admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:37.665745 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41259b8a-d23c-44f9-a015-7d2aa633fd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:37.666060 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41259b8a-d23c-44f9-a015-7d2aa633fd2f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:37.678076 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41259b8a-d23c-44f9-a015-7d2aa633fd2f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:23:37.684399 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-41259b8a-d23c-44f9-a015-7d2aa633fd2f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:23:37.685589 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 174/347] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:23:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:37.691649 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140f014-b4d6-4c1d-b5b1-5b8976ecacf1 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:37.700761 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140f014-b4d6-4c1d-b5b1-5b8976ecacf1 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:37.705884 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3458c4-9a8d-4922-b517-ff2bc3cae29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:37.706551 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3458c4-9a8d-4922-b517-ff2bc3cae29a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:37.706837 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3458c4-9a8d-4922-b517-ff2bc3cae29a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:37.707114 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3458c4-9a8d-4922-b517-ff2bc3cae29a admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:37.707817 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3458c4-9a8d-4922-b517-ff2bc3cae29a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:37.708115 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3458c4-9a8d-4922-b517-ff2bc3cae29a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:37.709789 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3458c4-9a8d-4922-b517-ff2bc3cae29a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:37.719703 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 174/348] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:23:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:37.725317 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41259b8a-d23c-44f9-a015-7d2aa633fd2f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:37.735017 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41259b8a-d23c-44f9-a015-7d2aa633fd2f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:37.738998 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76e049-a8e7-4add-875d-c3642e7680ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:37.739566 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76e049-a8e7-4add-875d-c3642e7680ec admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:37.739851 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76e049-a8e7-4add-875d-c3642e7680ec admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:37.740130 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76e049-a8e7-4add-875d-c3642e7680ec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:37.747588 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76e049-a8e7-4add-875d-c3642e7680ec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:37.749362 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76e049-a8e7-4add-875d-c3642e7680ec admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:37.757506 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 175/349] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:23:37 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:23:37.762874 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3458c4-9a8d-4922-b517-ff2bc3cae29a admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:37.774152 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3458c4-9a8d-4922-b517-ff2bc3cae29a admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:37.778914 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d70b95-6003-45d6-b9f0-d0966b53628e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:37.779698 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d70b95-6003-45d6-b9f0-d0966b53628e admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:37.779987 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d70b95-6003-45d6-b9f0-d0966b53628e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:37.780270 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d70b95-6003-45d6-b9f0-d0966b53628e admin admin] PATH_INFO: `/v3/projects/4379b60ef2094a39988c4f13a32f6cb0` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:37.781453 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d70b95-6003-45d6-b9f0-d0966b53628e admin admin] RBAC: Authorizing `identity:get_project(project_id=4379b60ef2094a39988c4f13a32f6cb0)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:37.783208 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d70b95-6003-45d6-b9f0-d0966b53628e admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:37.784724 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 175/350] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:23:37 2021] GET /identity/v3/projects/4379b60ef2094a39988c4f13a32f6cb0 => generated 344 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:23:37.790231 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76e049-a8e7-4add-875d-c3642e7680ec admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:37.799609 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76e049-a8e7-4add-875d-c3642e7680ec admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:37.803896 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3de0a-bdf0-4677-bcbc-6973013df353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:37.804673 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3de0a-bdf0-4677-bcbc-6973013df353 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:37.805001 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3de0a-bdf0-4677-bcbc-6973013df353 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:37.805293 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3de0a-bdf0-4677-bcbc-6973013df353 admin admin] PATH_INFO: `/v3/groups/9be923dd0e5b4231beae586b4cf61434` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:37.806390 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b3de0a-bdf0-4677-bcbc-6973013df353 admin admin] RBAC: Authorizing `identity:get_group(group_id=9be923dd0e5b4231beae586b4cf61434)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:37.808272 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b3de0a-bdf0-4677-bcbc-6973013df353 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:37.809762 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 176/351] 10.222.0.64 () {56 vars in 1201 bytes} [Thu Dec 16 14:23:37 2021] GET /identity/v3/groups/9be923dd0e5b4231beae586b4cf61434 => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:37.815294 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d70b95-6003-45d6-b9f0-d0966b53628e admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:37.824743 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d70b95-6003-45d6-b9f0-d0966b53628e admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:37.828911 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec173119-72ce-4799-af2b-2dccaaee5c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:37.829478 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec173119-72ce-4799-af2b-2dccaaee5c76 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:37.829766 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec173119-72ce-4799-af2b-2dccaaee5c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:37.830047 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec173119-72ce-4799-af2b-2dccaaee5c76 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:37.830819 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec173119-72ce-4799-af2b-2dccaaee5c76 admin admin] RBAC: Adding query filter params (group.id=9be923dd0e5b4231beae586b4cf61434, role.id=90166eb3dcfa41e58450e140b8b0fea3, scope.project.id=4379b60ef2094a39988c4f13a32f6cb0) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:37.831123 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec173119-72ce-4799-af2b-2dccaaee5c76 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:37.832969 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec173119-72ce-4799-af2b-2dccaaee5c76 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:37.838540 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 176/352] 10.222.0.64 () {56 vars in 1397 bytes} [Thu Dec 16 14:23:37 2021] GET /identity/v3/role_assignments?group.id=9be923dd0e5b4231beae586b4cf61434&scope.project.id=4379b60ef2094a39988c4f13a32f6cb0&role.id=90166eb3dcfa41e58450e140b8b0fea3 => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:41.090548 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb81336-fb88-428a-8bcf-dd1d0bf4936a None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:41.091089 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb81336-fb88-428a-8bcf-dd1d0bf4936a None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:41.091089 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb81336-fb88-428a-8bcf-dd1d0bf4936a None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:41.092802 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 177/353] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:23:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:41.097975 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde3dee-bb93-4923-befd-be6b9c0b9be5 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:41.098373 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde3dee-bb93-4923-befd-be6b9c0b9be5 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:41.098506 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde3dee-bb93-4923-befd-be6b9c0b9be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:41.120043 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-ddde3dee-bb93-4923-befd-be6b9c0b9be5 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:41.121166 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-ddde3dee-bb93-4923-befd-be6b9c0b9be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:41.127980 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 177/354] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:41.151792 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb81336-fb88-428a-8bcf-dd1d0bf4936a None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:41.164014 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb81336-fb88-428a-8bcf-dd1d0bf4936a None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:41.167964 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242afb67-2271-4fd5-aa86-6abc77e27197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:41.168668 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242afb67-2271-4fd5-aa86-6abc77e27197 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:41.168985 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242afb67-2271-4fd5-aa86-6abc77e27197 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:41.169269 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242afb67-2271-4fd5-aa86-6abc77e27197 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:41.180730 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242afb67-2271-4fd5-aa86-6abc77e27197 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:41.182576 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242afb67-2271-4fd5-aa86-6abc77e27197 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:41.199692 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-242afb67-2271-4fd5-aa86-6abc77e27197 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:41.200748 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 178/355] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:41.206432 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde3dee-bb93-4923-befd-be6b9c0b9be5 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:41.215832 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde3dee-bb93-4923-befd-be6b9c0b9be5 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:41.219946 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3555d-8de2-460b-a964-4178742a2f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:41.220534 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3555d-8de2-460b-a964-4178742a2f96 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:41.220855 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3555d-8de2-460b-a964-4178742a2f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:41.221145 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3555d-8de2-460b-a964-4178742a2f96 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:41.221836 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3555d-8de2-460b-a964-4178742a2f96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:41.222138 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3555d-8de2-460b-a964-4178742a2f96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:41.223722 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3555d-8de2-460b-a964-4178742a2f96 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:41.236220 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 178/356] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:41.241656 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242afb67-2271-4fd5-aa86-6abc77e27197 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:41.251151 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242afb67-2271-4fd5-aa86-6abc77e27197 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:41.255226 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d6abd-7642-4e4e-bd7b-24a329c0706e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:41.255823 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d6abd-7642-4e4e-bd7b-24a329c0706e admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:41.256110 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d6abd-7642-4e4e-bd7b-24a329c0706e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:41.256392 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d6abd-7642-4e4e-bd7b-24a329c0706e admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:41.257075 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d6abd-7642-4e4e-bd7b-24a329c0706e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:41.258074 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING py.warnings [None req-e25d6abd-7642-4e4e-bd7b-24a329c0706e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:23:41.258074 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: warnings.warn(msg) Dec 16 14:23:41.258074 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: Dec 16 14:23:41.259263 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d6abd-7642-4e4e-bd7b-24a329c0706e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:41.284232 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 179/357] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Dec 16 14:23:41 2021] POST /identity/v3/users => generated 246 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:23:43.341369 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd67bd2-e4e0-4741-aa81-756331511651 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:43.341917 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd67bd2-e4e0-4741-aa81-756331511651 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:43.341917 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd67bd2-e4e0-4741-aa81-756331511651 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:43.343637 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 179/358] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:23:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:43.348653 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80275329-2a65-4c3d-8003-66b9662d789b None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:43.349079 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80275329-2a65-4c3d-8003-66b9662d789b None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:43.349247 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80275329-2a65-4c3d-8003-66b9662d789b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:43.371726 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-80275329-2a65-4c3d-8003-66b9662d789b None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:43.372876 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-80275329-2a65-4c3d-8003-66b9662d789b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:43.379953 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 180/359] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:43.402308 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd67bd2-e4e0-4741-aa81-756331511651 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:43.413994 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd67bd2-e4e0-4741-aa81-756331511651 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:43.418454 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ab53c-ea00-4301-a9bb-c64ac53a3426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:43.419158 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ab53c-ea00-4301-a9bb-c64ac53a3426 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:43.419449 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ab53c-ea00-4301-a9bb-c64ac53a3426 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:43.419733 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ab53c-ea00-4301-a9bb-c64ac53a3426 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:43.430739 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ab53c-ea00-4301-a9bb-c64ac53a3426 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:23:43.437700 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-726ab53c-ea00-4301-a9bb-c64ac53a3426 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:23:43.438768 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 180/360] 10.222.0.64 () {56 vars in 1123 bytes} [Thu Dec 16 14:23:43 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:43.444194 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80275329-2a65-4c3d-8003-66b9662d789b None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:43.452951 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80275329-2a65-4c3d-8003-66b9662d789b None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:43.457079 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1d1b8-f95c-43e9-8388-c62d3255ac2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:43.457671 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1d1b8-f95c-43e9-8388-c62d3255ac2a admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:43.457961 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1d1b8-f95c-43e9-8388-c62d3255ac2a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:43.458246 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1d1b8-f95c-43e9-8388-c62d3255ac2a admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:43.458958 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1d1b8-f95c-43e9-8388-c62d3255ac2a admin admin] RBAC: Adding query filter params (name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:43.459262 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1d1b8-f95c-43e9-8388-c62d3255ac2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:43.460891 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1d1b8-f95c-43e9-8388-c62d3255ac2a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:43.469064 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 181/361] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Dec 16 14:23:43 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:43.474267 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ab53c-ea00-4301-a9bb-c64ac53a3426 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:43.484518 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ab53c-ea00-4301-a9bb-c64ac53a3426 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:43.488641 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9b557-fbf5-49a2-a2a4-1dfcbaaff36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:43.489382 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9b557-fbf5-49a2-a2a4-1dfcbaaff36b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:43.489682 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9b557-fbf5-49a2-a2a4-1dfcbaaff36b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:43.489969 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9b557-fbf5-49a2-a2a4-1dfcbaaff36b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:43.501720 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9b557-fbf5-49a2-a2a4-1dfcbaaff36b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:43.503540 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9b557-fbf5-49a2-a2a4-1dfcbaaff36b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:43.520840 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-b3d9b557-fbf5-49a2-a2a4-1dfcbaaff36b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:43.521903 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 181/362] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:43.528335 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1d1b8-f95c-43e9-8388-c62d3255ac2a admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:43.537695 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1d1b8-f95c-43e9-8388-c62d3255ac2a admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:43.541746 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093bd53-3420-4087-89b8-027ece560c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:43.542360 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093bd53-3420-4087-89b8-027ece560c4f admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:43.542621 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093bd53-3420-4087-89b8-027ece560c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:43.542906 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093bd53-3420-4087-89b8-027ece560c4f admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:43.543593 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093bd53-3420-4087-89b8-027ece560c4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:43.543895 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093bd53-3420-4087-89b8-027ece560c4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:43.544933 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING py.warnings [None req-7093bd53-3420-4087-89b8-027ece560c4f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:23:43.544933 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: warnings.warn(msg) Dec 16 14:23:43.544933 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: Dec 16 14:23:43.545812 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093bd53-3420-4087-89b8-027ece560c4f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:43.558561 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 182/363] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:43.563803 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9b557-fbf5-49a2-a2a4-1dfcbaaff36b admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:43.573307 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9b557-fbf5-49a2-a2a4-1dfcbaaff36b admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:43.578023 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d89bc4-04d4-400a-be16-5b7f494f954a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:43.578721 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d89bc4-04d4-400a-be16-5b7f494f954a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:43.579011 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d89bc4-04d4-400a-be16-5b7f494f954a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:43.579294 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d89bc4-04d4-400a-be16-5b7f494f954a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:43.591682 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d89bc4-04d4-400a-be16-5b7f494f954a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:43.593658 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d89bc4-04d4-400a-be16-5b7f494f954a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:43.610628 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-d2d89bc4-04d4-400a-be16-5b7f494f954a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 16 14:23:43.611670 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 182/364] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Dec 16 14:23:43 2021] GET /identity/v3/users/nova => generated 82 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:43.617089 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093bd53-3420-4087-89b8-027ece560c4f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:43.626866 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093bd53-3420-4087-89b8-027ece560c4f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:43.631753 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4010db8-eea5-4479-955a-45cabede68b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:43.632341 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4010db8-eea5-4479-955a-45cabede68b8 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:43.632622 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4010db8-eea5-4479-955a-45cabede68b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:43.632935 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4010db8-eea5-4479-955a-45cabede68b8 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:43.633715 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4010db8-eea5-4479-955a-45cabede68b8 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:43.634007 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4010db8-eea5-4479-955a-45cabede68b8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:43.635000 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING py.warnings [None req-c4010db8-eea5-4479-955a-45cabede68b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:23:43.635000 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: warnings.warn(msg) Dec 16 14:23:43.635000 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: Dec 16 14:23:43.636740 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4010db8-eea5-4479-955a-45cabede68b8 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:43.666051 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 183/365] 10.222.0.64 () {56 vars in 1154 bytes} [Thu Dec 16 14:23:43 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:43.671931 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d89bc4-04d4-400a-be16-5b7f494f954a admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:43.681512 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d89bc4-04d4-400a-be16-5b7f494f954a admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:43.686454 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b65df-6330-4f89-9ec5-28208e89be28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:43.687151 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b65df-6330-4f89-9ec5-28208e89be28 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:43.687317 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b65df-6330-4f89-9ec5-28208e89be28 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:43.687602 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b65df-6330-4f89-9ec5-28208e89be28 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:43.695618 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b65df-6330-4f89-9ec5-28208e89be28 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:43.697383 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b65df-6330-4f89-9ec5-28208e89be28 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:43.707373 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 183/366] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:23:43 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:23:43.713186 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4010db8-eea5-4479-955a-45cabede68b8 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:43.722648 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4010db8-eea5-4479-955a-45cabede68b8 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:43.726894 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265f033-276f-4548-a512-4a047bb44d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:43.727612 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265f033-276f-4548-a512-4a047bb44d07 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:43.727900 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265f033-276f-4548-a512-4a047bb44d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:43.728183 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265f033-276f-4548-a512-4a047bb44d07 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:43.739654 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265f033-276f-4548-a512-4a047bb44d07 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:43.741531 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265f033-276f-4548-a512-4a047bb44d07 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:43.758528 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-2265f033-276f-4548-a512-4a047bb44d07 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:43.759579 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 184/367] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:43.765865 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b65df-6330-4f89-9ec5-28208e89be28 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:43.774189 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b65df-6330-4f89-9ec5-28208e89be28 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:43.778312 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652a5db-d30d-458e-b83c-41e460f0a8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:43.778881 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652a5db-d30d-458e-b83c-41e460f0a8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:43.779169 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652a5db-d30d-458e-b83c-41e460f0a8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:43.779452 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652a5db-d30d-458e-b83c-41e460f0a8f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:43.780131 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652a5db-d30d-458e-b83c-41e460f0a8f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:43.780429 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652a5db-d30d-458e-b83c-41e460f0a8f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:43.782025 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652a5db-d30d-458e-b83c-41e460f0a8f2 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:43.794205 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 184/368] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:43.799322 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265f033-276f-4548-a512-4a047bb44d07 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:43.809120 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265f033-276f-4548-a512-4a047bb44d07 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:43.813255 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d1d00-47d5-430f-8a68-9330d0ff6cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:43.813975 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d1d00-47d5-430f-8a68-9330d0ff6cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:43.814265 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d1d00-47d5-430f-8a68-9330d0ff6cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:43.814549 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d1d00-47d5-430f-8a68-9330d0ff6cf0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:43.825340 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d1d00-47d5-430f-8a68-9330d0ff6cf0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:43.827301 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d1d00-47d5-430f-8a68-9330d0ff6cf0 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:43.840692 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-202d1d00-47d5-430f-8a68-9330d0ff6cf0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:23:43.841829 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 185/369] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:23:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:23:43.847329 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652a5db-d30d-458e-b83c-41e460f0a8f2 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:43.856573 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652a5db-d30d-458e-b83c-41e460f0a8f2 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:43.860723 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac4968-79f1-4486-a16a-00eb9582d1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:43.861336 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac4968-79f1-4486-a16a-00eb9582d1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:43.861627 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac4968-79f1-4486-a16a-00eb9582d1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:43.861912 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac4968-79f1-4486-a16a-00eb9582d1e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:43.862652 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac4968-79f1-4486-a16a-00eb9582d1e7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:43.863011 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac4968-79f1-4486-a16a-00eb9582d1e7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:43.863946 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING py.warnings [None req-eeac4968-79f1-4486-a16a-00eb9582d1e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:23:43.863946 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: warnings.warn(msg) Dec 16 14:23:43.863946 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: Dec 16 14:23:43.865087 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac4968-79f1-4486-a16a-00eb9582d1e7 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:43.879390 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 185/370] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:23:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:43.885191 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d1d00-47d5-430f-8a68-9330d0ff6cf0 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:43.894985 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d1d00-47d5-430f-8a68-9330d0ff6cf0 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:43.898964 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de424d-d94e-4c54-817f-a5cd7b754d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:43.899538 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de424d-d94e-4c54-817f-a5cd7b754d95 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:43.899820 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de424d-d94e-4c54-817f-a5cd7b754d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:43.900098 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de424d-d94e-4c54-817f-a5cd7b754d95 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:43.900901 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de424d-d94e-4c54-817f-a5cd7b754d95 admin admin] RBAC: Adding query filter params (role.id=07f29be2087e43caaf6845ecf113b6e7, scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55, user.id=8e416527de444ef1b744da062ee1e7f2) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:43.901207 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de424d-d94e-4c54-817f-a5cd7b754d95 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:43.903084 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de424d-d94e-4c54-817f-a5cd7b754d95 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:43.908240 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 186/371] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:23:43 2021] GET /identity/v3/role_assignments?user.id=8e416527de444ef1b744da062ee1e7f2&scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55&role.id=07f29be2087e43caaf6845ecf113b6e7 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:45.951671 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8e608-6eab-4a8c-9bf5-f354e945d942 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:45.952225 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8e608-6eab-4a8c-9bf5-f354e945d942 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:45.952225 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8e608-6eab-4a8c-9bf5-f354e945d942 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:45.953907 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 186/372] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:23:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:45.958969 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ec150-c9ab-4d5d-b838-50cbb79a5e2b None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:45.959355 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ec150-c9ab-4d5d-b838-50cbb79a5e2b None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:45.959527 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ec150-c9ab-4d5d-b838-50cbb79a5e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:45.981990 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-449ec150-c9ab-4d5d-b838-50cbb79a5e2b None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:45.983120 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-449ec150-c9ab-4d5d-b838-50cbb79a5e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:45.989741 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 187/373] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:23:46.011526 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8e608-6eab-4a8c-9bf5-f354e945d942 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:46.024608 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8e608-6eab-4a8c-9bf5-f354e945d942 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:46.029067 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e86a7-3168-403d-bb39-19a17aad5dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:46.029772 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e86a7-3168-403d-bb39-19a17aad5dae admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:46.030057 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e86a7-3168-403d-bb39-19a17aad5dae admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:46.030336 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e86a7-3168-403d-bb39-19a17aad5dae admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:46.041249 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e86a7-3168-403d-bb39-19a17aad5dae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:23:46.048063 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-de3e86a7-3168-403d-bb39-19a17aad5dae admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:23:46.049154 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 187/374] 10.222.0.64 () {56 vars in 1123 bytes} [Thu Dec 16 14:23:46 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:46.054753 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ec150-c9ab-4d5d-b838-50cbb79a5e2b None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:46.063408 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ec150-c9ab-4d5d-b838-50cbb79a5e2b None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:46.067544 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3fb649-ada7-44dc-aff2-28edbee6efca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:46.068137 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fb649-ada7-44dc-aff2-28edbee6efca admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:46.068428 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fb649-ada7-44dc-aff2-28edbee6efca admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:46.068709 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fb649-ada7-44dc-aff2-28edbee6efca admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:46.069700 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3fb649-ada7-44dc-aff2-28edbee6efca admin admin] RBAC: Adding query filter params (name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:46.070033 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3fb649-ada7-44dc-aff2-28edbee6efca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:46.071618 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3fb649-ada7-44dc-aff2-28edbee6efca admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:46.079844 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 188/375] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Dec 16 14:23:46 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:46.085033 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e86a7-3168-403d-bb39-19a17aad5dae admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:46.095071 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e86a7-3168-403d-bb39-19a17aad5dae admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:46.099131 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5641820-819d-49b6-864c-4c52644d6ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:46.099831 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5641820-819d-49b6-864c-4c52644d6ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:46.100123 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5641820-819d-49b6-864c-4c52644d6ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:46.100407 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5641820-819d-49b6-864c-4c52644d6ae7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:46.112202 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5641820-819d-49b6-864c-4c52644d6ae7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:46.113976 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5641820-819d-49b6-864c-4c52644d6ae7 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:46.130674 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-d5641820-819d-49b6-864c-4c52644d6ae7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:46.131729 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 188/376] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:23:46.137104 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3fb649-ada7-44dc-aff2-28edbee6efca admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:46.146275 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3fb649-ada7-44dc-aff2-28edbee6efca admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:46.150348 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5986904-393c-430d-8dc7-140d993b2eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:46.150930 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5986904-393c-430d-8dc7-140d993b2eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:46.151228 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5986904-393c-430d-8dc7-140d993b2eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:46.151507 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5986904-393c-430d-8dc7-140d993b2eb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:46.152685 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5986904-393c-430d-8dc7-140d993b2eb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:46.153028 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5986904-393c-430d-8dc7-140d993b2eb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:46.154606 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5986904-393c-430d-8dc7-140d993b2eb4 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:46.166790 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 189/377] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:46.172654 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5641820-819d-49b6-864c-4c52644d6ae7 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:46.181800 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5641820-819d-49b6-864c-4c52644d6ae7 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:46.186086 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ae17b-c3a8-4ce6-a76e-ebef2651fbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:46.186802 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ae17b-c3a8-4ce6-a76e-ebef2651fbdb admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:46.187092 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ae17b-c3a8-4ce6-a76e-ebef2651fbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:46.187376 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ae17b-c3a8-4ce6-a76e-ebef2651fbdb admin admin] PATH_INFO: `/v3/users/nova` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:46.200651 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ae17b-c3a8-4ce6-a76e-ebef2651fbdb admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:46.202663 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ae17b-c3a8-4ce6-a76e-ebef2651fbdb admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:46.220532 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-4b9ae17b-c3a8-4ce6-a76e-ebef2651fbdb admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 16 14:23:46.221630 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 189/378] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Dec 16 14:23:46 2021] GET /identity/v3/users/nova => generated 82 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:46.231287 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5986904-393c-430d-8dc7-140d993b2eb4 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:46.240555 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5986904-393c-430d-8dc7-140d993b2eb4 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:46.244618 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85dced8-9fec-4693-b881-eea80042fdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:46.245239 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dced8-9fec-4693-b881-eea80042fdcd admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:46.245521 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dced8-9fec-4693-b881-eea80042fdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:46.245798 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dced8-9fec-4693-b881-eea80042fdcd admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:46.246576 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85dced8-9fec-4693-b881-eea80042fdcd admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:46.246873 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85dced8-9fec-4693-b881-eea80042fdcd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:46.248697 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85dced8-9fec-4693-b881-eea80042fdcd admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:46.277658 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 190/379] 10.222.0.64 () {56 vars in 1154 bytes} [Thu Dec 16 14:23:46 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:46.283223 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ae17b-c3a8-4ce6-a76e-ebef2651fbdb admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:46.292470 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ae17b-c3a8-4ce6-a76e-ebef2651fbdb admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:46.296516 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96616f-9a49-4fc7-a10f-c5e417d46fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:46.297252 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96616f-9a49-4fc7-a10f-c5e417d46fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:46.297541 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96616f-9a49-4fc7-a10f-c5e417d46fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:46.297823 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96616f-9a49-4fc7-a10f-c5e417d46fe7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:46.309406 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96616f-9a49-4fc7-a10f-c5e417d46fe7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:46.311203 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96616f-9a49-4fc7-a10f-c5e417d46fe7 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:46.328287 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-3b96616f-9a49-4fc7-a10f-c5e417d46fe7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:46.329373 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 190/380] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:46.334759 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85dced8-9fec-4693-b881-eea80042fdcd admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:46.344628 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85dced8-9fec-4693-b881-eea80042fdcd admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:46.348670 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ca029-6aef-4a35-9333-207622ed83df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:46.349299 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ca029-6aef-4a35-9333-207622ed83df admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:46.349589 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ca029-6aef-4a35-9333-207622ed83df admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:46.349870 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ca029-6aef-4a35-9333-207622ed83df admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:46.350557 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ca029-6aef-4a35-9333-207622ed83df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:46.350856 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ca029-6aef-4a35-9333-207622ed83df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:46.352432 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ca029-6aef-4a35-9333-207622ed83df admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:46.364163 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 191/381] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:46.369382 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96616f-9a49-4fc7-a10f-c5e417d46fe7 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:46.379300 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96616f-9a49-4fc7-a10f-c5e417d46fe7 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:46.383423 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db2e9d-dec1-4fcf-b97b-477b36c5c5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:46.384132 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db2e9d-dec1-4fcf-b97b-477b36c5c5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:46.384422 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db2e9d-dec1-4fcf-b97b-477b36c5c5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:46.384706 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db2e9d-dec1-4fcf-b97b-477b36c5c5c8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:46.393675 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db2e9d-dec1-4fcf-b97b-477b36c5c5c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:46.395623 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db2e9d-dec1-4fcf-b97b-477b36c5c5c8 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:46.409602 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-d3db2e9d-dec1-4fcf-b97b-477b36c5c5c8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:23:46.410647 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 191/382] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:23:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:46.416105 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ca029-6aef-4a35-9333-207622ed83df admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:46.425183 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ca029-6aef-4a35-9333-207622ed83df admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:46.429238 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cf67b-1f92-40d5-9f2b-6ea8061d772a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:46.429811 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cf67b-1f92-40d5-9f2b-6ea8061d772a admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:46.430097 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cf67b-1f92-40d5-9f2b-6ea8061d772a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:46.430376 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cf67b-1f92-40d5-9f2b-6ea8061d772a admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:46.431105 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3cf67b-1f92-40d5-9f2b-6ea8061d772a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:46.431402 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3cf67b-1f92-40d5-9f2b-6ea8061d772a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:46.432398 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING py.warnings [None req-cb3cf67b-1f92-40d5-9f2b-6ea8061d772a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:23:46.432398 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: warnings.warn(msg) Dec 16 14:23:46.432398 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: Dec 16 14:23:46.433536 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3cf67b-1f92-40d5-9f2b-6ea8061d772a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:46.446039 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 192/383] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:23:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:46.451861 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db2e9d-dec1-4fcf-b97b-477b36c5c5c8 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:46.460921 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db2e9d-dec1-4fcf-b97b-477b36c5c5c8 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:46.465621 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391bf4f-8443-4baa-a1c7-5e4c07a9b1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:46.466414 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391bf4f-8443-4baa-a1c7-5e4c07a9b1b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:46.466706 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391bf4f-8443-4baa-a1c7-5e4c07a9b1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:46.466993 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391bf4f-8443-4baa-a1c7-5e4c07a9b1b2 admin admin] PATH_INFO: `/v3/projects/244c8ef98d0445c6a0279c46d5cb7e55/users/8e416527de444ef1b744da062ee1e7f2/roles/07f29be2087e43caaf6845ecf113b6e7` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:46.486359 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391bf4f-8443-4baa-a1c7-5e4c07a9b1b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=244c8ef98d0445c6a0279c46d5cb7e55, user_id=8e416527de444ef1b744da062ee1e7f2, role_id=07f29be2087e43caaf6845ecf113b6e7)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:46.489006 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391bf4f-8443-4baa-a1c7-5e4c07a9b1b2 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:46.501108 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 192/384] 10.222.0.64 () {58 vars in 1460 bytes} [Thu Dec 16 14:23:46 2021] PUT /identity/v3/projects/244c8ef98d0445c6a0279c46d5cb7e55/users/8e416527de444ef1b744da062ee1e7f2/roles/07f29be2087e43caaf6845ecf113b6e7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:23:48.554825 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cb2e9-4743-4683-979d-062e77c4064e None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:48.555350 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cb2e9-4743-4683-979d-062e77c4064e None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:48.555433 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cb2e9-4743-4683-979d-062e77c4064e None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:48.557091 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 193/385] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:23:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:48.562380 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4258bd7-87f0-4e77-9494-bd6ceaa976a5 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:48.562753 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4258bd7-87f0-4e77-9494-bd6ceaa976a5 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:48.562976 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4258bd7-87f0-4e77-9494-bd6ceaa976a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:48.585411 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-d4258bd7-87f0-4e77-9494-bd6ceaa976a5 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:48.586552 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-d4258bd7-87f0-4e77-9494-bd6ceaa976a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:48.648830 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 193/386] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:23:48.672178 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cb2e9-4743-4683-979d-062e77c4064e None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:48.683891 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cb2e9-4743-4683-979d-062e77c4064e None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:48.687840 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf10fa-1f04-43b8-a90d-29790920f03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:48.688551 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf10fa-1f04-43b8-a90d-29790920f03b admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:48.688869 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf10fa-1f04-43b8-a90d-29790920f03b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:48.689156 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf10fa-1f04-43b8-a90d-29790920f03b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:48.701272 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf10fa-1f04-43b8-a90d-29790920f03b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:23:48.707621 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-1bdf10fa-1f04-43b8-a90d-29790920f03b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:23:48.708719 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 194/387] 10.222.0.64 () {56 vars in 1123 bytes} [Thu Dec 16 14:23:48 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:48.714988 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4258bd7-87f0-4e77-9494-bd6ceaa976a5 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:48.723466 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4258bd7-87f0-4e77-9494-bd6ceaa976a5 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:48.727609 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b6148-b5fe-41e6-8153-69e471c568d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:48.728195 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b6148-b5fe-41e6-8153-69e471c568d1 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:48.728480 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b6148-b5fe-41e6-8153-69e471c568d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:48.728762 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b6148-b5fe-41e6-8153-69e471c568d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:48.729533 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b6148-b5fe-41e6-8153-69e471c568d1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:48.729844 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b6148-b5fe-41e6-8153-69e471c568d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:48.731414 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b6148-b5fe-41e6-8153-69e471c568d1 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:48.739535 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 194/388] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Dec 16 14:23:48 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:48.744715 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf10fa-1f04-43b8-a90d-29790920f03b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:48.754232 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf10fa-1f04-43b8-a90d-29790920f03b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:48.758257 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b1833-d614-4630-81bd-67e2eefcb63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:48.758950 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b1833-d614-4630-81bd-67e2eefcb63a admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:48.759238 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b1833-d614-4630-81bd-67e2eefcb63a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:48.759515 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b1833-d614-4630-81bd-67e2eefcb63a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:48.770900 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b1833-d614-4630-81bd-67e2eefcb63a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:48.772704 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b1833-d614-4630-81bd-67e2eefcb63a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:48.789773 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-361b1833-d614-4630-81bd-67e2eefcb63a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:48.790801 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 195/389] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:48.795951 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b6148-b5fe-41e6-8153-69e471c568d1 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:48.805058 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b6148-b5fe-41e6-8153-69e471c568d1 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:48.809539 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa2f5c-f68a-4629-9eae-aadd081b9ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:48.810110 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa2f5c-f68a-4629-9eae-aadd081b9ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:48.810403 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa2f5c-f68a-4629-9eae-aadd081b9ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:48.810680 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa2f5c-f68a-4629-9eae-aadd081b9ca4 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:48.811359 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa2f5c-f68a-4629-9eae-aadd081b9ca4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:48.811658 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa2f5c-f68a-4629-9eae-aadd081b9ca4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:48.813267 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa2f5c-f68a-4629-9eae-aadd081b9ca4 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:48.826629 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 195/390] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:48.831925 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b1833-d614-4630-81bd-67e2eefcb63a admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:48.841274 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b1833-d614-4630-81bd-67e2eefcb63a admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:48.845433 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e90ea-b6e1-4e20-857e-41e87424f3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:48.846137 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e90ea-b6e1-4e20-857e-41e87424f3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:48.846430 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e90ea-b6e1-4e20-857e-41e87424f3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:48.846718 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e90ea-b6e1-4e20-857e-41e87424f3b3 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:48.859232 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e90ea-b6e1-4e20-857e-41e87424f3b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:48.861312 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e90ea-b6e1-4e20-857e-41e87424f3b3 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:48.879035 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-9a3e90ea-b6e1-4e20-857e-41e87424f3b3 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 16 14:23:48.880119 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 196/391] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Dec 16 14:23:48 2021] GET /identity/v3/users/nova => generated 82 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:48.885753 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa2f5c-f68a-4629-9eae-aadd081b9ca4 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:48.896002 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa2f5c-f68a-4629-9eae-aadd081b9ca4 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:48.900122 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31330c2-877b-44be-b52c-ba2061d28af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:48.900715 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31330c2-877b-44be-b52c-ba2061d28af8 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:48.901033 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31330c2-877b-44be-b52c-ba2061d28af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:48.901317 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31330c2-877b-44be-b52c-ba2061d28af8 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:48.902187 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31330c2-877b-44be-b52c-ba2061d28af8 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:48.902483 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31330c2-877b-44be-b52c-ba2061d28af8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:48.903483 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING py.warnings [None req-e31330c2-877b-44be-b52c-ba2061d28af8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:23:48.903483 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: warnings.warn(msg) Dec 16 14:23:48.903483 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: Dec 16 14:23:48.904611 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31330c2-877b-44be-b52c-ba2061d28af8 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:48.934765 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 196/392] 10.222.0.64 () {56 vars in 1154 bytes} [Thu Dec 16 14:23:48 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:48.940297 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e90ea-b6e1-4e20-857e-41e87424f3b3 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:48.950502 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e90ea-b6e1-4e20-857e-41e87424f3b3 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:48.954548 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85673e45-43dd-4824-959d-76bde7185911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:48.955117 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85673e45-43dd-4824-959d-76bde7185911 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:48.955412 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85673e45-43dd-4824-959d-76bde7185911 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:48.955694 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85673e45-43dd-4824-959d-76bde7185911 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:48.963274 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85673e45-43dd-4824-959d-76bde7185911 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:48.965052 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85673e45-43dd-4824-959d-76bde7185911 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:48.974659 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 197/393] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:23:48 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:23:48.979994 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31330c2-877b-44be-b52c-ba2061d28af8 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:48.989062 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31330c2-877b-44be-b52c-ba2061d28af8 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:48.993080 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c4eea-8f16-45cc-bb99-24f14de2ade2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:48.993779 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c4eea-8f16-45cc-bb99-24f14de2ade2 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:48.994065 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c4eea-8f16-45cc-bb99-24f14de2ade2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:48.994344 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c4eea-8f16-45cc-bb99-24f14de2ade2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:49.006151 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c4eea-8f16-45cc-bb99-24f14de2ade2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:49.007952 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c4eea-8f16-45cc-bb99-24f14de2ade2 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:49.024739 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-026c4eea-8f16-45cc-bb99-24f14de2ade2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:49.025797 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 197/394] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:49.031082 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85673e45-43dd-4824-959d-76bde7185911 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:49.039527 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85673e45-43dd-4824-959d-76bde7185911 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:49.043741 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d3524-831e-4bb8-a19c-bd5297ebe4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:49.044322 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d3524-831e-4bb8-a19c-bd5297ebe4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:49.044611 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d3524-831e-4bb8-a19c-bd5297ebe4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:49.044922 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d3524-831e-4bb8-a19c-bd5297ebe4e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:49.045610 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d3524-831e-4bb8-a19c-bd5297ebe4e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:49.045906 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d3524-831e-4bb8-a19c-bd5297ebe4e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:49.047468 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d3524-831e-4bb8-a19c-bd5297ebe4e2 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:49.062374 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 198/395] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:49.067685 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c4eea-8f16-45cc-bb99-24f14de2ade2 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:49.079000 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c4eea-8f16-45cc-bb99-24f14de2ade2 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:49.083003 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ab6f9-f313-4eb5-b89a-e644e7b93a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:49.083705 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ab6f9-f313-4eb5-b89a-e644e7b93a3e admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:49.083995 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ab6f9-f313-4eb5-b89a-e644e7b93a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:49.084277 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ab6f9-f313-4eb5-b89a-e644e7b93a3e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:49.092578 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ab6f9-f313-4eb5-b89a-e644e7b93a3e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:49.094555 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ab6f9-f313-4eb5-b89a-e644e7b93a3e admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:49.107817 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-897ab6f9-f313-4eb5-b89a-e644e7b93a3e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:23:49.108872 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 198/396] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:23:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:49.114305 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d3524-831e-4bb8-a19c-bd5297ebe4e2 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:49.124550 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d3524-831e-4bb8-a19c-bd5297ebe4e2 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:49.128741 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1e33c-8a31-4d25-a49f-228fbd0838c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:49.129375 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1e33c-8a31-4d25-a49f-228fbd0838c8 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:49.129670 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1e33c-8a31-4d25-a49f-228fbd0838c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:49.129957 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1e33c-8a31-4d25-a49f-228fbd0838c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:49.130704 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1e33c-8a31-4d25-a49f-228fbd0838c8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:49.131053 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1e33c-8a31-4d25-a49f-228fbd0838c8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:49.132895 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1e33c-8a31-4d25-a49f-228fbd0838c8 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:49.146419 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 199/397] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:23:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:49.152477 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ab6f9-f313-4eb5-b89a-e644e7b93a3e admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:49.161727 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ab6f9-f313-4eb5-b89a-e644e7b93a3e admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:49.165792 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7caf8-4ea8-406c-a679-930eda515969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:49.166362 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7caf8-4ea8-406c-a679-930eda515969 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:49.166654 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7caf8-4ea8-406c-a679-930eda515969 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:49.166938 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7caf8-4ea8-406c-a679-930eda515969 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:49.168208 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7caf8-4ea8-406c-a679-930eda515969 admin admin] RBAC: Adding query filter params (role.id=07f29be2087e43caaf6845ecf113b6e7, scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55, user.id=8e416527de444ef1b744da062ee1e7f2) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:49.168509 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7caf8-4ea8-406c-a679-930eda515969 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:49.170368 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7caf8-4ea8-406c-a679-930eda515969 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:49.175890 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 199/398] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:23:49 2021] GET /identity/v3/role_assignments?user.id=8e416527de444ef1b744da062ee1e7f2&scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55&role.id=07f29be2087e43caaf6845ecf113b6e7 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:51.269662 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae6db5-1b15-4860-9c7a-4cec3d4a0136 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:51.270190 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae6db5-1b15-4860-9c7a-4cec3d4a0136 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:51.270190 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae6db5-1b15-4860-9c7a-4cec3d4a0136 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:51.272172 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 200/399] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:23:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:51.277834 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44b119-b8fa-47fc-b6d2-9ff3e612822e None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:51.278288 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44b119-b8fa-47fc-b6d2-9ff3e612822e None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:51.278410 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44b119-b8fa-47fc-b6d2-9ff3e612822e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:51.300031 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-fe44b119-b8fa-47fc-b6d2-9ff3e612822e None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:51.301221 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-fe44b119-b8fa-47fc-b6d2-9ff3e612822e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:51.308518 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 200/400] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:51.331537 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae6db5-1b15-4860-9c7a-4cec3d4a0136 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:51.343157 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae6db5-1b15-4860-9c7a-4cec3d4a0136 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:51.347141 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c859018-40f7-42a1-bedf-7919f6d41b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:51.347849 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c859018-40f7-42a1-bedf-7919f6d41b23 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:51.348137 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c859018-40f7-42a1-bedf-7919f6d41b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:51.348421 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c859018-40f7-42a1-bedf-7919f6d41b23 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:51.359419 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c859018-40f7-42a1-bedf-7919f6d41b23 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:23:51.365681 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-3c859018-40f7-42a1-bedf-7919f6d41b23 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:23:51.366744 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 201/401] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:23:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:51.372735 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44b119-b8fa-47fc-b6d2-9ff3e612822e None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:51.381888 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44b119-b8fa-47fc-b6d2-9ff3e612822e None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:51.386619 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cde47-2721-440e-bdf1-bec898dfef9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:51.387205 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cde47-2721-440e-bdf1-bec898dfef9b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:51.387497 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cde47-2721-440e-bdf1-bec898dfef9b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:51.387784 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cde47-2721-440e-bdf1-bec898dfef9b admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:51.388491 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241cde47-2721-440e-bdf1-bec898dfef9b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:51.388811 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241cde47-2721-440e-bdf1-bec898dfef9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:51.390383 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241cde47-2721-440e-bdf1-bec898dfef9b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:51.398786 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 201/402] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:23:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:51.404092 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c859018-40f7-42a1-bedf-7919f6d41b23 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:51.413639 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c859018-40f7-42a1-bedf-7919f6d41b23 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:51.418133 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb6d3f-6ce7-4572-b097-0e2c0349a5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:51.418829 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb6d3f-6ce7-4572-b097-0e2c0349a5eb admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:51.419112 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb6d3f-6ce7-4572-b097-0e2c0349a5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:51.419387 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb6d3f-6ce7-4572-b097-0e2c0349a5eb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:51.430248 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb6d3f-6ce7-4572-b097-0e2c0349a5eb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:51.432062 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb6d3f-6ce7-4572-b097-0e2c0349a5eb admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:51.450502 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-1beb6d3f-6ce7-4572-b097-0e2c0349a5eb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:51.451533 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 202/403] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:51.456730 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cde47-2721-440e-bdf1-bec898dfef9b admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:51.465853 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cde47-2721-440e-bdf1-bec898dfef9b admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:51.469946 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cbd76e-55d9-4a20-9da0-bc4173bb9850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:51.470523 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbd76e-55d9-4a20-9da0-bc4173bb9850 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:51.470814 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbd76e-55d9-4a20-9da0-bc4173bb9850 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:51.471099 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbd76e-55d9-4a20-9da0-bc4173bb9850 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:51.471777 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cbd76e-55d9-4a20-9da0-bc4173bb9850 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:51.472080 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cbd76e-55d9-4a20-9da0-bc4173bb9850 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:51.473670 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cbd76e-55d9-4a20-9da0-bc4173bb9850 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:51.486258 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 202/404] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:51.491270 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb6d3f-6ce7-4572-b097-0e2c0349a5eb admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:51.501052 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb6d3f-6ce7-4572-b097-0e2c0349a5eb admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:51.505117 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62158a7-3b22-487c-8a74-0802907300e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:51.505813 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62158a7-3b22-487c-8a74-0802907300e3 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:51.506101 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62158a7-3b22-487c-8a74-0802907300e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:51.506385 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62158a7-3b22-487c-8a74-0802907300e3 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:51.518690 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62158a7-3b22-487c-8a74-0802907300e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:51.520766 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62158a7-3b22-487c-8a74-0802907300e3 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:51.537826 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-e62158a7-3b22-487c-8a74-0802907300e3 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 16 14:23:51.538871 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 203/405] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Dec 16 14:23:51 2021] GET /identity/v3/users/nova => generated 82 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:51.544655 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cbd76e-55d9-4a20-9da0-bc4173bb9850 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:51.553693 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cbd76e-55d9-4a20-9da0-bc4173bb9850 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:51.558334 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59eb1a-eee8-4dc4-b567-2db6fda09d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:51.558912 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59eb1a-eee8-4dc4-b567-2db6fda09d7e admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:51.559196 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59eb1a-eee8-4dc4-b567-2db6fda09d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:51.559473 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59eb1a-eee8-4dc4-b567-2db6fda09d7e admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:51.560242 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59eb1a-eee8-4dc4-b567-2db6fda09d7e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:51.560532 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59eb1a-eee8-4dc4-b567-2db6fda09d7e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:51.562371 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59eb1a-eee8-4dc4-b567-2db6fda09d7e admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:51.589997 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 203/406] 10.222.0.64 () {56 vars in 1154 bytes} [Thu Dec 16 14:23:51 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:51.595468 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62158a7-3b22-487c-8a74-0802907300e3 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:51.605454 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62158a7-3b22-487c-8a74-0802907300e3 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:51.609485 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31296d90-ab13-4e54-a9da-70e3febf4057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:51.610056 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31296d90-ab13-4e54-a9da-70e3febf4057 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:51.610338 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31296d90-ab13-4e54-a9da-70e3febf4057 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:51.610619 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31296d90-ab13-4e54-a9da-70e3febf4057 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:51.618144 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31296d90-ab13-4e54-a9da-70e3febf4057 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:51.619859 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31296d90-ab13-4e54-a9da-70e3febf4057 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:51.628555 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 204/407] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:23:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:23:51.634019 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59eb1a-eee8-4dc4-b567-2db6fda09d7e admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:51.643168 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59eb1a-eee8-4dc4-b567-2db6fda09d7e admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:51.647211 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da3de4-d212-4b23-8ebe-fe4218eb923b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:51.647916 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da3de4-d212-4b23-8ebe-fe4218eb923b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:51.648203 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da3de4-d212-4b23-8ebe-fe4218eb923b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:51.648484 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da3de4-d212-4b23-8ebe-fe4218eb923b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:51.659732 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da3de4-d212-4b23-8ebe-fe4218eb923b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:51.661579 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da3de4-d212-4b23-8ebe-fe4218eb923b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:51.678310 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-30da3de4-d212-4b23-8ebe-fe4218eb923b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:51.679374 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 204/408] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:51.685741 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31296d90-ab13-4e54-a9da-70e3febf4057 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:51.694530 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31296d90-ab13-4e54-a9da-70e3febf4057 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:51.699436 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293b658-f562-4e32-b5b6-4cb480f116de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:51.700161 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293b658-f562-4e32-b5b6-4cb480f116de admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:51.700506 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293b658-f562-4e32-b5b6-4cb480f116de admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:51.700880 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293b658-f562-4e32-b5b6-4cb480f116de admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:51.701757 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293b658-f562-4e32-b5b6-4cb480f116de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:51.702077 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293b658-f562-4e32-b5b6-4cb480f116de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:51.703960 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293b658-f562-4e32-b5b6-4cb480f116de admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:51.717129 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 205/409] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:51.722445 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da3de4-d212-4b23-8ebe-fe4218eb923b admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:51.731551 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da3de4-d212-4b23-8ebe-fe4218eb923b admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:51.735802 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2bf6b-a27f-43e7-802e-59e910d10fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:51.736509 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2bf6b-a27f-43e7-802e-59e910d10fcf admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:51.736829 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2bf6b-a27f-43e7-802e-59e910d10fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:51.737114 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2bf6b-a27f-43e7-802e-59e910d10fcf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:51.745368 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2bf6b-a27f-43e7-802e-59e910d10fcf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:51.747286 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2bf6b-a27f-43e7-802e-59e910d10fcf admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:51.760268 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-f2d2bf6b-a27f-43e7-802e-59e910d10fcf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:23:51.761827 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 205/410] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:23:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:51.767231 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293b658-f562-4e32-b5b6-4cb480f116de admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:51.777326 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293b658-f562-4e32-b5b6-4cb480f116de admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:51.781340 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d42b54-427d-437b-9416-98644f1e2727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:51.781919 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d42b54-427d-437b-9416-98644f1e2727 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:51.782207 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d42b54-427d-437b-9416-98644f1e2727 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:51.782496 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d42b54-427d-437b-9416-98644f1e2727 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:51.783234 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d42b54-427d-437b-9416-98644f1e2727 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:51.783534 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d42b54-427d-437b-9416-98644f1e2727 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:51.785396 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d42b54-427d-437b-9416-98644f1e2727 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:51.797770 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 206/411] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:23:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:51.803573 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2bf6b-a27f-43e7-802e-59e910d10fcf admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:51.813361 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2bf6b-a27f-43e7-802e-59e910d10fcf admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:51.817453 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7500d98-dbbe-4b18-9bca-c7cb60b8d3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:51.818104 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7500d98-dbbe-4b18-9bca-c7cb60b8d3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:51.818301 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7500d98-dbbe-4b18-9bca-c7cb60b8d3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:51.818578 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7500d98-dbbe-4b18-9bca-c7cb60b8d3e9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:51.819598 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7500d98-dbbe-4b18-9bca-c7cb60b8d3e9 admin admin] RBAC: Adding query filter params (role.id=90166eb3dcfa41e58450e140b8b0fea3, scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55, user.id=8e416527de444ef1b744da062ee1e7f2) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:51.819897 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7500d98-dbbe-4b18-9bca-c7cb60b8d3e9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:51.821737 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7500d98-dbbe-4b18-9bca-c7cb60b8d3e9 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:51.827558 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 206/412] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:23:51 2021] GET /identity/v3/role_assignments?user.id=8e416527de444ef1b744da062ee1e7f2&scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55&role.id=90166eb3dcfa41e58450e140b8b0fea3 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:23:53.832915 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9de196-22fe-44a8-b1ef-2658473be29d None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:53.833441 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9de196-22fe-44a8-b1ef-2658473be29d None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:53.833531 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9de196-22fe-44a8-b1ef-2658473be29d None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:53.835142 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 207/413] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:23:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:53.840978 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4bad8-f4cc-4119-b9f9-f5fa6bbca107 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:53.841382 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4bad8-f4cc-4119-b9f9-f5fa6bbca107 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:53.841684 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4bad8-f4cc-4119-b9f9-f5fa6bbca107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:53.863574 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-2cf4bad8-f4cc-4119-b9f9-f5fa6bbca107 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:53.864712 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-2cf4bad8-f4cc-4119-b9f9-f5fa6bbca107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:53.871634 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 207/414] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:53.893676 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9de196-22fe-44a8-b1ef-2658473be29d None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:53.905943 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9de196-22fe-44a8-b1ef-2658473be29d None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:53.909838 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b84087-d587-48f0-98d1-5d0238e96bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:53.910542 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b84087-d587-48f0-98d1-5d0238e96bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:53.910823 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b84087-d587-48f0-98d1-5d0238e96bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:53.911103 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b84087-d587-48f0-98d1-5d0238e96bf7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:53.921992 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b84087-d587-48f0-98d1-5d0238e96bf7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:23:53.928141 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-29b84087-d587-48f0-98d1-5d0238e96bf7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:23:53.929227 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 208/415] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:23:53 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:53.934707 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4bad8-f4cc-4119-b9f9-f5fa6bbca107 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:53.943180 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4bad8-f4cc-4119-b9f9-f5fa6bbca107 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:53.947543 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4ec08-3b6d-46a5-b2f2-64674f733793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:53.948622 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4ec08-3b6d-46a5-b2f2-64674f733793 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:53.948950 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4ec08-3b6d-46a5-b2f2-64674f733793 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:53.949234 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4ec08-3b6d-46a5-b2f2-64674f733793 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:53.949941 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4ec08-3b6d-46a5-b2f2-64674f733793 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:53.950242 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4ec08-3b6d-46a5-b2f2-64674f733793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:53.951801 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4ec08-3b6d-46a5-b2f2-64674f733793 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:53.960111 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 208/416] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:23:53 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:53.965922 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b84087-d587-48f0-98d1-5d0238e96bf7 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:53.975339 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b84087-d587-48f0-98d1-5d0238e96bf7 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:53.979515 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53d5dc-9d14-4989-87d1-ad9f148d8c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:53.980206 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53d5dc-9d14-4989-87d1-ad9f148d8c0e admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:53.980485 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53d5dc-9d14-4989-87d1-ad9f148d8c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:53.980766 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53d5dc-9d14-4989-87d1-ad9f148d8c0e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:53.991576 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53d5dc-9d14-4989-87d1-ad9f148d8c0e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:53.993432 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53d5dc-9d14-4989-87d1-ad9f148d8c0e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:54.009841 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-6f53d5dc-9d14-4989-87d1-ad9f148d8c0e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:54.011383 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 209/417] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:54.016594 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4ec08-3b6d-46a5-b2f2-64674f733793 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:54.025873 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4ec08-3b6d-46a5-b2f2-64674f733793 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:54.030662 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a1878-8390-49fe-af4f-b3bf55aa021c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:54.031238 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a1878-8390-49fe-af4f-b3bf55aa021c admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:54.031528 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a1878-8390-49fe-af4f-b3bf55aa021c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:54.031812 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a1878-8390-49fe-af4f-b3bf55aa021c admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:54.032495 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a1878-8390-49fe-af4f-b3bf55aa021c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:54.032820 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a1878-8390-49fe-af4f-b3bf55aa021c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:54.034383 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a1878-8390-49fe-af4f-b3bf55aa021c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:54.046511 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 209/418] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:23:54.051504 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53d5dc-9d14-4989-87d1-ad9f148d8c0e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:54.061323 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53d5dc-9d14-4989-87d1-ad9f148d8c0e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:54.065472 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7673a-b550-4d32-a508-ea28a806cab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:54.066175 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7673a-b550-4d32-a508-ea28a806cab7 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:54.066457 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7673a-b550-4d32-a508-ea28a806cab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:54.066736 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7673a-b550-4d32-a508-ea28a806cab7 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:54.080450 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b7673a-b550-4d32-a508-ea28a806cab7 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:54.082501 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b7673a-b550-4d32-a508-ea28a806cab7 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:54.099514 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-09b7673a-b550-4d32-a508-ea28a806cab7 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 16 14:23:54.100505 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 210/419] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Dec 16 14:23:54 2021] GET /identity/v3/users/nova => generated 82 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:54.106064 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a1878-8390-49fe-af4f-b3bf55aa021c admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:54.115307 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a1878-8390-49fe-af4f-b3bf55aa021c admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:54.119405 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5ae9d-8ed8-4e75-8e1f-c1f506293de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:54.120531 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5ae9d-8ed8-4e75-8e1f-c1f506293de3 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:54.120850 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5ae9d-8ed8-4e75-8e1f-c1f506293de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:54.121138 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5ae9d-8ed8-4e75-8e1f-c1f506293de3 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:54.121946 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5ae9d-8ed8-4e75-8e1f-c1f506293de3 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:54.122248 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5ae9d-8ed8-4e75-8e1f-c1f506293de3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:54.124096 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5ae9d-8ed8-4e75-8e1f-c1f506293de3 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:54.153774 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 210/420] 10.222.0.64 () {56 vars in 1154 bytes} [Thu Dec 16 14:23:54 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:54.159091 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7673a-b550-4d32-a508-ea28a806cab7 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:54.168271 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7673a-b550-4d32-a508-ea28a806cab7 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:54.172326 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1323a26-d288-4f96-9aa2-f7d3f73977a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:54.173059 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1323a26-d288-4f96-9aa2-f7d3f73977a9 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:54.173352 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1323a26-d288-4f96-9aa2-f7d3f73977a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:54.173631 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1323a26-d288-4f96-9aa2-f7d3f73977a9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:54.185620 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1323a26-d288-4f96-9aa2-f7d3f73977a9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:54.187448 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1323a26-d288-4f96-9aa2-f7d3f73977a9 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:54.204542 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-d1323a26-d288-4f96-9aa2-f7d3f73977a9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:54.205621 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 211/421] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:54.210956 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5ae9d-8ed8-4e75-8e1f-c1f506293de3 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:54.220208 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5ae9d-8ed8-4e75-8e1f-c1f506293de3 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:54.224403 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8746a4-fe6e-4959-8de8-7e5d3cf375b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:54.225020 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8746a4-fe6e-4959-8de8-7e5d3cf375b3 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:54.225312 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8746a4-fe6e-4959-8de8-7e5d3cf375b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:54.225590 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8746a4-fe6e-4959-8de8-7e5d3cf375b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:54.226271 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8746a4-fe6e-4959-8de8-7e5d3cf375b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:54.226572 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8746a4-fe6e-4959-8de8-7e5d3cf375b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:54.228144 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8746a4-fe6e-4959-8de8-7e5d3cf375b3 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:54.239892 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 211/422] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:54.245599 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1323a26-d288-4f96-9aa2-f7d3f73977a9 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:54.254891 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1323a26-d288-4f96-9aa2-f7d3f73977a9 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:54.258919 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa4d4b-bc8e-407b-8694-b0f5fb32122a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:54.259627 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa4d4b-bc8e-407b-8694-b0f5fb32122a admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:54.259914 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa4d4b-bc8e-407b-8694-b0f5fb32122a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:54.260195 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa4d4b-bc8e-407b-8694-b0f5fb32122a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:54.269248 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa4d4b-bc8e-407b-8694-b0f5fb32122a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:54.271216 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa4d4b-bc8e-407b-8694-b0f5fb32122a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:54.284574 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-d0fa4d4b-bc8e-407b-8694-b0f5fb32122a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:23:54.285689 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 212/423] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:23:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:54.291747 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8746a4-fe6e-4959-8de8-7e5d3cf375b3 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:54.300954 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8746a4-fe6e-4959-8de8-7e5d3cf375b3 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:54.305024 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ccdfb-db20-4bb3-9773-29d3d332f171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:54.305598 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ccdfb-db20-4bb3-9773-29d3d332f171 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:54.305886 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ccdfb-db20-4bb3-9773-29d3d332f171 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:54.306167 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ccdfb-db20-4bb3-9773-29d3d332f171 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:54.306901 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ccdfb-db20-4bb3-9773-29d3d332f171 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:54.307201 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ccdfb-db20-4bb3-9773-29d3d332f171 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:54.309586 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ccdfb-db20-4bb3-9773-29d3d332f171 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:54.413708 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 212/424] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:23:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:54.419971 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa4d4b-bc8e-407b-8694-b0f5fb32122a admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:54.429221 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa4d4b-bc8e-407b-8694-b0f5fb32122a admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:54.433850 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9822c8-33da-4615-a623-ba13824e9310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:54.434650 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9822c8-33da-4615-a623-ba13824e9310 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:54.434938 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9822c8-33da-4615-a623-ba13824e9310 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:54.435221 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9822c8-33da-4615-a623-ba13824e9310 admin admin] PATH_INFO: `/v3/projects/244c8ef98d0445c6a0279c46d5cb7e55/users/8e416527de444ef1b744da062ee1e7f2/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:54.437015 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9822c8-33da-4615-a623-ba13824e9310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=244c8ef98d0445c6a0279c46d5cb7e55, user_id=8e416527de444ef1b744da062ee1e7f2, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:54.439624 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9822c8-33da-4615-a623-ba13824e9310 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:54.451931 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 213/425] 10.222.0.64 () {58 vars in 1460 bytes} [Thu Dec 16 14:23:54 2021] PUT /identity/v3/projects/244c8ef98d0445c6a0279c46d5cb7e55/users/8e416527de444ef1b744da062ee1e7f2/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:23:56.488595 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb229ad9-17d5-4e40-8929-7a5adf08515d None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:56.489191 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb229ad9-17d5-4e40-8929-7a5adf08515d None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:56.489389 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb229ad9-17d5-4e40-8929-7a5adf08515d None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:56.491713 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 213/426] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:23:56 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:56.497400 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f1c01-5fa5-4d0d-a478-aa87ea6c894a None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:56.497853 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f1c01-5fa5-4d0d-a478-aa87ea6c894a None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:56.498242 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f1c01-5fa5-4d0d-a478-aa87ea6c894a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:56.524133 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-b24f1c01-5fa5-4d0d-a478-aa87ea6c894a None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:56.525304 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-b24f1c01-5fa5-4d0d-a478-aa87ea6c894a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:56.587715 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 214/427] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:56.611262 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb229ad9-17d5-4e40-8929-7a5adf08515d None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:56.622854 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb229ad9-17d5-4e40-8929-7a5adf08515d None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:56.626795 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b354c0-5cc2-4eeb-8058-9c4594db519e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:56.627493 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b354c0-5cc2-4eeb-8058-9c4594db519e admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:56.627781 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b354c0-5cc2-4eeb-8058-9c4594db519e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:56.628064 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b354c0-5cc2-4eeb-8058-9c4594db519e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:56.639276 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b354c0-5cc2-4eeb-8058-9c4594db519e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:23:56.645483 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-53b354c0-5cc2-4eeb-8058-9c4594db519e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:23:56.646552 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 214/428] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:23:56 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:56.652614 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f1c01-5fa5-4d0d-a478-aa87ea6c894a None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:56.661213 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f1c01-5fa5-4d0d-a478-aa87ea6c894a None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:56.665472 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d3bdf-fdc1-4872-ae56-c01ca605639c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:56.666057 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d3bdf-fdc1-4872-ae56-c01ca605639c admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:56.666513 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d3bdf-fdc1-4872-ae56-c01ca605639c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:56.667331 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d3bdf-fdc1-4872-ae56-c01ca605639c admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:56.668045 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d3bdf-fdc1-4872-ae56-c01ca605639c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:56.668344 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d3bdf-fdc1-4872-ae56-c01ca605639c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:56.669969 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d3bdf-fdc1-4872-ae56-c01ca605639c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:56.679123 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 215/429] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:23:56 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:56.684505 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b354c0-5cc2-4eeb-8058-9c4594db519e admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:56.693922 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b354c0-5cc2-4eeb-8058-9c4594db519e admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:56.698610 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e503332-ad92-4d5a-97a5-57120ce91e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:56.699314 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e503332-ad92-4d5a-97a5-57120ce91e5d admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:56.699600 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e503332-ad92-4d5a-97a5-57120ce91e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:56.699947 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e503332-ad92-4d5a-97a5-57120ce91e5d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:56.711446 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e503332-ad92-4d5a-97a5-57120ce91e5d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:56.713346 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e503332-ad92-4d5a-97a5-57120ce91e5d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:56.730968 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-1e503332-ad92-4d5a-97a5-57120ce91e5d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:56.732048 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 215/430] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:56.737601 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d3bdf-fdc1-4872-ae56-c01ca605639c admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:56.747568 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d3bdf-fdc1-4872-ae56-c01ca605639c admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:56.751640 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fa535-a307-4686-891a-a32aadb0984a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:56.752226 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fa535-a307-4686-891a-a32aadb0984a admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:56.752514 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fa535-a307-4686-891a-a32aadb0984a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:56.752820 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fa535-a307-4686-891a-a32aadb0984a admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:56.753513 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fa535-a307-4686-891a-a32aadb0984a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:56.753819 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fa535-a307-4686-891a-a32aadb0984a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:56.755420 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fa535-a307-4686-891a-a32aadb0984a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:56.768939 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 216/431] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:56.774014 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e503332-ad92-4d5a-97a5-57120ce91e5d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:56.787603 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e503332-ad92-4d5a-97a5-57120ce91e5d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:56.792347 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037bc87-e27e-4c1a-95eb-e6c1301d3027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:56.793071 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037bc87-e27e-4c1a-95eb-e6c1301d3027 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:56.793359 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037bc87-e27e-4c1a-95eb-e6c1301d3027 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:56.793640 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037bc87-e27e-4c1a-95eb-e6c1301d3027 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:56.805739 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037bc87-e27e-4c1a-95eb-e6c1301d3027 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:56.808622 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037bc87-e27e-4c1a-95eb-e6c1301d3027 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:56.831366 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-0037bc87-e27e-4c1a-95eb-e6c1301d3027 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 16 14:23:56.832425 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 216/432] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Dec 16 14:23:56 2021] GET /identity/v3/users/nova => generated 82 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:56.837833 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fa535-a307-4686-891a-a32aadb0984a admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:56.847409 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fa535-a307-4686-891a-a32aadb0984a admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:56.851489 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263021d2-6165-4d00-93e2-13ec08f78b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:56.852114 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263021d2-6165-4d00-93e2-13ec08f78b0a admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:56.852405 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263021d2-6165-4d00-93e2-13ec08f78b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:56.852687 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263021d2-6165-4d00-93e2-13ec08f78b0a admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:56.853509 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263021d2-6165-4d00-93e2-13ec08f78b0a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:56.853812 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263021d2-6165-4d00-93e2-13ec08f78b0a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:56.856170 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263021d2-6165-4d00-93e2-13ec08f78b0a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:56.976497 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 217/433] 10.222.0.64 () {56 vars in 1154 bytes} [Thu Dec 16 14:23:56 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:56.982595 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037bc87-e27e-4c1a-95eb-e6c1301d3027 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:56.991811 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037bc87-e27e-4c1a-95eb-e6c1301d3027 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:56.996547 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1876e5-d198-4c18-beed-9411f736209d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:56.997152 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1876e5-d198-4c18-beed-9411f736209d admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:56.997445 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1876e5-d198-4c18-beed-9411f736209d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:56.997775 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1876e5-d198-4c18-beed-9411f736209d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:57.005242 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1876e5-d198-4c18-beed-9411f736209d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:57.006970 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1876e5-d198-4c18-beed-9411f736209d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:57.015668 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 217/434] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:23:56 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:23:57.020949 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263021d2-6165-4d00-93e2-13ec08f78b0a admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:57.030193 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263021d2-6165-4d00-93e2-13ec08f78b0a admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:57.034342 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9ad13-609e-4d2d-a951-c0c8cf4ab832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:57.035059 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9ad13-609e-4d2d-a951-c0c8cf4ab832 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:57.035348 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9ad13-609e-4d2d-a951-c0c8cf4ab832 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:57.035630 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9ad13-609e-4d2d-a951-c0c8cf4ab832 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:57.047555 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da9ad13-609e-4d2d-a951-c0c8cf4ab832 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:57.049666 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da9ad13-609e-4d2d-a951-c0c8cf4ab832 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:57.066546 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-8da9ad13-609e-4d2d-a951-c0c8cf4ab832 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:57.067605 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 218/435] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:57.073284 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1876e5-d198-4c18-beed-9411f736209d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:57.081749 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1876e5-d198-4c18-beed-9411f736209d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:57.086337 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28280db7-24a3-4ad6-ac03-ff95195d8d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:57.086912 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28280db7-24a3-4ad6-ac03-ff95195d8d58 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:57.087206 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28280db7-24a3-4ad6-ac03-ff95195d8d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:57.087493 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28280db7-24a3-4ad6-ac03-ff95195d8d58 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:57.088186 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28280db7-24a3-4ad6-ac03-ff95195d8d58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:57.089012 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28280db7-24a3-4ad6-ac03-ff95195d8d58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:57.090573 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28280db7-24a3-4ad6-ac03-ff95195d8d58 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:57.102353 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 218/436] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:23:57.108093 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9ad13-609e-4d2d-a951-c0c8cf4ab832 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:57.117272 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9ad13-609e-4d2d-a951-c0c8cf4ab832 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:57.121272 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee78e5-bbae-4c89-a976-47380fbbc0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:57.121983 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee78e5-bbae-4c89-a976-47380fbbc0af admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:57.122272 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee78e5-bbae-4c89-a976-47380fbbc0af admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:57.122553 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee78e5-bbae-4c89-a976-47380fbbc0af admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:57.130801 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee78e5-bbae-4c89-a976-47380fbbc0af admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:57.132759 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee78e5-bbae-4c89-a976-47380fbbc0af admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:57.146116 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-f9ee78e5-bbae-4c89-a976-47380fbbc0af admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:23:57.147175 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 219/437] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:23:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:57.153301 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28280db7-24a3-4ad6-ac03-ff95195d8d58 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:57.162464 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28280db7-24a3-4ad6-ac03-ff95195d8d58 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:57.166484 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f06b60-d6d1-49ab-b299-7c4218e491cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:57.167727 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f06b60-d6d1-49ab-b299-7c4218e491cc admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:57.168020 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f06b60-d6d1-49ab-b299-7c4218e491cc admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:57.168302 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f06b60-d6d1-49ab-b299-7c4218e491cc admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:57.169075 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f06b60-d6d1-49ab-b299-7c4218e491cc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:57.169379 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f06b60-d6d1-49ab-b299-7c4218e491cc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:57.171206 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f06b60-d6d1-49ab-b299-7c4218e491cc admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:57.183540 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 219/438] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:23:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:57.189219 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee78e5-bbae-4c89-a976-47380fbbc0af admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:57.198706 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee78e5-bbae-4c89-a976-47380fbbc0af admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:57.202769 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ec807-b06c-4db0-8b61-5afbeded2c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:57.203337 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ec807-b06c-4db0-8b61-5afbeded2c9d admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:57.203630 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ec807-b06c-4db0-8b61-5afbeded2c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:57.203914 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ec807-b06c-4db0-8b61-5afbeded2c9d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:57.204687 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ec807-b06c-4db0-8b61-5afbeded2c9d admin admin] RBAC: Adding query filter params (role.id=90166eb3dcfa41e58450e140b8b0fea3, scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55, user.id=8e416527de444ef1b744da062ee1e7f2) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:57.205023 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ec807-b06c-4db0-8b61-5afbeded2c9d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:57.206845 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ec807-b06c-4db0-8b61-5afbeded2c9d admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:57.212362 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 220/439] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:23:57 2021] GET /identity/v3/role_assignments?user.id=8e416527de444ef1b744da062ee1e7f2&scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55&role.id=90166eb3dcfa41e58450e140b8b0fea3 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:59.297357 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01458ffa-2da2-4fe0-8467-f780157b7737 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:59.297879 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01458ffa-2da2-4fe0-8467-f780157b7737 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:59.297962 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01458ffa-2da2-4fe0-8467-f780157b7737 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:59.299601 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 220/440] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:23:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:59.304983 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a14e8-0cb1-46cf-a9d0-4cd4224f68b6 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:59.305439 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a14e8-0cb1-46cf-a9d0-4cd4224f68b6 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:59.305541 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a14e8-0cb1-46cf-a9d0-4cd4224f68b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:59.328739 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-823a14e8-0cb1-46cf-a9d0-4cd4224f68b6 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:59.329918 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-823a14e8-0cb1-46cf-a9d0-4cd4224f68b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:59.336688 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 221/441] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:23:59.358047 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01458ffa-2da2-4fe0-8467-f780157b7737 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:59.370494 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01458ffa-2da2-4fe0-8467-f780157b7737 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:59.375091 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3216063-696d-46e9-8ead-fc474e3944e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:59.375828 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3216063-696d-46e9-8ead-fc474e3944e0 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:59.376159 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3216063-696d-46e9-8ead-fc474e3944e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:59.376480 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3216063-696d-46e9-8ead-fc474e3944e0 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:59.377344 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3216063-696d-46e9-8ead-fc474e3944e0 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:59.378644 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING py.warnings [None req-e3216063-696d-46e9-8ead-fc474e3944e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:23:59.378644 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: warnings.warn(msg) Dec 16 14:23:59.378644 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: Dec 16 14:23:59.379555 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3216063-696d-46e9-8ead-fc474e3944e0 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:59.391760 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-e3216063-696d-46e9-8ead-fc474e3944e0 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 16 14:23:59.396825 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 221/442] 10.222.0.64 () {56 vars in 1153 bytes} [Thu Dec 16 14:23:59 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:59.398776 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a14e8-0cb1-46cf-a9d0-4cd4224f68b6 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:59.407691 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a14e8-0cb1-46cf-a9d0-4cd4224f68b6 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:59.412191 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c5c60-e452-46e5-9966-ad94b4391917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:59.412816 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c5c60-e452-46e5-9966-ad94b4391917 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:59.413175 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c5c60-e452-46e5-9966-ad94b4391917 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:59.413462 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c5c60-e452-46e5-9966-ad94b4391917 admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:59.414143 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c5c60-e452-46e5-9966-ad94b4391917 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:59.414446 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c5c60-e452-46e5-9966-ad94b4391917 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:59.415463 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING py.warnings [None req-591c5c60-e452-46e5-9966-ad94b4391917 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:23:59.415463 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: warnings.warn(msg) Dec 16 14:23:59.415463 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: Dec 16 14:23:59.416372 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c5c60-e452-46e5-9966-ad94b4391917 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:59.420848 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 222/443] 10.222.0.64 () {56 vars in 1147 bytes} [Thu Dec 16 14:23:59 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:59.426449 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3216063-696d-46e9-8ead-fc474e3944e0 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:59.436121 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3216063-696d-46e9-8ead-fc474e3944e0 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:59.440167 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571f4ac-522b-4ede-83f0-9638d0c52833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:59.440745 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571f4ac-522b-4ede-83f0-9638d0c52833 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:59.441064 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571f4ac-522b-4ede-83f0-9638d0c52833 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:59.441348 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571f4ac-522b-4ede-83f0-9638d0c52833 admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:59.442013 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571f4ac-522b-4ede-83f0-9638d0c52833 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:23:59.442312 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571f4ac-522b-4ede-83f0-9638d0c52833 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:59.443290 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING py.warnings [None req-1571f4ac-522b-4ede-83f0-9638d0c52833 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:23:59.443290 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: warnings.warn(msg) Dec 16 14:23:59.443290 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: Dec 16 14:23:59.444416 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571f4ac-522b-4ede-83f0-9638d0c52833 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:23:59.449492 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 222/444] 10.222.0.64 () {56 vars in 1147 bytes} [Thu Dec 16 14:23:59 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:01.508277 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9205ba-5e39-47bd-a8d2-b3603b2a1b9f None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:01.508861 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9205ba-5e39-47bd-a8d2-b3603b2a1b9f None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:01.508861 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9205ba-5e39-47bd-a8d2-b3603b2a1b9f None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:01.511075 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 223/445] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:24:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:01.516459 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8160d-6fa0-4de6-9d64-ae1017300bc5 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:01.516877 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8160d-6fa0-4de6-9d64-ae1017300bc5 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:01.517067 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8160d-6fa0-4de6-9d64-ae1017300bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:01.539481 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-28f8160d-6fa0-4de6-9d64-ae1017300bc5 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:01.540655 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-28f8160d-6fa0-4de6-9d64-ae1017300bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:01.547548 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 223/446] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:24:01.570823 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9205ba-5e39-47bd-a8d2-b3603b2a1b9f None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:01.583005 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9205ba-5e39-47bd-a8d2-b3603b2a1b9f None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:01.586946 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc98444-a459-488a-adcf-dbc6fc4be3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:01.587525 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc98444-a459-488a-adcf-dbc6fc4be3d0 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:01.587813 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc98444-a459-488a-adcf-dbc6fc4be3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:01.588097 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc98444-a459-488a-adcf-dbc6fc4be3d0 admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:01.588854 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc98444-a459-488a-adcf-dbc6fc4be3d0 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:01.589805 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING py.warnings [None req-9cc98444-a459-488a-adcf-dbc6fc4be3d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:24:01.589805 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: warnings.warn(msg) Dec 16 14:24:01.589805 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: Dec 16 14:24:01.590675 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc98444-a459-488a-adcf-dbc6fc4be3d0 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:01.604251 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 224/447] 10.222.0.64 () {60 vars in 1162 bytes} [Thu Dec 16 14:24:01 2021] POST /identity/v3/services => generated 269 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:24:03.691135 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35a7c9-ab89-4b37-9895-226caf976b3a None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:03.691713 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35a7c9-ab89-4b37-9895-226caf976b3a None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:03.691713 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35a7c9-ab89-4b37-9895-226caf976b3a None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:03.693647 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 224/448] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:24:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:03.698817 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee7c17-e5f9-499d-9ea7-1c447a7109d6 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:03.699253 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee7c17-e5f9-499d-9ea7-1c447a7109d6 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:03.699391 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee7c17-e5f9-499d-9ea7-1c447a7109d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:03.721103 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-85ee7c17-e5f9-499d-9ea7-1c447a7109d6 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:03.722246 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-85ee7c17-e5f9-499d-9ea7-1c447a7109d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:03.739736 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 225/449] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:03 2021] POST /identity/v3/auth/tokens => generated 1177 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:03.762302 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35a7c9-ab89-4b37-9895-226caf976b3a None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:03.773873 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35a7c9-ab89-4b37-9895-226caf976b3a None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:03.777896 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79461929-4060-40f2-b5b4-feeab6150b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:03.778613 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79461929-4060-40f2-b5b4-feeab6150b21 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:03.778904 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79461929-4060-40f2-b5b4-feeab6150b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:03.779190 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79461929-4060-40f2-b5b4-feeab6150b21 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:03.779812 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79461929-4060-40f2-b5b4-feeab6150b21 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:03.781411 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79461929-4060-40f2-b5b4-feeab6150b21 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:03.792311 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-79461929-4060-40f2-b5b4-feeab6150b21 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 16 14:24:03.793372 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 225/450] 10.222.0.64 () {56 vars in 1153 bytes} [Thu Dec 16 14:24:03 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:03.798933 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee7c17-e5f9-499d-9ea7-1c447a7109d6 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:03.808120 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee7c17-e5f9-499d-9ea7-1c447a7109d6 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:03.812293 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b134ca1-eaf9-47a5-9424-39628a3b7dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:03.812919 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b134ca1-eaf9-47a5-9424-39628a3b7dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:03.813217 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b134ca1-eaf9-47a5-9424-39628a3b7dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:03.813504 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b134ca1-eaf9-47a5-9424-39628a3b7dc7 admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:03.814181 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b134ca1-eaf9-47a5-9424-39628a3b7dc7 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:03.814484 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b134ca1-eaf9-47a5-9424-39628a3b7dc7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:03.816071 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b134ca1-eaf9-47a5-9424-39628a3b7dc7 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:03.820575 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 226/451] 10.222.0.64 () {56 vars in 1147 bytes} [Thu Dec 16 14:24:03 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:03.825885 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79461929-4060-40f2-b5b4-feeab6150b21 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:03.835065 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79461929-4060-40f2-b5b4-feeab6150b21 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:03.839768 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f979c1-ad19-43f9-828f-82d508008f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:03.840335 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f979c1-ad19-43f9-828f-82d508008f01 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:03.840620 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f979c1-ad19-43f9-828f-82d508008f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:03.840935 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f979c1-ad19-43f9-828f-82d508008f01 admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:03.841600 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f979c1-ad19-43f9-828f-82d508008f01 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:03.841895 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f979c1-ad19-43f9-828f-82d508008f01 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:03.843438 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f979c1-ad19-43f9-828f-82d508008f01 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:03.848487 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 226/452] 10.222.0.64 () {56 vars in 1147 bytes} [Thu Dec 16 14:24:03 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:03.854692 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b134ca1-eaf9-47a5-9424-39628a3b7dc7 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:03.864275 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b134ca1-eaf9-47a5-9424-39628a3b7dc7 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:03.868510 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee123183-ac5b-4f31-ab15-e6c1d72a2e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:03.869125 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee123183-ac5b-4f31-ab15-e6c1d72a2e31 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:03.869419 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee123183-ac5b-4f31-ab15-e6c1d72a2e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:03.869705 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee123183-ac5b-4f31-ab15-e6c1d72a2e31 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:03.870464 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee123183-ac5b-4f31-ab15-e6c1d72a2e31 admin admin] RBAC: Adding query filter params (interface=public, service_id=de28e49b12f846ab93e80bd3726d10ee, region_id=RegionOne) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:03.870772 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee123183-ac5b-4f31-ab15-e6c1d72a2e31 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:03.871779 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING py.warnings [None req-ee123183-ac5b-4f31-ab15-e6c1d72a2e31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:24:03.871779 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: warnings.warn(msg) Dec 16 14:24:03.871779 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: Dec 16 14:24:03.872657 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee123183-ac5b-4f31-ab15-e6c1d72a2e31 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:03.879034 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 227/453] 10.222.0.64 () {56 vars in 1272 bytes} [Thu Dec 16 14:24:03 2021] GET /identity/v3/endpoints?service_id=de28e49b12f846ab93e80bd3726d10ee&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:03.884451 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f979c1-ad19-43f9-828f-82d508008f01 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:03.893677 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f979c1-ad19-43f9-828f-82d508008f01 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:03.897746 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f249cc-34a4-409e-922c-97cffa70e31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:03.898326 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f249cc-34a4-409e-922c-97cffa70e31f admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:03.898617 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f249cc-34a4-409e-922c-97cffa70e31f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:03.898904 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f249cc-34a4-409e-922c-97cffa70e31f admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:03.899550 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f249cc-34a4-409e-922c-97cffa70e31f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:03.901655 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f249cc-34a4-409e-922c-97cffa70e31f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:03.906742 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 227/454] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Dec 16 14:24:03 2021] GET /identity/v3/services => generated 562 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:05.955740 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8764c83-90b1-4c90-b9dd-d55a5446ebc9 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:05.956285 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8764c83-90b1-4c90-b9dd-d55a5446ebc9 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:05.956285 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8764c83-90b1-4c90-b9dd-d55a5446ebc9 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:05.958008 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 228/455] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:24:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:05.963925 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4ad28-d233-462f-a67c-90b803bf8011 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:05.964362 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4ad28-d233-462f-a67c-90b803bf8011 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:05.964494 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4ad28-d233-462f-a67c-90b803bf8011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:05.986121 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-45f4ad28-d233-462f-a67c-90b803bf8011 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:05.987294 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-45f4ad28-d233-462f-a67c-90b803bf8011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:05.994105 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 228/456] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:05 2021] POST /identity/v3/auth/tokens => generated 1177 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:06.016707 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8764c83-90b1-4c90-b9dd-d55a5446ebc9 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:06.029307 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8764c83-90b1-4c90-b9dd-d55a5446ebc9 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:06.033309 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778657b-1619-4e13-8e29-4da0b897e16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:06.034037 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778657b-1619-4e13-8e29-4da0b897e16a admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:06.034328 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778657b-1619-4e13-8e29-4da0b897e16a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:06.034611 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778657b-1619-4e13-8e29-4da0b897e16a admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:06.035237 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778657b-1619-4e13-8e29-4da0b897e16a admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:06.036243 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING py.warnings [None req-5778657b-1619-4e13-8e29-4da0b897e16a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:24:06.036243 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: warnings.warn(msg) Dec 16 14:24:06.036243 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: Dec 16 14:24:06.037172 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778657b-1619-4e13-8e29-4da0b897e16a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:06.048471 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-5778657b-1619-4e13-8e29-4da0b897e16a admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 16 14:24:06.049590 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 229/457] 10.222.0.64 () {56 vars in 1153 bytes} [Thu Dec 16 14:24:06 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:06.055711 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4ad28-d233-462f-a67c-90b803bf8011 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:06.064974 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4ad28-d233-462f-a67c-90b803bf8011 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:06.069430 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b0f1b-4671-4078-a240-fdde4e2e5404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:06.070022 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b0f1b-4671-4078-a240-fdde4e2e5404 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:06.070314 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b0f1b-4671-4078-a240-fdde4e2e5404 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:06.070597 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b0f1b-4671-4078-a240-fdde4e2e5404 admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:06.071273 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b0f1b-4671-4078-a240-fdde4e2e5404 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:06.071575 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b0f1b-4671-4078-a240-fdde4e2e5404 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:06.073783 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b0f1b-4671-4078-a240-fdde4e2e5404 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:06.078146 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 229/458] 10.222.0.64 () {56 vars in 1147 bytes} [Thu Dec 16 14:24:06 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:06.083708 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778657b-1619-4e13-8e29-4da0b897e16a admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:06.092899 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778657b-1619-4e13-8e29-4da0b897e16a admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:06.096906 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f5c70-6ce2-42dd-a556-709f8038b6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:06.097480 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f5c70-6ce2-42dd-a556-709f8038b6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:06.097770 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f5c70-6ce2-42dd-a556-709f8038b6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:06.098048 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f5c70-6ce2-42dd-a556-709f8038b6c0 admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:06.098710 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f5c70-6ce2-42dd-a556-709f8038b6c0 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:06.099008 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f5c70-6ce2-42dd-a556-709f8038b6c0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:06.100576 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f5c70-6ce2-42dd-a556-709f8038b6c0 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:06.105298 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 230/459] 10.222.0.64 () {56 vars in 1147 bytes} [Thu Dec 16 14:24:06 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:06.110877 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b0f1b-4671-4078-a240-fdde4e2e5404 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:06.121990 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b0f1b-4671-4078-a240-fdde4e2e5404 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:06.126588 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33880a-493d-4c27-9f30-13cbf9b3d307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:06.127160 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33880a-493d-4c27-9f30-13cbf9b3d307 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:06.127453 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33880a-493d-4c27-9f30-13cbf9b3d307 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:06.127735 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33880a-493d-4c27-9f30-13cbf9b3d307 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:06.128425 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33880a-493d-4c27-9f30-13cbf9b3d307 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:06.129457 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING py.warnings [None req-cf33880a-493d-4c27-9f30-13cbf9b3d307 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:24:06.129457 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: warnings.warn(msg) Dec 16 14:24:06.129457 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: Dec 16 14:24:06.130331 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33880a-493d-4c27-9f30-13cbf9b3d307 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:06.150205 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 230/460] 10.222.0.64 () {60 vars in 1165 bytes} [Thu Dec 16 14:24:06 2021] POST /identity/v3/endpoints => generated 347 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:24:08.216527 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623db43-e50e-462c-a049-6e678c228235 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:08.217118 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623db43-e50e-462c-a049-6e678c228235 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:08.217257 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623db43-e50e-462c-a049-6e678c228235 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:08.218943 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 231/461] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:24:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:08.224117 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48522d-94dc-4101-bc06-056b7eb487ab None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:08.224544 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48522d-94dc-4101-bc06-056b7eb487ab None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:08.224677 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48522d-94dc-4101-bc06-056b7eb487ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:08.247727 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-6e48522d-94dc-4101-bc06-056b7eb487ab None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:08.248917 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-6e48522d-94dc-4101-bc06-056b7eb487ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:08.269227 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 231/462] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:08 2021] POST /identity/v3/auth/tokens => generated 1364 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:08.291493 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623db43-e50e-462c-a049-6e678c228235 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:08.303229 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623db43-e50e-462c-a049-6e678c228235 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:08.307816 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52dead-156a-42c8-9b7f-aadabaec67ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:08.308518 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52dead-156a-42c8-9b7f-aadabaec67ae admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:08.308831 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52dead-156a-42c8-9b7f-aadabaec67ae admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:08.309120 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52dead-156a-42c8-9b7f-aadabaec67ae admin admin] PATH_INFO: `/v3/services/compute` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:08.309743 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52dead-156a-42c8-9b7f-aadabaec67ae admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:08.311331 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52dead-156a-42c8-9b7f-aadabaec67ae admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:08.321630 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-5a52dead-156a-42c8-9b7f-aadabaec67ae admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 16 14:24:08.322689 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 232/463] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:24:08 2021] GET /identity/v3/services/compute => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:08.328156 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48522d-94dc-4101-bc06-056b7eb487ab None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:08.336672 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48522d-94dc-4101-bc06-056b7eb487ab None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:08.341319 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa230d26-5389-4a17-82fc-154754361699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:08.341896 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa230d26-5389-4a17-82fc-154754361699 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:08.342183 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa230d26-5389-4a17-82fc-154754361699 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:08.342462 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa230d26-5389-4a17-82fc-154754361699 admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:08.343123 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa230d26-5389-4a17-82fc-154754361699 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:08.343418 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa230d26-5389-4a17-82fc-154754361699 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:08.345003 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa230d26-5389-4a17-82fc-154754361699 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:08.349172 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 232/464] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Dec 16 14:24:08 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:08.354901 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52dead-156a-42c8-9b7f-aadabaec67ae admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:08.364558 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52dead-156a-42c8-9b7f-aadabaec67ae admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:08.368675 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f72012-87e2-4aa3-8072-a9c1f91032f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:08.369339 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f72012-87e2-4aa3-8072-a9c1f91032f2 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:08.369627 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f72012-87e2-4aa3-8072-a9c1f91032f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:08.369910 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f72012-87e2-4aa3-8072-a9c1f91032f2 admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:08.370571 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f72012-87e2-4aa3-8072-a9c1f91032f2 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:08.370872 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f72012-87e2-4aa3-8072-a9c1f91032f2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:08.372429 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f72012-87e2-4aa3-8072-a9c1f91032f2 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:08.376621 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 233/465] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Dec 16 14:24:08 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:10.433856 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08473f-279f-433d-9429-f7f189c76c4e None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:10.434418 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08473f-279f-433d-9429-f7f189c76c4e None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:10.434418 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08473f-279f-433d-9429-f7f189c76c4e None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:10.436100 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 233/466] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:24:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:10.441398 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d53fb-d7d1-4c02-bfb0-4d38290e277e None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:10.441808 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d53fb-d7d1-4c02-bfb0-4d38290e277e None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:10.441970 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d53fb-d7d1-4c02-bfb0-4d38290e277e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:10.465152 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-a14d53fb-d7d1-4c02-bfb0-4d38290e277e None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:10.466290 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-a14d53fb-d7d1-4c02-bfb0-4d38290e277e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:10.473107 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 234/467] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:10 2021] POST /identity/v3/auth/tokens => generated 1364 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:24:10.494591 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08473f-279f-433d-9429-f7f189c76c4e None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:10.506422 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08473f-279f-433d-9429-f7f189c76c4e None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:10.510840 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5f40b-3f2a-4acc-ae78-e226e868968e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:10.511412 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5f40b-3f2a-4acc-ae78-e226e868968e admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:10.511704 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5f40b-3f2a-4acc-ae78-e226e868968e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:10.511988 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5f40b-3f2a-4acc-ae78-e226e868968e admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:10.512688 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5f40b-3f2a-4acc-ae78-e226e868968e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:10.513707 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING py.warnings [None req-02e5f40b-3f2a-4acc-ae78-e226e868968e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:24:10.513707 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: warnings.warn(msg) Dec 16 14:24:10.513707 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: Dec 16 14:24:10.514585 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5f40b-3f2a-4acc-ae78-e226e868968e admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:10.528397 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 234/468] 10.222.0.64 () {60 vars in 1162 bytes} [Thu Dec 16 14:24:10 2021] POST /identity/v3/services => generated 242 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:24:12.604374 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630ac26-4f10-4346-b7f8-dec17fc8aa89 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:12.604920 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630ac26-4f10-4346-b7f8-dec17fc8aa89 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:12.605007 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630ac26-4f10-4346-b7f8-dec17fc8aa89 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:12.606663 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 235/469] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:24:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:12.611899 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b0cd8-66d3-4f34-8cbe-af5886e5b410 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:12.612299 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b0cd8-66d3-4f34-8cbe-af5886e5b410 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:12.612472 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b0cd8-66d3-4f34-8cbe-af5886e5b410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:12.634078 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-c89b0cd8-66d3-4f34-8cbe-af5886e5b410 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:12.635762 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-c89b0cd8-66d3-4f34-8cbe-af5886e5b410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:12.652467 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 235/470] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:12 2021] POST /identity/v3/auth/tokens => generated 1460 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:12.674462 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630ac26-4f10-4346-b7f8-dec17fc8aa89 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:12.686093 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630ac26-4f10-4346-b7f8-dec17fc8aa89 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:12.690135 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e733e5f-9fcd-4ad5-944c-af79a8a3d810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:12.690837 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e733e5f-9fcd-4ad5-944c-af79a8a3d810 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:12.691126 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e733e5f-9fcd-4ad5-944c-af79a8a3d810 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:12.691410 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e733e5f-9fcd-4ad5-944c-af79a8a3d810 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:12.692034 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e733e5f-9fcd-4ad5-944c-af79a8a3d810 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:12.693902 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e733e5f-9fcd-4ad5-944c-af79a8a3d810 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:12.704416 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-1e733e5f-9fcd-4ad5-944c-af79a8a3d810 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 16 14:24:12.705482 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 236/471] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:24:12 2021] GET /identity/v3/services/compute => generated 88 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:12.711040 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b0cd8-66d3-4f34-8cbe-af5886e5b410 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:12.720223 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b0cd8-66d3-4f34-8cbe-af5886e5b410 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:12.724311 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1d633-d2b7-4db5-9c68-5ba141193956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:12.724930 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1d633-d2b7-4db5-9c68-5ba141193956 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:12.725236 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1d633-d2b7-4db5-9c68-5ba141193956 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:12.725503 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1d633-d2b7-4db5-9c68-5ba141193956 admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:12.726170 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1d633-d2b7-4db5-9c68-5ba141193956 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:12.726468 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1d633-d2b7-4db5-9c68-5ba141193956 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:12.728032 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1d633-d2b7-4db5-9c68-5ba141193956 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:12.732394 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 236/472] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Dec 16 14:24:12 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:12.737577 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e733e5f-9fcd-4ad5-944c-af79a8a3d810 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:12.747200 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e733e5f-9fcd-4ad5-944c-af79a8a3d810 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:12.751244 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bc621-304b-4659-8842-d196ad303699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:12.751811 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bc621-304b-4659-8842-d196ad303699 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:12.752096 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bc621-304b-4659-8842-d196ad303699 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:12.752383 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bc621-304b-4659-8842-d196ad303699 admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:12.753081 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980bc621-304b-4659-8842-d196ad303699 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:12.753381 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980bc621-304b-4659-8842-d196ad303699 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:12.754941 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980bc621-304b-4659-8842-d196ad303699 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:12.760021 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 237/473] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Dec 16 14:24:12 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:12.765505 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1d633-d2b7-4db5-9c68-5ba141193956 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:12.774423 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1d633-d2b7-4db5-9c68-5ba141193956 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:12.779147 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9d5b4-02cb-4ccd-9e27-b70ff2a9263e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:12.779709 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9d5b4-02cb-4ccd-9e27-b70ff2a9263e admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:12.779997 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9d5b4-02cb-4ccd-9e27-b70ff2a9263e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:12.780279 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9d5b4-02cb-4ccd-9e27-b70ff2a9263e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:12.781041 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9d5b4-02cb-4ccd-9e27-b70ff2a9263e admin admin] RBAC: Adding query filter params (interface=public, service_id=778090a9baed4a04a45f6a736d9c36f6, region_id=RegionOne) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:12.781344 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9d5b4-02cb-4ccd-9e27-b70ff2a9263e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:12.782310 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING py.warnings [None req-c3c9d5b4-02cb-4ccd-9e27-b70ff2a9263e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:24:12.782310 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: warnings.warn(msg) Dec 16 14:24:12.782310 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: Dec 16 14:24:12.783162 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9d5b4-02cb-4ccd-9e27-b70ff2a9263e admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:12.788637 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 237/474] 10.222.0.64 () {56 vars in 1272 bytes} [Thu Dec 16 14:24:12 2021] GET /identity/v3/endpoints?service_id=778090a9baed4a04a45f6a736d9c36f6&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:12.793614 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bc621-304b-4659-8842-d196ad303699 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:12.802636 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bc621-304b-4659-8842-d196ad303699 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:12.807237 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94a6e1-b33c-4d47-ac0f-22049fe06d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:12.807806 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94a6e1-b33c-4d47-ac0f-22049fe06d88 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:12.808122 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94a6e1-b33c-4d47-ac0f-22049fe06d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:12.808382 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94a6e1-b33c-4d47-ac0f-22049fe06d88 admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:12.809078 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94a6e1-b33c-4d47-ac0f-22049fe06d88 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:12.810632 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94a6e1-b33c-4d47-ac0f-22049fe06d88 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:12.815517 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 238/475] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Dec 16 14:24:12 2021] GET /identity/v3/services => generated 792 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:14.861173 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b3d18-9800-4827-ae8b-83ff705c8ad8 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:14.861664 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b3d18-9800-4827-ae8b-83ff705c8ad8 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:14.861761 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b3d18-9800-4827-ae8b-83ff705c8ad8 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:14.863438 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 238/476] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:24:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:14.869272 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c8dce-bd82-4ff2-b7eb-f6f0c449cdb4 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:14.869697 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c8dce-bd82-4ff2-b7eb-f6f0c449cdb4 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:14.869835 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c8dce-bd82-4ff2-b7eb-f6f0c449cdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:14.891772 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-a34c8dce-bd82-4ff2-b7eb-f6f0c449cdb4 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:14.892939 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-a34c8dce-bd82-4ff2-b7eb-f6f0c449cdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:14.900061 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 239/477] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:14 2021] POST /identity/v3/auth/tokens => generated 1460 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:14.922426 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b3d18-9800-4827-ae8b-83ff705c8ad8 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:14.934828 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b3d18-9800-4827-ae8b-83ff705c8ad8 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:14.938781 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f457e-6189-4c72-805d-7b83148633b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:14.939483 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f457e-6189-4c72-805d-7b83148633b3 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:14.939770 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f457e-6189-4c72-805d-7b83148633b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:14.940057 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f457e-6189-4c72-805d-7b83148633b3 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:14.940675 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f457e-6189-4c72-805d-7b83148633b3 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:14.942280 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f457e-6189-4c72-805d-7b83148633b3 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:14.952697 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-765f457e-6189-4c72-805d-7b83148633b3 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 16 14:24:14.953767 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 239/478] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:24:14 2021] GET /identity/v3/services/compute => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:14.959416 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c8dce-bd82-4ff2-b7eb-f6f0c449cdb4 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:14.968154 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c8dce-bd82-4ff2-b7eb-f6f0c449cdb4 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:14.972313 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f57241-c2e9-4a14-bbd6-7725c3aa5b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:14.972928 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f57241-c2e9-4a14-bbd6-7725c3aa5b74 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:14.973458 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f57241-c2e9-4a14-bbd6-7725c3aa5b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:14.973742 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f57241-c2e9-4a14-bbd6-7725c3aa5b74 admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:14.974412 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f57241-c2e9-4a14-bbd6-7725c3aa5b74 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:14.974710 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f57241-c2e9-4a14-bbd6-7725c3aa5b74 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:14.976282 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f57241-c2e9-4a14-bbd6-7725c3aa5b74 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:14.981056 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 240/479] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Dec 16 14:24:14 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:14.986322 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f457e-6189-4c72-805d-7b83148633b3 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:14.996193 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f457e-6189-4c72-805d-7b83148633b3 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:15.000302 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f851fd-835b-48fe-84bc-f1eedd66857e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:15.000921 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f851fd-835b-48fe-84bc-f1eedd66857e admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:15.001218 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f851fd-835b-48fe-84bc-f1eedd66857e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:15.001500 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f851fd-835b-48fe-84bc-f1eedd66857e admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:15.002172 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f851fd-835b-48fe-84bc-f1eedd66857e admin admin] RBAC: Adding query filter params (type=compute) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:15.002475 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f851fd-835b-48fe-84bc-f1eedd66857e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:15.004176 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f851fd-835b-48fe-84bc-f1eedd66857e admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:15.009121 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 240/480] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Dec 16 14:24:14 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:15.014443 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f57241-c2e9-4a14-bbd6-7725c3aa5b74 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:15.023446 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f57241-c2e9-4a14-bbd6-7725c3aa5b74 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:15.027468 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83218604-eae5-4e58-93b3-72eda030b260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:15.028034 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83218604-eae5-4e58-93b3-72eda030b260 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:15.028321 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83218604-eae5-4e58-93b3-72eda030b260 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:15.028602 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83218604-eae5-4e58-93b3-72eda030b260 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:15.029323 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83218604-eae5-4e58-93b3-72eda030b260 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:15.030312 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING py.warnings [None req-83218604-eae5-4e58-93b3-72eda030b260 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:24:15.030312 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: warnings.warn(msg) Dec 16 14:24:15.030312 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: Dec 16 14:24:15.031184 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83218604-eae5-4e58-93b3-72eda030b260 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:15.050165 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 241/481] 10.222.0.64 () {60 vars in 1165 bytes} [Thu Dec 16 14:24:15 2021] POST /identity/v3/endpoints => generated 334 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:24:17.174872 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d91c4-f949-4e99-9495-f00cb8237a84 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:17.175376 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d91c4-f949-4e99-9495-f00cb8237a84 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:17.175376 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d91c4-f949-4e99-9495-f00cb8237a84 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:17.177050 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 241/482] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:24:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:17.182093 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f2d82-c326-453e-86a6-38c27980aa12 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:17.182509 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f2d82-c326-453e-86a6-38c27980aa12 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:17.182653 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f2d82-c326-453e-86a6-38c27980aa12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:17.205552 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-141f2d82-c326-453e-86a6-38c27980aa12 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:17.206675 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-141f2d82-c326-453e-86a6-38c27980aa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:17.223159 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 242/483] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:17 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:17.245951 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d91c4-f949-4e99-9495-f00cb8237a84 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:17.258014 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d91c4-f949-4e99-9495-f00cb8237a84 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:17.262460 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22ec8e-e818-4754-990c-2fbba5a04c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:17.263179 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22ec8e-e818-4754-990c-2fbba5a04c6b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:17.263465 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22ec8e-e818-4754-990c-2fbba5a04c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:17.263742 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22ec8e-e818-4754-990c-2fbba5a04c6b admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:17.277223 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22ec8e-e818-4754-990c-2fbba5a04c6b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:24:17.283851 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-4e22ec8e-e818-4754-990c-2fbba5a04c6b admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 16 14:24:17.284961 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 242/484] 10.222.0.64 () {56 vars in 1141 bytes} [Thu Dec 16 14:24:17 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:17.290806 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f2d82-c326-453e-86a6-38c27980aa12 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:17.299501 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f2d82-c326-453e-86a6-38c27980aa12 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:17.303558 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb7636-f890-415c-a0c5-d0c483aaf8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:17.304146 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb7636-f890-415c-a0c5-d0c483aaf8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:17.304434 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb7636-f890-415c-a0c5-d0c483aaf8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:17.304712 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb7636-f890-415c-a0c5-d0c483aaf8f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:17.305443 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb7636-f890-415c-a0c5-d0c483aaf8f3 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:17.305740 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb7636-f890-415c-a0c5-d0c483aaf8f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:17.307819 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb7636-f890-415c-a0c5-d0c483aaf8f3 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:17.316243 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 243/485] 10.222.0.64 () {56 vars in 1136 bytes} [Thu Dec 16 14:24:17 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:17.322359 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22ec8e-e818-4754-990c-2fbba5a04c6b admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:17.331323 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22ec8e-e818-4754-990c-2fbba5a04c6b admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:17.335313 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b308e1-a5cb-465f-a3aa-51919911a419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:17.336001 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b308e1-a5cb-465f-a3aa-51919911a419 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:17.336288 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b308e1-a5cb-465f-a3aa-51919911a419 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:17.336568 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b308e1-a5cb-465f-a3aa-51919911a419 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:17.349332 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b308e1-a5cb-465f-a3aa-51919911a419 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:17.351122 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b308e1-a5cb-465f-a3aa-51919911a419 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:17.367108 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-a2b308e1-a5cb-465f-a3aa-51919911a419 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:17.368149 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 243/486] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:17.374294 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb7636-f890-415c-a0c5-d0c483aaf8f3 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:17.383749 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb7636-f890-415c-a0c5-d0c483aaf8f3 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:17.388823 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef503c-43ec-4f11-a971-138aef07288a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:17.389419 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef503c-43ec-4f11-a971-138aef07288a admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:17.389709 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef503c-43ec-4f11-a971-138aef07288a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:17.389993 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef503c-43ec-4f11-a971-138aef07288a admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:17.390689 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef503c-43ec-4f11-a971-138aef07288a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:17.390991 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef503c-43ec-4f11-a971-138aef07288a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:17.392587 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef503c-43ec-4f11-a971-138aef07288a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:17.404931 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 244/487] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:17.410409 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b308e1-a5cb-465f-a3aa-51919911a419 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:17.419857 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b308e1-a5cb-465f-a3aa-51919911a419 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:17.423959 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4d068-a183-4d1e-bbd9-7a37b4f3bce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:17.424658 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4d068-a183-4d1e-bbd9-7a37b4f3bce2 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:17.425036 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4d068-a183-4d1e-bbd9-7a37b4f3bce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:17.425272 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4d068-a183-4d1e-bbd9-7a37b4f3bce2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:17.438752 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4d068-a183-4d1e-bbd9-7a37b4f3bce2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:17.440746 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4d068-a183-4d1e-bbd9-7a37b4f3bce2 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:17.458880 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-f4d4d068-a183-4d1e-bbd9-7a37b4f3bce2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 16 14:24:17.459921 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 244/488] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Dec 16 14:24:17 2021] GET /identity/v3/users/nova => generated 82 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:17.465310 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef503c-43ec-4f11-a971-138aef07288a admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:17.474424 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef503c-43ec-4f11-a971-138aef07288a admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:17.478709 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da4b48-3f7f-4e53-97b0-d1903cb449f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:17.479299 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da4b48-3f7f-4e53-97b0-d1903cb449f0 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:17.479591 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da4b48-3f7f-4e53-97b0-d1903cb449f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:17.479875 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da4b48-3f7f-4e53-97b0-d1903cb449f0 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:17.480658 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da4b48-3f7f-4e53-97b0-d1903cb449f0 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:17.481007 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da4b48-3f7f-4e53-97b0-d1903cb449f0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:17.482837 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da4b48-3f7f-4e53-97b0-d1903cb449f0 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:17.512680 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 245/489] 10.222.0.64 () {56 vars in 1154 bytes} [Thu Dec 16 14:24:17 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:17.518120 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4d068-a183-4d1e-bbd9-7a37b4f3bce2 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:17.527294 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4d068-a183-4d1e-bbd9-7a37b4f3bce2 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:17.531291 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcecddd2-87d6-4c54-9edf-d7977269b645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:17.531858 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecddd2-87d6-4c54-9edf-d7977269b645 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:17.532154 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecddd2-87d6-4c54-9edf-d7977269b645 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:17.532435 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecddd2-87d6-4c54-9edf-d7977269b645 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:17.539926 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcecddd2-87d6-4c54-9edf-d7977269b645 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:17.541696 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcecddd2-87d6-4c54-9edf-d7977269b645 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:17.549900 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 245/490] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:24:17 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:24:17.555071 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da4b48-3f7f-4e53-97b0-d1903cb449f0 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:17.564635 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da4b48-3f7f-4e53-97b0-d1903cb449f0 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:17.569051 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395a990-dd08-43de-adb4-931104552a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:17.569755 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395a990-dd08-43de-adb4-931104552a3d admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:17.570045 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395a990-dd08-43de-adb4-931104552a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:17.570325 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395a990-dd08-43de-adb4-931104552a3d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:17.582240 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395a990-dd08-43de-adb4-931104552a3d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:17.584058 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395a990-dd08-43de-adb4-931104552a3d admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:17.600533 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-b395a990-dd08-43de-adb4-931104552a3d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:17.601617 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 246/491] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:17.606994 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcecddd2-87d6-4c54-9edf-d7977269b645 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:17.615418 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcecddd2-87d6-4c54-9edf-d7977269b645 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:17.620158 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34472700-5ff5-4bb4-876a-8b0f7f438ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:17.620737 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34472700-5ff5-4bb4-876a-8b0f7f438ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:17.621129 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34472700-5ff5-4bb4-876a-8b0f7f438ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:17.621414 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34472700-5ff5-4bb4-876a-8b0f7f438ae5 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:17.622096 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34472700-5ff5-4bb4-876a-8b0f7f438ae5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:17.622393 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34472700-5ff5-4bb4-876a-8b0f7f438ae5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:17.623959 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34472700-5ff5-4bb4-876a-8b0f7f438ae5 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:17.636859 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 246/492] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:17.642355 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395a990-dd08-43de-adb4-931104552a3d admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:17.651447 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395a990-dd08-43de-adb4-931104552a3d admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:17.655415 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ac2ac-9565-406a-8987-ee19a3e67f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:17.656116 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ac2ac-9565-406a-8987-ee19a3e67f84 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:17.656401 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ac2ac-9565-406a-8987-ee19a3e67f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:17.656676 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ac2ac-9565-406a-8987-ee19a3e67f84 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:17.665131 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ac2ac-9565-406a-8987-ee19a3e67f84 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:17.667561 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ac2ac-9565-406a-8987-ee19a3e67f84 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:17.680680 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-078ac2ac-9565-406a-8987-ee19a3e67f84 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:24:17.682345 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 247/493] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:24:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:17.687877 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34472700-5ff5-4bb4-876a-8b0f7f438ae5 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:17.697312 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34472700-5ff5-4bb4-876a-8b0f7f438ae5 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:17.701342 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b5602-8c46-4eaf-a9a9-3ff937dc5420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:17.701918 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b5602-8c46-4eaf-a9a9-3ff937dc5420 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:17.702207 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b5602-8c46-4eaf-a9a9-3ff937dc5420 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:17.702489 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b5602-8c46-4eaf-a9a9-3ff937dc5420 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:17.703225 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b5602-8c46-4eaf-a9a9-3ff937dc5420 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:17.703525 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b5602-8c46-4eaf-a9a9-3ff937dc5420 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:17.705374 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b5602-8c46-4eaf-a9a9-3ff937dc5420 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:17.717727 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 247/494] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:24:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:17.723171 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ac2ac-9565-406a-8987-ee19a3e67f84 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:17.732706 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ac2ac-9565-406a-8987-ee19a3e67f84 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:17.736713 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489d290-869f-4b4f-ae1e-8bd40fffb7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:17.737301 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489d290-869f-4b4f-ae1e-8bd40fffb7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:17.737586 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489d290-869f-4b4f-ae1e-8bd40fffb7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:17.737864 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489d290-869f-4b4f-ae1e-8bd40fffb7e2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:17.738632 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489d290-869f-4b4f-ae1e-8bd40fffb7e2 admin admin] RBAC: Adding query filter params (role.id=0cc0d33666514991897c60dd152be949, scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55, user.id=8e416527de444ef1b744da062ee1e7f2) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:17.738936 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489d290-869f-4b4f-ae1e-8bd40fffb7e2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:17.740726 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489d290-869f-4b4f-ae1e-8bd40fffb7e2 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:17.746548 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 248/495] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:24:17 2021] GET /identity/v3/role_assignments?user.id=8e416527de444ef1b744da062ee1e7f2&scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55&role.id=0cc0d33666514991897c60dd152be949 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:19.801106 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d6739-38c7-46c3-8cf3-faa283a8ad78 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:19.801660 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d6739-38c7-46c3-8cf3-faa283a8ad78 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:19.801660 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d6739-38c7-46c3-8cf3-faa283a8ad78 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:19.803254 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 248/496] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:24:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:19.808329 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20868ca-1b14-4f9e-8607-40ae4c8b2da2 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:19.808704 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20868ca-1b14-4f9e-8607-40ae4c8b2da2 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:19.808944 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20868ca-1b14-4f9e-8607-40ae4c8b2da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:19.830935 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-e20868ca-1b14-4f9e-8607-40ae4c8b2da2 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:19.832061 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e20868ca-1b14-4f9e-8607-40ae4c8b2da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:19.839462 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 249/497] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:19 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:19.861636 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d6739-38c7-46c3-8cf3-faa283a8ad78 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:19.873240 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d6739-38c7-46c3-8cf3-faa283a8ad78 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:19.877319 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fce38f-8deb-42ac-ae97-ffd7eafd50c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:19.878041 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fce38f-8deb-42ac-ae97-ffd7eafd50c5 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:19.878333 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fce38f-8deb-42ac-ae97-ffd7eafd50c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:19.878621 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fce38f-8deb-42ac-ae97-ffd7eafd50c5 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:19.889715 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fce38f-8deb-42ac-ae97-ffd7eafd50c5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:24:19.896408 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-46fce38f-8deb-42ac-ae97-ffd7eafd50c5 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 16 14:24:19.897531 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 249/498] 10.222.0.64 () {56 vars in 1141 bytes} [Thu Dec 16 14:24:19 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:19.903802 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20868ca-1b14-4f9e-8607-40ae4c8b2da2 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:19.912311 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20868ca-1b14-4f9e-8607-40ae4c8b2da2 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:19.917088 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533db6d-1a1e-4307-be12-57e6fc62d740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:19.917673 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533db6d-1a1e-4307-be12-57e6fc62d740 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:19.917959 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533db6d-1a1e-4307-be12-57e6fc62d740 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:19.918235 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533db6d-1a1e-4307-be12-57e6fc62d740 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:19.918934 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533db6d-1a1e-4307-be12-57e6fc62d740 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:19.919231 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533db6d-1a1e-4307-be12-57e6fc62d740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:19.920803 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533db6d-1a1e-4307-be12-57e6fc62d740 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:19.929671 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 250/499] 10.222.0.64 () {56 vars in 1136 bytes} [Thu Dec 16 14:24:19 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:19.935087 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fce38f-8deb-42ac-ae97-ffd7eafd50c5 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:19.945027 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fce38f-8deb-42ac-ae97-ffd7eafd50c5 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:19.949653 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd082974-30d8-4281-887e-7daca0976e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:19.950350 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd082974-30d8-4281-887e-7daca0976e0a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:19.950641 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd082974-30d8-4281-887e-7daca0976e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:19.950924 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd082974-30d8-4281-887e-7daca0976e0a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:19.961908 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd082974-30d8-4281-887e-7daca0976e0a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:19.964273 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd082974-30d8-4281-887e-7daca0976e0a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:19.980817 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-fd082974-30d8-4281-887e-7daca0976e0a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:19.981869 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 250/500] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:19.989945 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533db6d-1a1e-4307-be12-57e6fc62d740 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:20.003975 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533db6d-1a1e-4307-be12-57e6fc62d740 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:20.008441 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec2367-1c4e-493e-bc1b-122b49b61b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:20.009555 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec2367-1c4e-493e-bc1b-122b49b61b15 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:20.009846 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec2367-1c4e-493e-bc1b-122b49b61b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:20.010130 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec2367-1c4e-493e-bc1b-122b49b61b15 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:20.010818 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec2367-1c4e-493e-bc1b-122b49b61b15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:20.011121 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec2367-1c4e-493e-bc1b-122b49b61b15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:20.012707 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec2367-1c4e-493e-bc1b-122b49b61b15 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:20.025474 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 251/501] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:20.031162 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd082974-30d8-4281-887e-7daca0976e0a admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:20.040418 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd082974-30d8-4281-887e-7daca0976e0a admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:20.044568 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba18108-befd-48ca-b40b-3dafae6b444d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:20.045304 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba18108-befd-48ca-b40b-3dafae6b444d admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:20.045591 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba18108-befd-48ca-b40b-3dafae6b444d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:20.045870 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba18108-befd-48ca-b40b-3dafae6b444d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:20.058141 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba18108-befd-48ca-b40b-3dafae6b444d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:20.060083 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba18108-befd-48ca-b40b-3dafae6b444d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:20.077791 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-aba18108-befd-48ca-b40b-3dafae6b444d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 16 14:24:20.078827 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 251/502] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Dec 16 14:24:20 2021] GET /identity/v3/users/nova => generated 82 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:20.084204 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec2367-1c4e-493e-bc1b-122b49b61b15 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:20.094098 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec2367-1c4e-493e-bc1b-122b49b61b15 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:20.098279 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213de1a-f743-4e7b-814d-492cc26dbb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:20.098871 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213de1a-f743-4e7b-814d-492cc26dbb6c admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:20.099164 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213de1a-f743-4e7b-814d-492cc26dbb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:20.099450 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213de1a-f743-4e7b-814d-492cc26dbb6c admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:20.100236 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213de1a-f743-4e7b-814d-492cc26dbb6c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:20.100543 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213de1a-f743-4e7b-814d-492cc26dbb6c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:20.102414 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213de1a-f743-4e7b-814d-492cc26dbb6c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:20.129995 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 252/503] 10.222.0.64 () {56 vars in 1154 bytes} [Thu Dec 16 14:24:20 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:20.135788 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba18108-befd-48ca-b40b-3dafae6b444d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:20.144842 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba18108-befd-48ca-b40b-3dafae6b444d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:20.148834 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e6427-ae3a-41d6-a2dc-de1d8ea4fb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:20.150180 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e6427-ae3a-41d6-a2dc-de1d8ea4fb7f admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:20.150467 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e6427-ae3a-41d6-a2dc-de1d8ea4fb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:20.150744 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e6427-ae3a-41d6-a2dc-de1d8ea4fb7f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:20.162144 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e6427-ae3a-41d6-a2dc-de1d8ea4fb7f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:20.163935 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e6427-ae3a-41d6-a2dc-de1d8ea4fb7f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:20.180083 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-2c2e6427-ae3a-41d6-a2dc-de1d8ea4fb7f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:20.181258 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 252/504] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:20.186760 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213de1a-f743-4e7b-814d-492cc26dbb6c admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:20.196097 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213de1a-f743-4e7b-814d-492cc26dbb6c admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:20.200664 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52728b46-ad6c-4863-9274-9f52c8c2dec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:20.201276 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52728b46-ad6c-4863-9274-9f52c8c2dec9 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:20.201563 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52728b46-ad6c-4863-9274-9f52c8c2dec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:20.201842 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52728b46-ad6c-4863-9274-9f52c8c2dec9 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:20.202545 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52728b46-ad6c-4863-9274-9f52c8c2dec9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:20.202843 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52728b46-ad6c-4863-9274-9f52c8c2dec9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:20.204410 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52728b46-ad6c-4863-9274-9f52c8c2dec9 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:20.216462 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 253/505] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:20.221755 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e6427-ae3a-41d6-a2dc-de1d8ea4fb7f admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:20.231442 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e6427-ae3a-41d6-a2dc-de1d8ea4fb7f admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:20.235609 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3f73a-a846-4896-a2c3-7ff799662db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:20.236308 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3f73a-a846-4896-a2c3-7ff799662db7 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:20.236599 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3f73a-a846-4896-a2c3-7ff799662db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:20.236923 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3f73a-a846-4896-a2c3-7ff799662db7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:20.246097 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3f73a-a846-4896-a2c3-7ff799662db7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:20.248055 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3f73a-a846-4896-a2c3-7ff799662db7 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:20.261785 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-28a3f73a-a846-4896-a2c3-7ff799662db7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:24:20.262881 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 253/506] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:24:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:20.268679 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52728b46-ad6c-4863-9274-9f52c8c2dec9 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:20.278130 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52728b46-ad6c-4863-9274-9f52c8c2dec9 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:20.282314 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcae275-cc27-4036-b39a-223491a98856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:20.282900 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcae275-cc27-4036-b39a-223491a98856 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:20.283191 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcae275-cc27-4036-b39a-223491a98856 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:20.283474 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcae275-cc27-4036-b39a-223491a98856 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:20.284213 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcae275-cc27-4036-b39a-223491a98856 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:20.284517 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcae275-cc27-4036-b39a-223491a98856 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:20.286391 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcae275-cc27-4036-b39a-223491a98856 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:20.299410 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 254/507] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:24:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:20.305092 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3f73a-a846-4896-a2c3-7ff799662db7 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:20.314918 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3f73a-a846-4896-a2c3-7ff799662db7 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:20.319256 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5155b-0163-478f-b620-d5398de262d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:20.320053 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5155b-0163-478f-b620-d5398de262d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:20.320341 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5155b-0163-478f-b620-d5398de262d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:20.320627 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5155b-0163-478f-b620-d5398de262d7 admin admin] PATH_INFO: `/v3/projects/244c8ef98d0445c6a0279c46d5cb7e55/users/8e416527de444ef1b744da062ee1e7f2/roles/0cc0d33666514991897c60dd152be949` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:20.322690 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5155b-0163-478f-b620-d5398de262d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=244c8ef98d0445c6a0279c46d5cb7e55, user_id=8e416527de444ef1b744da062ee1e7f2, role_id=0cc0d33666514991897c60dd152be949)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:20.325336 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5155b-0163-478f-b620-d5398de262d7 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:20.337950 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 254/508] 10.222.0.64 () {58 vars in 1460 bytes} [Thu Dec 16 14:24:20 2021] PUT /identity/v3/projects/244c8ef98d0445c6a0279c46d5cb7e55/users/8e416527de444ef1b744da062ee1e7f2/roles/0cc0d33666514991897c60dd152be949 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:24:22.385136 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdca604-d601-443b-981c-b565f2cc4be1 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:22.385666 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdca604-d601-443b-981c-b565f2cc4be1 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:22.385751 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdca604-d601-443b-981c-b565f2cc4be1 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:22.387354 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 255/509] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:24:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:22.392534 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da3209-0755-446b-9abe-1521f317e338 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:22.393009 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da3209-0755-446b-9abe-1521f317e338 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:22.393137 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da3209-0755-446b-9abe-1521f317e338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:22.415542 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-59da3209-0755-446b-9abe-1521f317e338 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:22.416673 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-59da3209-0755-446b-9abe-1521f317e338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:22.479303 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 255/510] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:22 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:22.502079 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdca604-d601-443b-981c-b565f2cc4be1 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:22.514247 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdca604-d601-443b-981c-b565f2cc4be1 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:22.518273 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd0fee-91a8-4c92-a29f-50cbb93fc70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:22.519173 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd0fee-91a8-4c92-a29f-50cbb93fc70d admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:22.519464 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd0fee-91a8-4c92-a29f-50cbb93fc70d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:22.519745 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd0fee-91a8-4c92-a29f-50cbb93fc70d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:22.531361 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd0fee-91a8-4c92-a29f-50cbb93fc70d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:24:22.538112 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-efcd0fee-91a8-4c92-a29f-50cbb93fc70d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 16 14:24:22.539250 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 256/511] 10.222.0.64 () {56 vars in 1141 bytes} [Thu Dec 16 14:24:22 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:22.544974 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da3209-0755-446b-9abe-1521f317e338 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:22.553403 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da3209-0755-446b-9abe-1521f317e338 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:22.558097 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761b82a-493b-4f2d-9cad-727e5abc0f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:22.558680 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761b82a-493b-4f2d-9cad-727e5abc0f0c admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:22.558965 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761b82a-493b-4f2d-9cad-727e5abc0f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:22.559246 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761b82a-493b-4f2d-9cad-727e5abc0f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:22.559951 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761b82a-493b-4f2d-9cad-727e5abc0f0c admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:22.560248 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761b82a-493b-4f2d-9cad-727e5abc0f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:22.561847 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761b82a-493b-4f2d-9cad-727e5abc0f0c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:22.570187 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 256/512] 10.222.0.64 () {56 vars in 1136 bytes} [Thu Dec 16 14:24:22 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:22.575855 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd0fee-91a8-4c92-a29f-50cbb93fc70d admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:22.585377 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd0fee-91a8-4c92-a29f-50cbb93fc70d admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:22.589454 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e92a59-fa0e-478a-8445-8aa276bcd54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:22.590142 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e92a59-fa0e-478a-8445-8aa276bcd54b admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:22.590427 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e92a59-fa0e-478a-8445-8aa276bcd54b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:22.590704 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e92a59-fa0e-478a-8445-8aa276bcd54b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:22.601548 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e92a59-fa0e-478a-8445-8aa276bcd54b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:22.603352 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e92a59-fa0e-478a-8445-8aa276bcd54b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:22.620256 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-a6e92a59-fa0e-478a-8445-8aa276bcd54b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:22.621321 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 257/513] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:22.626700 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761b82a-493b-4f2d-9cad-727e5abc0f0c admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:22.636580 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761b82a-493b-4f2d-9cad-727e5abc0f0c admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:22.640745 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35140912-806a-4ab4-b87e-3a021a873256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:22.641353 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35140912-806a-4ab4-b87e-3a021a873256 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:22.641648 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35140912-806a-4ab4-b87e-3a021a873256 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:22.641936 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35140912-806a-4ab4-b87e-3a021a873256 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:22.642621 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35140912-806a-4ab4-b87e-3a021a873256 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:22.642923 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35140912-806a-4ab4-b87e-3a021a873256 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:22.644514 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35140912-806a-4ab4-b87e-3a021a873256 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:22.657751 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 257/514] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:22.662894 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e92a59-fa0e-478a-8445-8aa276bcd54b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:22.672260 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e92a59-fa0e-478a-8445-8aa276bcd54b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:22.676282 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd61bb-473f-45d0-b172-82eccfdd7042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:22.677010 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd61bb-473f-45d0-b172-82eccfdd7042 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:22.677297 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd61bb-473f-45d0-b172-82eccfdd7042 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:22.677577 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd61bb-473f-45d0-b172-82eccfdd7042 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:22.690473 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd61bb-473f-45d0-b172-82eccfdd7042 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:22.692727 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd61bb-473f-45d0-b172-82eccfdd7042 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:22.711085 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-a5bd61bb-473f-45d0-b172-82eccfdd7042 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 16 14:24:22.712172 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 258/515] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Dec 16 14:24:22 2021] GET /identity/v3/users/nova => generated 82 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:22.718099 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35140912-806a-4ab4-b87e-3a021a873256 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:22.727697 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35140912-806a-4ab4-b87e-3a021a873256 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:22.731968 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c618c0-7266-4261-9234-35b12e94692b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:22.732551 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c618c0-7266-4261-9234-35b12e94692b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:22.732874 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c618c0-7266-4261-9234-35b12e94692b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:22.733162 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c618c0-7266-4261-9234-35b12e94692b admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:22.733977 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c618c0-7266-4261-9234-35b12e94692b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:22.734278 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c618c0-7266-4261-9234-35b12e94692b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:22.736124 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c618c0-7266-4261-9234-35b12e94692b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:22.765034 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 258/516] 10.222.0.64 () {56 vars in 1154 bytes} [Thu Dec 16 14:24:22 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:22.770654 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd61bb-473f-45d0-b172-82eccfdd7042 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:22.779919 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd61bb-473f-45d0-b172-82eccfdd7042 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:22.784014 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b530fb0-85d3-4db0-93fa-360d1cbdb770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:22.784584 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b530fb0-85d3-4db0-93fa-360d1cbdb770 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:22.784910 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b530fb0-85d3-4db0-93fa-360d1cbdb770 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:22.785195 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b530fb0-85d3-4db0-93fa-360d1cbdb770 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:22.792865 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b530fb0-85d3-4db0-93fa-360d1cbdb770 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:22.794592 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b530fb0-85d3-4db0-93fa-360d1cbdb770 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:22.802909 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 259/517] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:24:22 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:24:22.808640 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c618c0-7266-4261-9234-35b12e94692b admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:22.818209 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c618c0-7266-4261-9234-35b12e94692b admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:22.823026 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90e12f-2575-42fa-89df-fcb686defcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:22.823735 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90e12f-2575-42fa-89df-fcb686defcd6 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:22.824022 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90e12f-2575-42fa-89df-fcb686defcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:22.824303 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90e12f-2575-42fa-89df-fcb686defcd6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:22.835641 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90e12f-2575-42fa-89df-fcb686defcd6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:22.837482 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90e12f-2575-42fa-89df-fcb686defcd6 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:22.853830 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-3d90e12f-2575-42fa-89df-fcb686defcd6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:22.854911 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 259/518] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:22.860470 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b530fb0-85d3-4db0-93fa-360d1cbdb770 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:22.869584 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b530fb0-85d3-4db0-93fa-360d1cbdb770 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:22.873776 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a51871-13c1-4bb8-9af2-81fe0ff54946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:22.874355 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a51871-13c1-4bb8-9af2-81fe0ff54946 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:22.874649 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a51871-13c1-4bb8-9af2-81fe0ff54946 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:22.874943 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a51871-13c1-4bb8-9af2-81fe0ff54946 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:22.875624 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a51871-13c1-4bb8-9af2-81fe0ff54946 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:22.875928 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a51871-13c1-4bb8-9af2-81fe0ff54946 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:22.877540 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a51871-13c1-4bb8-9af2-81fe0ff54946 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:22.890561 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 260/519] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:22.895766 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90e12f-2575-42fa-89df-fcb686defcd6 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:22.904945 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90e12f-2575-42fa-89df-fcb686defcd6 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:22.909165 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d0060-7dd7-4358-9707-001dd1df55d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:22.909867 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d0060-7dd7-4358-9707-001dd1df55d8 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:22.910157 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d0060-7dd7-4358-9707-001dd1df55d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:22.910441 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d0060-7dd7-4358-9707-001dd1df55d8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:22.919419 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d0060-7dd7-4358-9707-001dd1df55d8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:22.921540 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d0060-7dd7-4358-9707-001dd1df55d8 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:22.935382 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-9a4d0060-7dd7-4358-9707-001dd1df55d8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:24:22.936436 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 260/520] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:24:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:22.942006 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a51871-13c1-4bb8-9af2-81fe0ff54946 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:22.951496 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a51871-13c1-4bb8-9af2-81fe0ff54946 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:22.955596 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c401f-5324-4fe0-887c-0e0395d40e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:22.956174 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c401f-5324-4fe0-887c-0e0395d40e7c admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:22.956465 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c401f-5324-4fe0-887c-0e0395d40e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:22.956749 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c401f-5324-4fe0-887c-0e0395d40e7c admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:22.957533 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c401f-5324-4fe0-887c-0e0395d40e7c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:22.957819 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c401f-5324-4fe0-887c-0e0395d40e7c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:22.959669 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c401f-5324-4fe0-887c-0e0395d40e7c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:22.973300 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 261/521] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:24:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:22.979373 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d0060-7dd7-4358-9707-001dd1df55d8 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:22.988566 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d0060-7dd7-4358-9707-001dd1df55d8 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:22.992675 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d08d69-d2a8-42fe-bfd6-229f2e6bdda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:22.993270 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d08d69-d2a8-42fe-bfd6-229f2e6bdda5 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:22.993564 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d08d69-d2a8-42fe-bfd6-229f2e6bdda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:22.993842 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d08d69-d2a8-42fe-bfd6-229f2e6bdda5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:22.995175 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d08d69-d2a8-42fe-bfd6-229f2e6bdda5 admin admin] RBAC: Adding query filter params (role.id=0cc0d33666514991897c60dd152be949, scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55, user.id=8e416527de444ef1b744da062ee1e7f2) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:22.995481 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d08d69-d2a8-42fe-bfd6-229f2e6bdda5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:22.997319 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d08d69-d2a8-42fe-bfd6-229f2e6bdda5 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:23.002846 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 261/522] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:24:22 2021] GET /identity/v3/role_assignments?user.id=8e416527de444ef1b744da062ee1e7f2&scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55&role.id=0cc0d33666514991897c60dd152be949 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:25.266438 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028941c-b633-4698-9ef2-7d1aeba297f4 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:25.266959 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028941c-b633-4698-9ef2-7d1aeba297f4 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:25.267046 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028941c-b633-4698-9ef2-7d1aeba297f4 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:25.268680 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 262/523] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:24:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:25.273948 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fd21b-6ae8-4eec-8118-55360d1ad4ff None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:25.274360 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fd21b-6ae8-4eec-8118-55360d1ad4ff None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:25.274525 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fd21b-6ae8-4eec-8118-55360d1ad4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:25.297614 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-ec4fd21b-6ae8-4eec-8118-55360d1ad4ff None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:25.298947 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-ec4fd21b-6ae8-4eec-8118-55360d1ad4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:25.306014 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 262/524] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:25 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:25.331020 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028941c-b633-4698-9ef2-7d1aeba297f4 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:25.343444 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028941c-b633-4698-9ef2-7d1aeba297f4 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:25.347488 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8f326-68c9-4fd5-8d74-7be78c975eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:25.348193 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8f326-68c9-4fd5-8d74-7be78c975eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:25.348482 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8f326-68c9-4fd5-8d74-7be78c975eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:25.348767 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8f326-68c9-4fd5-8d74-7be78c975eb2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:25.360081 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8f326-68c9-4fd5-8d74-7be78c975eb2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:25.361943 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8f326-68c9-4fd5-8d74-7be78c975eb2 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:25.378277 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-25d8f326-68c9-4fd5-8d74-7be78c975eb2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:25.379326 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 263/525] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:25.386237 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fd21b-6ae8-4eec-8118-55360d1ad4ff None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:25.395345 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fd21b-6ae8-4eec-8118-55360d1ad4ff None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:25.399547 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18f74b-bb7b-4192-8d3e-b97a939bd03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:25.400748 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18f74b-bb7b-4192-8d3e-b97a939bd03f admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:25.401067 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18f74b-bb7b-4192-8d3e-b97a939bd03f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:25.401354 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18f74b-bb7b-4192-8d3e-b97a939bd03f admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:25.402042 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18f74b-bb7b-4192-8d3e-b97a939bd03f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:25.402345 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18f74b-bb7b-4192-8d3e-b97a939bd03f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:25.403907 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18f74b-bb7b-4192-8d3e-b97a939bd03f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:25.416057 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 263/526] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:25.421536 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8f326-68c9-4fd5-8d74-7be78c975eb2 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:25.430674 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8f326-68c9-4fd5-8d74-7be78c975eb2 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:25.434780 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fa364-8cbe-49e2-998f-628effa3a9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:25.435361 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fa364-8cbe-49e2-998f-628effa3a9a6 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:25.435650 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fa364-8cbe-49e2-998f-628effa3a9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:25.435932 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fa364-8cbe-49e2-998f-628effa3a9a6 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:25.436581 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fa364-8cbe-49e2-998f-628effa3a9a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:25.438619 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fa364-8cbe-49e2-998f-628effa3a9a6 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:25.458934 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 264/527] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Dec 16 14:24:25 2021] POST /identity/v3/users => generated 248 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:24:27.539438 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d93558-de85-4a14-bf20-885faedc6e7d None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:27.539963 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d93558-de85-4a14-bf20-885faedc6e7d None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:27.540076 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d93558-de85-4a14-bf20-885faedc6e7d None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:27.542289 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 264/528] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:24:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:27.547288 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d56168-88c4-4669-a114-59991cfd10dc None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:27.547685 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d56168-88c4-4669-a114-59991cfd10dc None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:27.547851 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d56168-88c4-4669-a114-59991cfd10dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:27.570107 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-c8d56168-88c4-4669-a114-59991cfd10dc None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:27.571236 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-c8d56168-88c4-4669-a114-59991cfd10dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:27.578001 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 265/529] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:27 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:24:27.600969 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d93558-de85-4a14-bf20-885faedc6e7d None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:27.613188 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d93558-de85-4a14-bf20-885faedc6e7d None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:27.617193 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0440659-9f2b-4194-89e7-883d5cd1012a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:27.617895 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0440659-9f2b-4194-89e7-883d5cd1012a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:27.618184 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0440659-9f2b-4194-89e7-883d5cd1012a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:27.618466 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0440659-9f2b-4194-89e7-883d5cd1012a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:27.630234 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0440659-9f2b-4194-89e7-883d5cd1012a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:24:27.636610 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-a0440659-9f2b-4194-89e7-883d5cd1012a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:24:27.637722 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 265/530] 10.222.0.64 () {56 vars in 1123 bytes} [Thu Dec 16 14:24:27 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:27.643264 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d56168-88c4-4669-a114-59991cfd10dc None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:27.651718 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d56168-88c4-4669-a114-59991cfd10dc None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:27.655806 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef057af-ef5d-4b2e-8e00-c64da6d5fb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:27.656392 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef057af-ef5d-4b2e-8e00-c64da6d5fb86 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:27.656679 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef057af-ef5d-4b2e-8e00-c64da6d5fb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:27.657001 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef057af-ef5d-4b2e-8e00-c64da6d5fb86 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:27.657704 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef057af-ef5d-4b2e-8e00-c64da6d5fb86 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:27.658003 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef057af-ef5d-4b2e-8e00-c64da6d5fb86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:27.659681 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef057af-ef5d-4b2e-8e00-c64da6d5fb86 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:27.668491 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 266/531] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Dec 16 14:24:27 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:27.673905 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0440659-9f2b-4194-89e7-883d5cd1012a admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:27.684206 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0440659-9f2b-4194-89e7-883d5cd1012a admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:27.688396 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030be96-ca7b-4d15-8f8d-6056a5903020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:27.689127 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030be96-ca7b-4d15-8f8d-6056a5903020 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:27.689421 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030be96-ca7b-4d15-8f8d-6056a5903020 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:27.689703 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030be96-ca7b-4d15-8f8d-6056a5903020 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:27.700992 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030be96-ca7b-4d15-8f8d-6056a5903020 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:27.702806 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030be96-ca7b-4d15-8f8d-6056a5903020 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:27.719659 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-9030be96-ca7b-4d15-8f8d-6056a5903020 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:27.720736 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 266/532] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:27.726344 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef057af-ef5d-4b2e-8e00-c64da6d5fb86 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:27.736136 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef057af-ef5d-4b2e-8e00-c64da6d5fb86 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:27.740272 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98798ef-cebf-482d-ba7b-fc9d4f6cff07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:27.740890 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98798ef-cebf-482d-ba7b-fc9d4f6cff07 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:27.741184 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98798ef-cebf-482d-ba7b-fc9d4f6cff07 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:27.741471 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98798ef-cebf-482d-ba7b-fc9d4f6cff07 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:27.742157 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98798ef-cebf-482d-ba7b-fc9d4f6cff07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:27.742460 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98798ef-cebf-482d-ba7b-fc9d4f6cff07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:27.744717 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98798ef-cebf-482d-ba7b-fc9d4f6cff07 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:27.756857 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 267/533] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:27.762406 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030be96-ca7b-4d15-8f8d-6056a5903020 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:27.772233 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030be96-ca7b-4d15-8f8d-6056a5903020 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:27.777524 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abed1df-1177-4062-9daa-c95a49505c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:27.778243 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abed1df-1177-4062-9daa-c95a49505c53 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:27.778537 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abed1df-1177-4062-9daa-c95a49505c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:27.778824 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abed1df-1177-4062-9daa-c95a49505c53 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:27.792113 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abed1df-1177-4062-9daa-c95a49505c53 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:27.794079 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abed1df-1177-4062-9daa-c95a49505c53 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:27.811524 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-3abed1df-1177-4062-9daa-c95a49505c53 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 16 14:24:27.812606 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 267/534] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:24:27 2021] GET /identity/v3/users/glance => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:27.818522 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98798ef-cebf-482d-ba7b-fc9d4f6cff07 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:27.827871 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98798ef-cebf-482d-ba7b-fc9d4f6cff07 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:27.831974 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d0cd9-ab71-4d83-abf2-a4fa05121f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:27.832565 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d0cd9-ab71-4d83-abf2-a4fa05121f23 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:27.832896 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d0cd9-ab71-4d83-abf2-a4fa05121f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:27.833181 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d0cd9-ab71-4d83-abf2-a4fa05121f23 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:27.834020 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d0cd9-ab71-4d83-abf2-a4fa05121f23 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:27.834307 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d0cd9-ab71-4d83-abf2-a4fa05121f23 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:27.836124 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d0cd9-ab71-4d83-abf2-a4fa05121f23 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:27.864811 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 268/535] 10.222.0.64 () {56 vars in 1158 bytes} [Thu Dec 16 14:24:27 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:24:27.870364 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abed1df-1177-4062-9daa-c95a49505c53 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:27.879641 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abed1df-1177-4062-9daa-c95a49505c53 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:27.884114 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b72139-4239-4e6f-ae50-d926d3816002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:27.884688 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b72139-4239-4e6f-ae50-d926d3816002 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:27.885012 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b72139-4239-4e6f-ae50-d926d3816002 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:27.885298 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b72139-4239-4e6f-ae50-d926d3816002 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:27.893031 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b72139-4239-4e6f-ae50-d926d3816002 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:27.894777 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b72139-4239-4e6f-ae50-d926d3816002 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:27.903514 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 268/536] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:24:27 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:24:27.909063 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d0cd9-ab71-4d83-abf2-a4fa05121f23 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:27.918936 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d0cd9-ab71-4d83-abf2-a4fa05121f23 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:27.923140 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b1ca3-1035-4ca5-a1b7-840144f225d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:27.923856 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1ca3-1035-4ca5-a1b7-840144f225d8 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:27.924145 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1ca3-1035-4ca5-a1b7-840144f225d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:27.924426 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1ca3-1035-4ca5-a1b7-840144f225d8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:27.935724 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b1ca3-1035-4ca5-a1b7-840144f225d8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:27.937563 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b1ca3-1035-4ca5-a1b7-840144f225d8 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:27.954068 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-830b1ca3-1035-4ca5-a1b7-840144f225d8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:27.955118 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 269/537] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:27.960514 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b72139-4239-4e6f-ae50-d926d3816002 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:27.969544 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b72139-4239-4e6f-ae50-d926d3816002 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:27.973753 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c90cb-ecbc-4730-ac9c-95bd17c5947f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:27.974328 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c90cb-ecbc-4730-ac9c-95bd17c5947f admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:27.974619 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c90cb-ecbc-4730-ac9c-95bd17c5947f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:27.974902 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c90cb-ecbc-4730-ac9c-95bd17c5947f admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:27.975584 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c90cb-ecbc-4730-ac9c-95bd17c5947f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:27.975884 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c90cb-ecbc-4730-ac9c-95bd17c5947f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:27.977482 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c90cb-ecbc-4730-ac9c-95bd17c5947f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:27.990389 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 269/538] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:27.995605 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b1ca3-1035-4ca5-a1b7-840144f225d8 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:28.004730 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b1ca3-1035-4ca5-a1b7-840144f225d8 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:28.008799 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83f955-e2c9-4c60-855c-fe767447d385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:28.009677 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83f955-e2c9-4c60-855c-fe767447d385 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:28.010134 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83f955-e2c9-4c60-855c-fe767447d385 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:28.010451 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83f955-e2c9-4c60-855c-fe767447d385 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:28.020091 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83f955-e2c9-4c60-855c-fe767447d385 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:28.022055 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83f955-e2c9-4c60-855c-fe767447d385 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:28.035924 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-0a83f955-e2c9-4c60-855c-fe767447d385 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:24:28.037063 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 270/539] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:24:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:28.043797 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c90cb-ecbc-4730-ac9c-95bd17c5947f admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:28.054146 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c90cb-ecbc-4730-ac9c-95bd17c5947f admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:28.058307 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ee1ed-f478-4325-8df9-aacdaf278507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:28.058887 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ee1ed-f478-4325-8df9-aacdaf278507 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:28.059176 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ee1ed-f478-4325-8df9-aacdaf278507 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:28.059462 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ee1ed-f478-4325-8df9-aacdaf278507 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:28.060209 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ee1ed-f478-4325-8df9-aacdaf278507 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:28.060514 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ee1ed-f478-4325-8df9-aacdaf278507 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:28.062550 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ee1ed-f478-4325-8df9-aacdaf278507 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:28.075984 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 270/540] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:24:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:28.081929 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83f955-e2c9-4c60-855c-fe767447d385 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:28.091568 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83f955-e2c9-4c60-855c-fe767447d385 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:28.095574 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e690d-fc56-48d6-86f8-d5172bb79d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:28.096142 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e690d-fc56-48d6-86f8-d5172bb79d7c admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:28.096429 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e690d-fc56-48d6-86f8-d5172bb79d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:28.096710 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e690d-fc56-48d6-86f8-d5172bb79d7c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:28.097508 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e690d-fc56-48d6-86f8-d5172bb79d7c admin admin] RBAC: Adding query filter params (role.id=07f29be2087e43caaf6845ecf113b6e7, scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55, user.id=2ccebf28ac494f608c33437fc34139be) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:28.097811 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e690d-fc56-48d6-86f8-d5172bb79d7c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:28.099622 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e690d-fc56-48d6-86f8-d5172bb79d7c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:28.105331 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 271/541] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:24:28 2021] GET /identity/v3/role_assignments?user.id=2ccebf28ac494f608c33437fc34139be&scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55&role.id=07f29be2087e43caaf6845ecf113b6e7 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:30.159840 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b0bf8-412e-40ae-9b71-97525341f9f3 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:30.160352 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b0bf8-412e-40ae-9b71-97525341f9f3 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:30.160352 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b0bf8-412e-40ae-9b71-97525341f9f3 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:30.162021 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 271/542] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:24:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:30.167407 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9fc5f-82f5-468e-94cd-360cf81ff4e8 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:30.167822 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9fc5f-82f5-468e-94cd-360cf81ff4e8 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:30.168005 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9fc5f-82f5-468e-94cd-360cf81ff4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:30.190319 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-7ca9fc5f-82f5-468e-94cd-360cf81ff4e8 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:30.191459 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-7ca9fc5f-82f5-468e-94cd-360cf81ff4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:30.199235 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 272/543] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:30 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:30.221060 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b0bf8-412e-40ae-9b71-97525341f9f3 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:30.232718 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b0bf8-412e-40ae-9b71-97525341f9f3 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:30.236907 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd7936-10fb-472a-9e79-75807e8991f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:30.237616 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd7936-10fb-472a-9e79-75807e8991f6 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:30.237909 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd7936-10fb-472a-9e79-75807e8991f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:30.238193 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd7936-10fb-472a-9e79-75807e8991f6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:30.249936 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd7936-10fb-472a-9e79-75807e8991f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:24:30.256247 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-99fd7936-10fb-472a-9e79-75807e8991f6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:24:30.257381 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 272/544] 10.222.0.64 () {56 vars in 1123 bytes} [Thu Dec 16 14:24:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:30.263881 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9fc5f-82f5-468e-94cd-360cf81ff4e8 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:30.272565 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9fc5f-82f5-468e-94cd-360cf81ff4e8 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:30.276922 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cc123-b6e2-4b4a-baff-ad00560e1993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:30.277517 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cc123-b6e2-4b4a-baff-ad00560e1993 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:30.277808 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cc123-b6e2-4b4a-baff-ad00560e1993 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:30.278094 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cc123-b6e2-4b4a-baff-ad00560e1993 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:30.278811 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3cc123-b6e2-4b4a-baff-ad00560e1993 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:30.279115 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3cc123-b6e2-4b4a-baff-ad00560e1993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:30.280692 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3cc123-b6e2-4b4a-baff-ad00560e1993 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:30.288975 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 273/545] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Dec 16 14:24:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:30.294502 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd7936-10fb-472a-9e79-75807e8991f6 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:30.305594 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd7936-10fb-472a-9e79-75807e8991f6 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:30.310198 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ee2ae-45fc-4ba4-8450-123ecd7ddc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:30.310894 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ee2ae-45fc-4ba4-8450-123ecd7ddc94 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:30.311184 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ee2ae-45fc-4ba4-8450-123ecd7ddc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:30.311464 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ee2ae-45fc-4ba4-8450-123ecd7ddc94 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:30.323215 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ee2ae-45fc-4ba4-8450-123ecd7ddc94 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:30.325032 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ee2ae-45fc-4ba4-8450-123ecd7ddc94 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:30.341556 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-eb1ee2ae-45fc-4ba4-8450-123ecd7ddc94 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:30.342596 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 273/546] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:30.347988 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cc123-b6e2-4b4a-baff-ad00560e1993 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:30.357049 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cc123-b6e2-4b4a-baff-ad00560e1993 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:30.361121 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3aedef-d2e7-4c53-8d90-3fabc4fb0ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:30.361698 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aedef-d2e7-4c53-8d90-3fabc4fb0ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:30.361984 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aedef-d2e7-4c53-8d90-3fabc4fb0ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:30.362264 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aedef-d2e7-4c53-8d90-3fabc4fb0ba0 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:30.362940 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3aedef-d2e7-4c53-8d90-3fabc4fb0ba0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:30.363237 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3aedef-d2e7-4c53-8d90-3fabc4fb0ba0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:30.364808 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3aedef-d2e7-4c53-8d90-3fabc4fb0ba0 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:30.380478 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 274/547] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:30.387722 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ee2ae-45fc-4ba4-8450-123ecd7ddc94 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:30.397128 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ee2ae-45fc-4ba4-8450-123ecd7ddc94 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:30.401316 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfcd03-fce9-471c-ac2d-92baad7c5717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:30.402025 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfcd03-fce9-471c-ac2d-92baad7c5717 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:30.402315 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfcd03-fce9-471c-ac2d-92baad7c5717 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:30.402597 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfcd03-fce9-471c-ac2d-92baad7c5717 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:30.415030 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bfcd03-fce9-471c-ac2d-92baad7c5717 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:30.417500 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bfcd03-fce9-471c-ac2d-92baad7c5717 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:30.435267 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-17bfcd03-fce9-471c-ac2d-92baad7c5717 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 16 14:24:30.436327 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 274/548] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:24:30 2021] GET /identity/v3/users/glance => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:30.441903 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3aedef-d2e7-4c53-8d90-3fabc4fb0ba0 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:30.451407 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3aedef-d2e7-4c53-8d90-3fabc4fb0ba0 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:30.455495 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db654d3d-9eb1-425c-8679-46980d6125e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:30.456084 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db654d3d-9eb1-425c-8679-46980d6125e1 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:30.456375 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db654d3d-9eb1-425c-8679-46980d6125e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:30.456665 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db654d3d-9eb1-425c-8679-46980d6125e1 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:30.457489 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db654d3d-9eb1-425c-8679-46980d6125e1 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:30.457795 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db654d3d-9eb1-425c-8679-46980d6125e1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:30.459614 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db654d3d-9eb1-425c-8679-46980d6125e1 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:30.488956 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 275/549] 10.222.0.64 () {56 vars in 1158 bytes} [Thu Dec 16 14:24:30 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:30.494901 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfcd03-fce9-471c-ac2d-92baad7c5717 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:30.504162 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfcd03-fce9-471c-ac2d-92baad7c5717 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:30.508297 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503a1a2-5295-4527-b0b7-91d6187167ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:30.509041 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503a1a2-5295-4527-b0b7-91d6187167ce admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:30.509335 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503a1a2-5295-4527-b0b7-91d6187167ce admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:30.509619 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503a1a2-5295-4527-b0b7-91d6187167ce admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:30.521141 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503a1a2-5295-4527-b0b7-91d6187167ce admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:30.522937 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503a1a2-5295-4527-b0b7-91d6187167ce admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:30.539389 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-6503a1a2-5295-4527-b0b7-91d6187167ce admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:30.541035 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 275/550] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:30.546433 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db654d3d-9eb1-425c-8679-46980d6125e1 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:30.555572 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db654d3d-9eb1-425c-8679-46980d6125e1 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:30.560315 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f65bcc-d422-473d-add7-79d151344aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:30.560932 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f65bcc-d422-473d-add7-79d151344aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:30.561220 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f65bcc-d422-473d-add7-79d151344aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:30.561503 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f65bcc-d422-473d-add7-79d151344aa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:30.562183 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f65bcc-d422-473d-add7-79d151344aa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:30.562483 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f65bcc-d422-473d-add7-79d151344aa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:30.564047 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f65bcc-d422-473d-add7-79d151344aa7 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:30.576525 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 276/551] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:30.581746 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503a1a2-5295-4527-b0b7-91d6187167ce admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:30.591577 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503a1a2-5295-4527-b0b7-91d6187167ce admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:30.596612 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c7259-3ad3-473a-89a4-027e831a57a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:30.597354 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c7259-3ad3-473a-89a4-027e831a57a1 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:30.597647 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c7259-3ad3-473a-89a4-027e831a57a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:30.597932 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c7259-3ad3-473a-89a4-027e831a57a1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:30.606399 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c7259-3ad3-473a-89a4-027e831a57a1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:30.608332 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c7259-3ad3-473a-89a4-027e831a57a1 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:30.621587 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-0e0c7259-3ad3-473a-89a4-027e831a57a1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:24:30.622640 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 276/552] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:24:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:30.628538 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f65bcc-d422-473d-add7-79d151344aa7 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:30.638160 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f65bcc-d422-473d-add7-79d151344aa7 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:30.642238 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069f394-edb1-496a-a7c4-968c0558448b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:30.642813 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069f394-edb1-496a-a7c4-968c0558448b admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:30.643096 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069f394-edb1-496a-a7c4-968c0558448b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:30.643373 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069f394-edb1-496a-a7c4-968c0558448b admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:30.644104 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069f394-edb1-496a-a7c4-968c0558448b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:30.644401 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069f394-edb1-496a-a7c4-968c0558448b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:30.646255 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069f394-edb1-496a-a7c4-968c0558448b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:30.659051 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 277/553] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:24:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:30.664867 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c7259-3ad3-473a-89a4-027e831a57a1 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:30.674362 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c7259-3ad3-473a-89a4-027e831a57a1 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:30.679669 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51faa2-ea44-45a2-a7a4-bd5f95c796c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:30.680466 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51faa2-ea44-45a2-a7a4-bd5f95c796c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:30.680756 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51faa2-ea44-45a2-a7a4-bd5f95c796c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:30.681102 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51faa2-ea44-45a2-a7a4-bd5f95c796c6 admin admin] PATH_INFO: `/v3/projects/244c8ef98d0445c6a0279c46d5cb7e55/users/2ccebf28ac494f608c33437fc34139be/roles/07f29be2087e43caaf6845ecf113b6e7` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:30.700987 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51faa2-ea44-45a2-a7a4-bd5f95c796c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=244c8ef98d0445c6a0279c46d5cb7e55, user_id=2ccebf28ac494f608c33437fc34139be, role_id=07f29be2087e43caaf6845ecf113b6e7)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:30.703602 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51faa2-ea44-45a2-a7a4-bd5f95c796c6 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:30.717471 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 277/554] 10.222.0.64 () {58 vars in 1460 bytes} [Thu Dec 16 14:24:30 2021] PUT /identity/v3/projects/244c8ef98d0445c6a0279c46d5cb7e55/users/2ccebf28ac494f608c33437fc34139be/roles/07f29be2087e43caaf6845ecf113b6e7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:24:32.758283 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4a172-a2a6-4f98-917b-7077187e3a23 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:32.758811 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4a172-a2a6-4f98-917b-7077187e3a23 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:32.759402 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4a172-a2a6-4f98-917b-7077187e3a23 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:32.761758 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 278/555] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:24:32 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:32.766892 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145901ba-5cad-410f-87e9-46f513b58000 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:32.767309 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145901ba-5cad-410f-87e9-46f513b58000 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:32.767462 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145901ba-5cad-410f-87e9-46f513b58000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:32.789581 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-145901ba-5cad-410f-87e9-46f513b58000 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:32.790742 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-145901ba-5cad-410f-87e9-46f513b58000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:32.853327 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 278/556] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:32 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:32.876044 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4a172-a2a6-4f98-917b-7077187e3a23 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:32.888195 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4a172-a2a6-4f98-917b-7077187e3a23 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:32.892164 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78e723-3bfc-4009-aca0-782013ddba8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:32.893030 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78e723-3bfc-4009-aca0-782013ddba8b admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:32.893323 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78e723-3bfc-4009-aca0-782013ddba8b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:32.893603 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78e723-3bfc-4009-aca0-782013ddba8b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:32.905079 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78e723-3bfc-4009-aca0-782013ddba8b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:24:32.911358 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-fb78e723-3bfc-4009-aca0-782013ddba8b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:24:32.912416 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 279/557] 10.222.0.64 () {56 vars in 1123 bytes} [Thu Dec 16 14:24:32 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:32.918054 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145901ba-5cad-410f-87e9-46f513b58000 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:32.926506 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145901ba-5cad-410f-87e9-46f513b58000 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:32.930684 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8de708-25ac-4a7c-883d-5209cf3a257b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:32.931296 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8de708-25ac-4a7c-883d-5209cf3a257b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:32.931587 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8de708-25ac-4a7c-883d-5209cf3a257b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:32.931872 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8de708-25ac-4a7c-883d-5209cf3a257b admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:32.932578 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8de708-25ac-4a7c-883d-5209cf3a257b admin admin] RBAC: Adding query filter params (name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:32.932921 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8de708-25ac-4a7c-883d-5209cf3a257b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:32.934587 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8de708-25ac-4a7c-883d-5209cf3a257b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:32.943012 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 279/558] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Dec 16 14:24:32 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:32.948801 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78e723-3bfc-4009-aca0-782013ddba8b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:32.958434 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78e723-3bfc-4009-aca0-782013ddba8b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:32.963135 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6afa0d-8b35-42ae-a9a3-16575ce18332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:32.963832 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6afa0d-8b35-42ae-a9a3-16575ce18332 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:32.964123 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6afa0d-8b35-42ae-a9a3-16575ce18332 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:32.964407 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6afa0d-8b35-42ae-a9a3-16575ce18332 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:32.975334 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6afa0d-8b35-42ae-a9a3-16575ce18332 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:32.977218 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6afa0d-8b35-42ae-a9a3-16575ce18332 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:32.993903 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-5a6afa0d-8b35-42ae-a9a3-16575ce18332 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:32.994942 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 280/559] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:33.000253 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8de708-25ac-4a7c-883d-5209cf3a257b admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:33.009999 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8de708-25ac-4a7c-883d-5209cf3a257b admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:33.014110 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927223b-c76d-4e18-8727-bdc63de2a594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:33.014690 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927223b-c76d-4e18-8727-bdc63de2a594 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:33.014982 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927223b-c76d-4e18-8727-bdc63de2a594 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:33.015268 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927223b-c76d-4e18-8727-bdc63de2a594 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:33.015947 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927223b-c76d-4e18-8727-bdc63de2a594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:33.016247 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927223b-c76d-4e18-8727-bdc63de2a594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:33.017839 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927223b-c76d-4e18-8727-bdc63de2a594 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:33.030662 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 280/560] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:33.035836 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6afa0d-8b35-42ae-a9a3-16575ce18332 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:33.045176 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6afa0d-8b35-42ae-a9a3-16575ce18332 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:33.049619 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9cc26-9304-43a6-80c3-d220da27536b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:33.050336 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9cc26-9304-43a6-80c3-d220da27536b admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:33.050627 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9cc26-9304-43a6-80c3-d220da27536b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:33.050913 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9cc26-9304-43a6-80c3-d220da27536b admin admin] PATH_INFO: `/v3/users/glance` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:33.063969 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9cc26-9304-43a6-80c3-d220da27536b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:33.066005 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9cc26-9304-43a6-80c3-d220da27536b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:33.084132 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-3ac9cc26-9304-43a6-80c3-d220da27536b admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 16 14:24:33.085228 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 281/561] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:24:33 2021] GET /identity/v3/users/glance => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:33.090684 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927223b-c76d-4e18-8727-bdc63de2a594 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:33.099831 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927223b-c76d-4e18-8727-bdc63de2a594 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:33.103931 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472174a-ec3a-4855-8f83-08cd66d2b0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:33.104516 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472174a-ec3a-4855-8f83-08cd66d2b0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:33.104834 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472174a-ec3a-4855-8f83-08cd66d2b0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:33.105119 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472174a-ec3a-4855-8f83-08cd66d2b0a1 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:33.105894 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472174a-ec3a-4855-8f83-08cd66d2b0a1 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:33.106195 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472174a-ec3a-4855-8f83-08cd66d2b0a1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:33.108019 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472174a-ec3a-4855-8f83-08cd66d2b0a1 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:33.136408 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 281/562] 10.222.0.64 () {56 vars in 1158 bytes} [Thu Dec 16 14:24:33 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:33.142318 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9cc26-9304-43a6-80c3-d220da27536b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:33.152814 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9cc26-9304-43a6-80c3-d220da27536b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:33.157107 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d5979-dd4b-4ba5-bbc3-21cb2b78c731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:33.157678 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d5979-dd4b-4ba5-bbc3-21cb2b78c731 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:33.157970 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d5979-dd4b-4ba5-bbc3-21cb2b78c731 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:33.158251 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d5979-dd4b-4ba5-bbc3-21cb2b78c731 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:33.165920 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d5979-dd4b-4ba5-bbc3-21cb2b78c731 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:33.167630 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d5979-dd4b-4ba5-bbc3-21cb2b78c731 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:33.175850 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 282/563] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:24:33 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:24:33.181797 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472174a-ec3a-4855-8f83-08cd66d2b0a1 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:33.190976 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472174a-ec3a-4855-8f83-08cd66d2b0a1 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:33.195511 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5d66d-a297-46f4-a4d6-798c6b60609b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:33.196223 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5d66d-a297-46f4-a4d6-798c6b60609b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:33.197195 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5d66d-a297-46f4-a4d6-798c6b60609b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:33.197412 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5d66d-a297-46f4-a4d6-798c6b60609b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:33.210159 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c5d66d-a297-46f4-a4d6-798c6b60609b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:33.211967 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c5d66d-a297-46f4-a4d6-798c6b60609b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:33.228309 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-89c5d66d-a297-46f4-a4d6-798c6b60609b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:33.229397 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 282/564] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:33.234731 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d5979-dd4b-4ba5-bbc3-21cb2b78c731 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:33.243121 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d5979-dd4b-4ba5-bbc3-21cb2b78c731 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:33.247871 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6d069-9f94-48d9-b4f5-45374f900b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:33.248454 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6d069-9f94-48d9-b4f5-45374f900b1f admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:33.248754 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6d069-9f94-48d9-b4f5-45374f900b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:33.249055 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6d069-9f94-48d9-b4f5-45374f900b1f admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:33.249743 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed6d069-9f94-48d9-b4f5-45374f900b1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:33.250043 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed6d069-9f94-48d9-b4f5-45374f900b1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:33.251612 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed6d069-9f94-48d9-b4f5-45374f900b1f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:33.264813 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 283/565] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:33.270389 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5d66d-a297-46f4-a4d6-798c6b60609b admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:33.279701 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5d66d-a297-46f4-a4d6-798c6b60609b admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:33.283818 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51605e47-e48e-4c0b-afbf-1e513ea5bc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:33.284521 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51605e47-e48e-4c0b-afbf-1e513ea5bc4a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:33.284844 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51605e47-e48e-4c0b-afbf-1e513ea5bc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:33.285133 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51605e47-e48e-4c0b-afbf-1e513ea5bc4a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:33.293416 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51605e47-e48e-4c0b-afbf-1e513ea5bc4a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:33.295346 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51605e47-e48e-4c0b-afbf-1e513ea5bc4a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:33.309032 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-51605e47-e48e-4c0b-afbf-1e513ea5bc4a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:24:33.310074 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 283/566] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:24:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:33.315769 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6d069-9f94-48d9-b4f5-45374f900b1f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:33.326925 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6d069-9f94-48d9-b4f5-45374f900b1f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:33.331212 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29867726-d219-4ed5-8e5c-379f33f3e148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:33.331833 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29867726-d219-4ed5-8e5c-379f33f3e148 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:33.332127 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29867726-d219-4ed5-8e5c-379f33f3e148 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:33.332411 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29867726-d219-4ed5-8e5c-379f33f3e148 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:33.333208 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29867726-d219-4ed5-8e5c-379f33f3e148 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:33.333516 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29867726-d219-4ed5-8e5c-379f33f3e148 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:33.335386 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29867726-d219-4ed5-8e5c-379f33f3e148 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:33.347896 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 284/567] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:24:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:33.353615 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51605e47-e48e-4c0b-afbf-1e513ea5bc4a admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:33.362651 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51605e47-e48e-4c0b-afbf-1e513ea5bc4a admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:33.366832 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f57550-719f-438f-ac05-ab2472524a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:33.367396 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f57550-719f-438f-ac05-ab2472524a5b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:33.367685 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f57550-719f-438f-ac05-ab2472524a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:33.367963 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f57550-719f-438f-ac05-ab2472524a5b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:33.369322 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f57550-719f-438f-ac05-ab2472524a5b admin admin] RBAC: Adding query filter params (role.id=07f29be2087e43caaf6845ecf113b6e7, scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55, user.id=2ccebf28ac494f608c33437fc34139be) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:33.369624 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f57550-719f-438f-ac05-ab2472524a5b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:33.371414 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f57550-719f-438f-ac05-ab2472524a5b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:33.376917 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 284/568] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:24:33 2021] GET /identity/v3/role_assignments?user.id=2ccebf28ac494f608c33437fc34139be&scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55&role.id=07f29be2087e43caaf6845ecf113b6e7 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:24:35.473808 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41468852-7495-45ca-9d9d-ce78f3344fe6 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:35.474351 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41468852-7495-45ca-9d9d-ce78f3344fe6 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:35.474351 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41468852-7495-45ca-9d9d-ce78f3344fe6 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:35.476052 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 285/569] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:24:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:35.481775 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03384cc1-253f-481d-9be2-0e0d3063eb8c None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:35.482185 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03384cc1-253f-481d-9be2-0e0d3063eb8c None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:35.482335 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03384cc1-253f-481d-9be2-0e0d3063eb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:35.503851 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-03384cc1-253f-481d-9be2-0e0d3063eb8c None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:35.505029 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-03384cc1-253f-481d-9be2-0e0d3063eb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:35.511838 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 285/570] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:35 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:35.535578 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41468852-7495-45ca-9d9d-ce78f3344fe6 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:35.547954 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41468852-7495-45ca-9d9d-ce78f3344fe6 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:35.551906 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d41a9-80c3-4cc6-87c7-9e8e8c02711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:35.552614 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d41a9-80c3-4cc6-87c7-9e8e8c02711a admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:35.552945 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d41a9-80c3-4cc6-87c7-9e8e8c02711a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:35.553233 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d41a9-80c3-4cc6-87c7-9e8e8c02711a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:35.564864 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d41a9-80c3-4cc6-87c7-9e8e8c02711a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:35.567228 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d41a9-80c3-4cc6-87c7-9e8e8c02711a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:35.583710 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-536d41a9-80c3-4cc6-87c7-9e8e8c02711a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:35.584756 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 286/571] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:35.590868 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03384cc1-253f-481d-9be2-0e0d3063eb8c None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:35.599301 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03384cc1-253f-481d-9be2-0e0d3063eb8c None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:35.604084 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244db46-546f-4243-9825-bfb89daaa3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:35.604664 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244db46-546f-4243-9825-bfb89daaa3cf admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:35.604979 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244db46-546f-4243-9825-bfb89daaa3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:35.605263 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244db46-546f-4243-9825-bfb89daaa3cf admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:35.605945 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244db46-546f-4243-9825-bfb89daaa3cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:35.606244 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244db46-546f-4243-9825-bfb89daaa3cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:35.607802 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244db46-546f-4243-9825-bfb89daaa3cf admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:35.619764 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 286/572] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:35.624999 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d41a9-80c3-4cc6-87c7-9e8e8c02711a admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:35.634876 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d41a9-80c3-4cc6-87c7-9e8e8c02711a admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:35.639038 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1d2ab-0215-4291-84d5-25570e19c96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:35.639625 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1d2ab-0215-4291-84d5-25570e19c96e admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:35.639915 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1d2ab-0215-4291-84d5-25570e19c96e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:35.640201 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1d2ab-0215-4291-84d5-25570e19c96e admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:35.640891 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1d2ab-0215-4291-84d5-25570e19c96e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:35.642762 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1d2ab-0215-4291-84d5-25570e19c96e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:35.663240 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 287/573] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Dec 16 14:24:35 2021] POST /identity/v3/users => generated 254 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:24:37.760937 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd53582-61cc-4ed7-9e26-57657a964371 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:37.761494 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd53582-61cc-4ed7-9e26-57657a964371 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:37.761494 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd53582-61cc-4ed7-9e26-57657a964371 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:37.763171 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 287/574] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:24:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:37.768526 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a131462-d397-4e57-84ee-3c37c49afa54 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:37.768998 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a131462-d397-4e57-84ee-3c37c49afa54 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:37.769127 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a131462-d397-4e57-84ee-3c37c49afa54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:37.792275 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-8a131462-d397-4e57-84ee-3c37c49afa54 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:37.793457 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-8a131462-d397-4e57-84ee-3c37c49afa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:37.800427 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 288/575] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:37 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:37.824913 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd53582-61cc-4ed7-9e26-57657a964371 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:37.837257 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd53582-61cc-4ed7-9e26-57657a964371 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:37.841338 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41f872-74fa-4e4a-bd64-b65f0dfca112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:37.842045 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41f872-74fa-4e4a-bd64-b65f0dfca112 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:37.842336 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41f872-74fa-4e4a-bd64-b65f0dfca112 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:37.842627 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41f872-74fa-4e4a-bd64-b65f0dfca112 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:37.854293 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41f872-74fa-4e4a-bd64-b65f0dfca112 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:24:37.860609 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-1c41f872-74fa-4e4a-bd64-b65f0dfca112 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:24:37.861725 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 288/576] 10.222.0.64 () {56 vars in 1123 bytes} [Thu Dec 16 14:24:37 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:37.867417 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a131462-d397-4e57-84ee-3c37c49afa54 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:37.876000 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a131462-d397-4e57-84ee-3c37c49afa54 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:37.880383 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5242a95-cab2-4597-b358-c942e16fa098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:37.881007 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5242a95-cab2-4597-b358-c942e16fa098 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:37.881295 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5242a95-cab2-4597-b358-c942e16fa098 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:37.881575 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5242a95-cab2-4597-b358-c942e16fa098 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:37.882282 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5242a95-cab2-4597-b358-c942e16fa098 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:37.882581 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5242a95-cab2-4597-b358-c942e16fa098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:37.884711 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5242a95-cab2-4597-b358-c942e16fa098 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:37.893051 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 289/577] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Dec 16 14:24:37 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:37.898565 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41f872-74fa-4e4a-bd64-b65f0dfca112 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:37.909025 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41f872-74fa-4e4a-bd64-b65f0dfca112 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:37.913275 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05f717-b7c2-42a9-aa2b-5abd69d5bf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:37.913921 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05f717-b7c2-42a9-aa2b-5abd69d5bf95 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:37.914212 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05f717-b7c2-42a9-aa2b-5abd69d5bf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:37.914494 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05f717-b7c2-42a9-aa2b-5abd69d5bf95 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:37.925850 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05f717-b7c2-42a9-aa2b-5abd69d5bf95 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:37.927648 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05f717-b7c2-42a9-aa2b-5abd69d5bf95 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:37.944706 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-3e05f717-b7c2-42a9-aa2b-5abd69d5bf95 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:37.945790 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 289/578] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:37.952368 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5242a95-cab2-4597-b358-c942e16fa098 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:37.961670 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5242a95-cab2-4597-b358-c942e16fa098 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:37.966806 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6953a4-0758-413b-8c47-68f47514b913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:37.967388 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6953a4-0758-413b-8c47-68f47514b913 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:37.967672 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6953a4-0758-413b-8c47-68f47514b913 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:37.967950 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6953a4-0758-413b-8c47-68f47514b913 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:37.968634 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6953a4-0758-413b-8c47-68f47514b913 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:37.968966 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6953a4-0758-413b-8c47-68f47514b913 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:37.970524 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6953a4-0758-413b-8c47-68f47514b913 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:37.982402 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 290/579] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:37.987590 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05f717-b7c2-42a9-aa2b-5abd69d5bf95 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:37.996733 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05f717-b7c2-42a9-aa2b-5abd69d5bf95 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:38.000910 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a9fcc-d7b3-453a-8f59-a29e052420d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:38.001624 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a9fcc-d7b3-453a-8f59-a29e052420d9 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:38.001913 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a9fcc-d7b3-453a-8f59-a29e052420d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:38.002198 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a9fcc-d7b3-453a-8f59-a29e052420d9 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:38.015072 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a9fcc-d7b3-453a-8f59-a29e052420d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:38.017025 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a9fcc-d7b3-453a-8f59-a29e052420d9 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:38.035588 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-0c2a9fcc-d7b3-453a-8f59-a29e052420d9 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 16 14:24:38.036703 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 290/580] 10.222.0.64 () {56 vars in 1138 bytes} [Thu Dec 16 14:24:37 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:24:38.042377 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6953a4-0758-413b-8c47-68f47514b913 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:38.051602 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6953a4-0758-413b-8c47-68f47514b913 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:38.055716 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adfa57-cb4d-4b4e-ab19-6a30531d3fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:38.056301 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adfa57-cb4d-4b4e-ab19-6a30531d3fcd admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:38.056587 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adfa57-cb4d-4b4e-ab19-6a30531d3fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:38.056900 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adfa57-cb4d-4b4e-ab19-6a30531d3fcd admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:38.057682 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adfa57-cb4d-4b4e-ab19-6a30531d3fcd admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:38.057982 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adfa57-cb4d-4b4e-ab19-6a30531d3fcd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:38.059797 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adfa57-cb4d-4b4e-ab19-6a30531d3fcd admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:38.089861 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 291/581] 10.222.0.64 () {56 vars in 1170 bytes} [Thu Dec 16 14:24:38 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:38.095399 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a9fcc-d7b3-453a-8f59-a29e052420d9 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:38.104655 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a9fcc-d7b3-453a-8f59-a29e052420d9 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:38.108763 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0901f3f-1c4f-4a72-a70e-0f69e11cfb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:38.109355 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0901f3f-1c4f-4a72-a70e-0f69e11cfb53 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:38.109647 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0901f3f-1c4f-4a72-a70e-0f69e11cfb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:38.109938 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0901f3f-1c4f-4a72-a70e-0f69e11cfb53 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:38.117394 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0901f3f-1c4f-4a72-a70e-0f69e11cfb53 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:38.119175 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0901f3f-1c4f-4a72-a70e-0f69e11cfb53 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:38.127406 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 291/582] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:24:38 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:24:38.132714 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adfa57-cb4d-4b4e-ab19-6a30531d3fcd admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:38.142588 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adfa57-cb4d-4b4e-ab19-6a30531d3fcd admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:38.146859 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10f5ac-3b80-4bf1-ba64-199d91b7e203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:38.147576 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10f5ac-3b80-4bf1-ba64-199d91b7e203 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:38.147865 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10f5ac-3b80-4bf1-ba64-199d91b7e203 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:38.148150 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10f5ac-3b80-4bf1-ba64-199d91b7e203 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:38.161050 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10f5ac-3b80-4bf1-ba64-199d91b7e203 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:38.162872 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10f5ac-3b80-4bf1-ba64-199d91b7e203 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:38.179404 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-7a10f5ac-3b80-4bf1-ba64-199d91b7e203 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:38.180486 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 292/583] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:38.186123 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0901f3f-1c4f-4a72-a70e-0f69e11cfb53 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:38.194814 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0901f3f-1c4f-4a72-a70e-0f69e11cfb53 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:38.199472 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99540368-ce49-4d76-aae7-1835a152e034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:38.200042 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99540368-ce49-4d76-aae7-1835a152e034 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:38.200326 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99540368-ce49-4d76-aae7-1835a152e034 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:38.200604 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99540368-ce49-4d76-aae7-1835a152e034 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:38.201320 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99540368-ce49-4d76-aae7-1835a152e034 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:38.201617 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99540368-ce49-4d76-aae7-1835a152e034 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:38.203153 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99540368-ce49-4d76-aae7-1835a152e034 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:38.215856 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 292/584] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:38.221014 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10f5ac-3b80-4bf1-ba64-199d91b7e203 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:38.230741 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10f5ac-3b80-4bf1-ba64-199d91b7e203 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:38.235076 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb9aed-dcc4-4a6d-b9cd-a15ad35b8256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:38.235784 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb9aed-dcc4-4a6d-b9cd-a15ad35b8256 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:38.236068 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb9aed-dcc4-4a6d-b9cd-a15ad35b8256 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:38.236344 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb9aed-dcc4-4a6d-b9cd-a15ad35b8256 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:38.244872 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb9aed-dcc4-4a6d-b9cd-a15ad35b8256 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:38.246815 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb9aed-dcc4-4a6d-b9cd-a15ad35b8256 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:38.260674 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-e9bb9aed-dcc4-4a6d-b9cd-a15ad35b8256 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:24:38.261853 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 293/585] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:24:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:38.267623 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99540368-ce49-4d76-aae7-1835a152e034 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:38.277870 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99540368-ce49-4d76-aae7-1835a152e034 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:38.281988 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff7917-6e5a-42ca-ab80-1d3c4f61f121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:38.282561 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff7917-6e5a-42ca-ab80-1d3c4f61f121 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:38.282848 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff7917-6e5a-42ca-ab80-1d3c4f61f121 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:38.283150 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff7917-6e5a-42ca-ab80-1d3c4f61f121 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:38.283886 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff7917-6e5a-42ca-ab80-1d3c4f61f121 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:38.284183 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff7917-6e5a-42ca-ab80-1d3c4f61f121 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:38.286039 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff7917-6e5a-42ca-ab80-1d3c4f61f121 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:38.298366 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 293/586] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:24:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:38.304189 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb9aed-dcc4-4a6d-b9cd-a15ad35b8256 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:38.314073 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb9aed-dcc4-4a6d-b9cd-a15ad35b8256 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:38.318446 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898696a-f42d-4e73-b097-9fff1c118a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:38.319019 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898696a-f42d-4e73-b097-9fff1c118a0c admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:38.319307 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898696a-f42d-4e73-b097-9fff1c118a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:38.319591 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898696a-f42d-4e73-b097-9fff1c118a0c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:38.320372 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898696a-f42d-4e73-b097-9fff1c118a0c admin admin] RBAC: Adding query filter params (role.id=07f29be2087e43caaf6845ecf113b6e7, scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55, user.id=fa7dedfceea346ca997eedec181935c3) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:38.320678 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898696a-f42d-4e73-b097-9fff1c118a0c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:38.323160 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898696a-f42d-4e73-b097-9fff1c118a0c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:38.328295 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 294/587] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:24:38 2021] GET /identity/v3/role_assignments?user.id=fa7dedfceea346ca997eedec181935c3&scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55&role.id=07f29be2087e43caaf6845ecf113b6e7 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:40.359256 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8aa616-800e-48c5-9d59-769acbbdbc4c None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:40.359808 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8aa616-800e-48c5-9d59-769acbbdbc4c None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:40.359808 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8aa616-800e-48c5-9d59-769acbbdbc4c None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:40.361535 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 294/588] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:24:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:40.366989 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdfe04-db22-4810-9f61-9bd3f074f7fc None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:40.367416 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdfe04-db22-4810-9f61-9bd3f074f7fc None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:40.367549 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdfe04-db22-4810-9f61-9bd3f074f7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:40.390193 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-58fdfe04-db22-4810-9f61-9bd3f074f7fc None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:40.391322 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-58fdfe04-db22-4810-9f61-9bd3f074f7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:40.398008 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 295/589] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:40 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:40.420349 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8aa616-800e-48c5-9d59-769acbbdbc4c None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:40.431973 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8aa616-800e-48c5-9d59-769acbbdbc4c None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:40.436024 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73dff3-e3bb-45fb-918b-a2ed72afa6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:40.436730 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73dff3-e3bb-45fb-918b-a2ed72afa6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:40.437048 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73dff3-e3bb-45fb-918b-a2ed72afa6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:40.437333 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73dff3-e3bb-45fb-918b-a2ed72afa6b2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:40.449087 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73dff3-e3bb-45fb-918b-a2ed72afa6b2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:24:40.455401 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-ad73dff3-e3bb-45fb-918b-a2ed72afa6b2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:24:40.456471 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 295/590] 10.222.0.64 () {56 vars in 1123 bytes} [Thu Dec 16 14:24:40 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:40.463131 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdfe04-db22-4810-9f61-9bd3f074f7fc None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:40.471596 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdfe04-db22-4810-9f61-9bd3f074f7fc None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:40.475680 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b8e51-a25a-4372-9b4e-b1c76e3cd508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:40.476273 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b8e51-a25a-4372-9b4e-b1c76e3cd508 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:40.476565 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b8e51-a25a-4372-9b4e-b1c76e3cd508 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:40.476889 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b8e51-a25a-4372-9b4e-b1c76e3cd508 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:40.477605 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b8e51-a25a-4372-9b4e-b1c76e3cd508 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:40.477908 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b8e51-a25a-4372-9b4e-b1c76e3cd508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:40.479483 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b8e51-a25a-4372-9b4e-b1c76e3cd508 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:40.487571 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 296/591] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Dec 16 14:24:40 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:40.492969 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73dff3-e3bb-45fb-918b-a2ed72afa6b2 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:40.502568 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73dff3-e3bb-45fb-918b-a2ed72afa6b2 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:40.506706 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64d1a8-78c3-4e32-b1e5-89a00fbace82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:40.507403 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64d1a8-78c3-4e32-b1e5-89a00fbace82 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:40.507699 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64d1a8-78c3-4e32-b1e5-89a00fbace82 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:40.507980 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64d1a8-78c3-4e32-b1e5-89a00fbace82 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:40.519382 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64d1a8-78c3-4e32-b1e5-89a00fbace82 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:40.521223 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64d1a8-78c3-4e32-b1e5-89a00fbace82 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:40.538391 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-1d64d1a8-78c3-4e32-b1e5-89a00fbace82 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:40.539439 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 296/592] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:40.545052 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b8e51-a25a-4372-9b4e-b1c76e3cd508 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:40.554093 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b8e51-a25a-4372-9b4e-b1c76e3cd508 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:40.558642 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9222b-921b-46c9-8ca1-0619d04aec76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:40.559216 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9222b-921b-46c9-8ca1-0619d04aec76 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:40.559499 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9222b-921b-46c9-8ca1-0619d04aec76 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:40.559777 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9222b-921b-46c9-8ca1-0619d04aec76 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:40.560453 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9222b-921b-46c9-8ca1-0619d04aec76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:40.560749 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9222b-921b-46c9-8ca1-0619d04aec76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:40.562331 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9222b-921b-46c9-8ca1-0619d04aec76 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:40.575139 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 297/593] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:40.580420 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64d1a8-78c3-4e32-b1e5-89a00fbace82 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:40.589463 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64d1a8-78c3-4e32-b1e5-89a00fbace82 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:40.593558 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edccbe8f-97c3-4ab6-adc9-4ab19f4febbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:40.594271 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccbe8f-97c3-4ab6-adc9-4ab19f4febbd admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:40.594563 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccbe8f-97c3-4ab6-adc9-4ab19f4febbd admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:40.594847 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccbe8f-97c3-4ab6-adc9-4ab19f4febbd admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:40.607098 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edccbe8f-97c3-4ab6-adc9-4ab19f4febbd admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:40.609097 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edccbe8f-97c3-4ab6-adc9-4ab19f4febbd admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:40.627236 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-edccbe8f-97c3-4ab6-adc9-4ab19f4febbd admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 16 14:24:40.628235 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 297/594] 10.222.0.64 () {56 vars in 1138 bytes} [Thu Dec 16 14:24:40 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:40.634515 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9222b-921b-46c9-8ca1-0619d04aec76 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:40.643656 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9222b-921b-46c9-8ca1-0619d04aec76 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:40.647690 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d361f-ceb6-4c03-b6e4-bd70edb76fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:40.648272 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d361f-ceb6-4c03-b6e4-bd70edb76fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:40.648557 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d361f-ceb6-4c03-b6e4-bd70edb76fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:40.648871 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d361f-ceb6-4c03-b6e4-bd70edb76fc7 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:40.649652 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d361f-ceb6-4c03-b6e4-bd70edb76fc7 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:40.649954 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d361f-ceb6-4c03-b6e4-bd70edb76fc7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:40.651760 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d361f-ceb6-4c03-b6e4-bd70edb76fc7 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:40.678965 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 298/595] 10.222.0.64 () {56 vars in 1170 bytes} [Thu Dec 16 14:24:40 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:40.684750 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edccbe8f-97c3-4ab6-adc9-4ab19f4febbd admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:40.694414 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edccbe8f-97c3-4ab6-adc9-4ab19f4febbd admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:40.699264 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aac4fd-1637-4970-b907-2bb36440d823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:40.699961 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aac4fd-1637-4970-b907-2bb36440d823 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:40.700253 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aac4fd-1637-4970-b907-2bb36440d823 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:40.700535 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aac4fd-1637-4970-b907-2bb36440d823 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:40.713829 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aac4fd-1637-4970-b907-2bb36440d823 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:40.715661 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aac4fd-1637-4970-b907-2bb36440d823 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:40.732296 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-f3aac4fd-1637-4970-b907-2bb36440d823 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:40.733431 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 298/596] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:40.738998 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d361f-ceb6-4c03-b6e4-bd70edb76fc7 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:40.748761 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d361f-ceb6-4c03-b6e4-bd70edb76fc7 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:40.752955 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a4bb3-036e-4b85-ab0b-858e1a0b229a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:40.753539 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a4bb3-036e-4b85-ab0b-858e1a0b229a admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:40.753831 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a4bb3-036e-4b85-ab0b-858e1a0b229a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:40.754116 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a4bb3-036e-4b85-ab0b-858e1a0b229a admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:40.754803 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a4bb3-036e-4b85-ab0b-858e1a0b229a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:40.755106 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a4bb3-036e-4b85-ab0b-858e1a0b229a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:40.756674 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a4bb3-036e-4b85-ab0b-858e1a0b229a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:40.769045 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 299/597] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:40.774301 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aac4fd-1637-4970-b907-2bb36440d823 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:40.783409 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aac4fd-1637-4970-b907-2bb36440d823 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:40.787577 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdb129-9446-48b9-adea-b4338cbebddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:40.788270 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdb129-9446-48b9-adea-b4338cbebddd admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:40.788561 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdb129-9446-48b9-adea-b4338cbebddd admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:40.788886 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdb129-9446-48b9-adea-b4338cbebddd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:40.797422 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fdb129-9446-48b9-adea-b4338cbebddd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:40.799351 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fdb129-9446-48b9-adea-b4338cbebddd admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:40.813118 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-53fdb129-9446-48b9-adea-b4338cbebddd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:24:40.814166 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 299/598] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:24:40 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:40.819791 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a4bb3-036e-4b85-ab0b-858e1a0b229a admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:40.829740 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a4bb3-036e-4b85-ab0b-858e1a0b229a admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:40.833863 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce166a2-f094-4bda-b09b-1946e047ad85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:40.834576 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce166a2-f094-4bda-b09b-1946e047ad85 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:40.834871 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce166a2-f094-4bda-b09b-1946e047ad85 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:40.835154 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce166a2-f094-4bda-b09b-1946e047ad85 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:40.835899 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce166a2-f094-4bda-b09b-1946e047ad85 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:40.836205 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce166a2-f094-4bda-b09b-1946e047ad85 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:40.838070 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce166a2-f094-4bda-b09b-1946e047ad85 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:40.850407 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 300/599] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:24:40 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:40.856074 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdb129-9446-48b9-adea-b4338cbebddd admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:40.865231 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdb129-9446-48b9-adea-b4338cbebddd admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:40.869802 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dee109-4ef6-4478-ab52-59d6486fd610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:40.870602 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dee109-4ef6-4478-ab52-59d6486fd610 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:40.870892 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dee109-4ef6-4478-ab52-59d6486fd610 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:40.871179 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dee109-4ef6-4478-ab52-59d6486fd610 admin admin] PATH_INFO: `/v3/projects/244c8ef98d0445c6a0279c46d5cb7e55/users/fa7dedfceea346ca997eedec181935c3/roles/07f29be2087e43caaf6845ecf113b6e7` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:40.890824 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dee109-4ef6-4478-ab52-59d6486fd610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=244c8ef98d0445c6a0279c46d5cb7e55, user_id=fa7dedfceea346ca997eedec181935c3, role_id=07f29be2087e43caaf6845ecf113b6e7)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:40.893407 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dee109-4ef6-4478-ab52-59d6486fd610 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:40.904958 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 300/600] 10.222.0.64 () {58 vars in 1460 bytes} [Thu Dec 16 14:24:40 2021] PUT /identity/v3/projects/244c8ef98d0445c6a0279c46d5cb7e55/users/fa7dedfceea346ca997eedec181935c3/roles/07f29be2087e43caaf6845ecf113b6e7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:24:42.974078 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bd42c-a0d8-484c-8acf-1d6aa7fd9a11 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:42.974592 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bd42c-a0d8-484c-8acf-1d6aa7fd9a11 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:42.974675 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bd42c-a0d8-484c-8acf-1d6aa7fd9a11 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:42.976306 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 301/601] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:24:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:42.981455 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0dba6-4729-47a4-a496-6b42a9545fb7 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:42.981843 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0dba6-4729-47a4-a496-6b42a9545fb7 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:42.982032 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0dba6-4729-47a4-a496-6b42a9545fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:43.004055 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-d1f0dba6-4729-47a4-a496-6b42a9545fb7 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:43.005210 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-d1f0dba6-4729-47a4-a496-6b42a9545fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:43.067634 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 301/602] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:42 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:43.091014 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bd42c-a0d8-484c-8acf-1d6aa7fd9a11 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:43.103046 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bd42c-a0d8-484c-8acf-1d6aa7fd9a11 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:43.107205 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d6c55-5534-4337-8fa2-dec1c47433c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:43.107867 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d6c55-5534-4337-8fa2-dec1c47433c1 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:43.108160 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d6c55-5534-4337-8fa2-dec1c47433c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:43.108448 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d6c55-5534-4337-8fa2-dec1c47433c1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:43.120111 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d6c55-5534-4337-8fa2-dec1c47433c1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:24:43.126596 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-447d6c55-5534-4337-8fa2-dec1c47433c1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:24:43.127670 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 302/603] 10.222.0.64 () {56 vars in 1123 bytes} [Thu Dec 16 14:24:43 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:43.134157 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0dba6-4729-47a4-a496-6b42a9545fb7 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:43.142516 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0dba6-4729-47a4-a496-6b42a9545fb7 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:43.146669 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b667d5-2b5d-4a99-8787-91175ce403fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:43.147253 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b667d5-2b5d-4a99-8787-91175ce403fa admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:43.147540 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b667d5-2b5d-4a99-8787-91175ce403fa admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:43.147821 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b667d5-2b5d-4a99-8787-91175ce403fa admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:43.148524 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b667d5-2b5d-4a99-8787-91175ce403fa admin admin] RBAC: Adding query filter params (name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:43.149155 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b667d5-2b5d-4a99-8787-91175ce403fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:43.150413 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b667d5-2b5d-4a99-8787-91175ce403fa admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:43.158584 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 302/604] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Dec 16 14:24:43 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:43.163926 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d6c55-5534-4337-8fa2-dec1c47433c1 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:43.174204 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d6c55-5534-4337-8fa2-dec1c47433c1 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:43.178367 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9bc4c-3c9f-4d22-b65b-8a753a88b2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:43.179072 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9bc4c-3c9f-4d22-b65b-8a753a88b2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:43.179364 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9bc4c-3c9f-4d22-b65b-8a753a88b2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:43.179651 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9bc4c-3c9f-4d22-b65b-8a753a88b2f0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:43.191266 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9bc4c-3c9f-4d22-b65b-8a753a88b2f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:43.193385 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9bc4c-3c9f-4d22-b65b-8a753a88b2f0 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:43.210300 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-74f9bc4c-3c9f-4d22-b65b-8a753a88b2f0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:43.211461 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 303/605] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:43.217479 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b667d5-2b5d-4a99-8787-91175ce403fa admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:43.227872 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b667d5-2b5d-4a99-8787-91175ce403fa admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:43.232147 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0cf1d-5d16-434f-8b00-49a36801618f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:43.232739 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0cf1d-5d16-434f-8b00-49a36801618f admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:43.233060 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0cf1d-5d16-434f-8b00-49a36801618f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:43.233340 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0cf1d-5d16-434f-8b00-49a36801618f admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:43.234030 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0cf1d-5d16-434f-8b00-49a36801618f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:43.234324 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0cf1d-5d16-434f-8b00-49a36801618f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:43.235897 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0cf1d-5d16-434f-8b00-49a36801618f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:43.249947 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 303/606] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:43.255737 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9bc4c-3c9f-4d22-b65b-8a753a88b2f0 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:43.265476 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9bc4c-3c9f-4d22-b65b-8a753a88b2f0 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:43.269813 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe57511-1a51-4aab-8781-0dcdbc6079af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:43.270565 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe57511-1a51-4aab-8781-0dcdbc6079af admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:43.270859 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe57511-1a51-4aab-8781-0dcdbc6079af admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:43.271146 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe57511-1a51-4aab-8781-0dcdbc6079af admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:43.284484 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe57511-1a51-4aab-8781-0dcdbc6079af admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:43.286557 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe57511-1a51-4aab-8781-0dcdbc6079af admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:43.306261 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-1fe57511-1a51-4aab-8781-0dcdbc6079af admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 16 14:24:43.307391 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 304/607] 10.222.0.64 () {56 vars in 1138 bytes} [Thu Dec 16 14:24:43 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:43.313093 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0cf1d-5d16-434f-8b00-49a36801618f admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:43.322735 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0cf1d-5d16-434f-8b00-49a36801618f admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:43.327120 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd3e6d-2913-4a7c-949b-1bd4e4dc8e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:43.327725 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd3e6d-2913-4a7c-949b-1bd4e4dc8e74 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:43.328013 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd3e6d-2913-4a7c-949b-1bd4e4dc8e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:43.328293 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd3e6d-2913-4a7c-949b-1bd4e4dc8e74 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:43.329131 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd3e6d-2913-4a7c-949b-1bd4e4dc8e74 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:43.329434 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd3e6d-2913-4a7c-949b-1bd4e4dc8e74 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:43.331261 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd3e6d-2913-4a7c-949b-1bd4e4dc8e74 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:43.361340 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 304/608] 10.222.0.64 () {56 vars in 1170 bytes} [Thu Dec 16 14:24:43 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:43.366911 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe57511-1a51-4aab-8781-0dcdbc6079af admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:43.376962 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe57511-1a51-4aab-8781-0dcdbc6079af admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:43.381220 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1458e6e-2ec6-4987-b997-793aed7c06cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:43.381789 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1458e6e-2ec6-4987-b997-793aed7c06cb admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:43.382077 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1458e6e-2ec6-4987-b997-793aed7c06cb admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:43.382360 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1458e6e-2ec6-4987-b997-793aed7c06cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:43.390273 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1458e6e-2ec6-4987-b997-793aed7c06cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:43.392008 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1458e6e-2ec6-4987-b997-793aed7c06cb admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:43.400710 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 305/609] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:24:43 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:24:43.406504 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd3e6d-2913-4a7c-949b-1bd4e4dc8e74 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:43.416522 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd3e6d-2913-4a7c-949b-1bd4e4dc8e74 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:43.420751 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707418a-8f56-4139-ac87-2ef7d8d786ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:43.421502 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707418a-8f56-4139-ac87-2ef7d8d786ff admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:43.421793 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707418a-8f56-4139-ac87-2ef7d8d786ff admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:43.422079 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707418a-8f56-4139-ac87-2ef7d8d786ff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:43.434104 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707418a-8f56-4139-ac87-2ef7d8d786ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:43.435934 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707418a-8f56-4139-ac87-2ef7d8d786ff admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:43.452972 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-e707418a-8f56-4139-ac87-2ef7d8d786ff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:43.454085 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 305/610] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:43.459938 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1458e6e-2ec6-4987-b997-793aed7c06cb admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:43.468800 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1458e6e-2ec6-4987-b997-793aed7c06cb admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:43.473157 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316d2c7-e078-46c0-984d-fa410fe51562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:43.473743 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316d2c7-e078-46c0-984d-fa410fe51562 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:43.474033 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316d2c7-e078-46c0-984d-fa410fe51562 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:43.474317 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316d2c7-e078-46c0-984d-fa410fe51562 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:43.475004 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316d2c7-e078-46c0-984d-fa410fe51562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:43.475304 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316d2c7-e078-46c0-984d-fa410fe51562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:43.477440 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316d2c7-e078-46c0-984d-fa410fe51562 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:43.492706 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 306/611] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:43.498743 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707418a-8f56-4139-ac87-2ef7d8d786ff admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:43.508207 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707418a-8f56-4139-ac87-2ef7d8d786ff admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:43.512413 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd8796-9910-4966-a9dc-229a5eb7d816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:43.513171 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd8796-9910-4966-a9dc-229a5eb7d816 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:43.513454 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd8796-9910-4966-a9dc-229a5eb7d816 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:43.513729 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd8796-9910-4966-a9dc-229a5eb7d816 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:43.522829 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd8796-9910-4966-a9dc-229a5eb7d816 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:43.525304 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd8796-9910-4966-a9dc-229a5eb7d816 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:43.538463 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-c7cd8796-9910-4966-a9dc-229a5eb7d816 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:24:43.540272 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 306/612] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:24:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:43.545849 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316d2c7-e078-46c0-984d-fa410fe51562 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:43.555282 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316d2c7-e078-46c0-984d-fa410fe51562 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:43.559429 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf865a36-1262-4c57-ba9d-09ebe07abdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:43.560009 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf865a36-1262-4c57-ba9d-09ebe07abdd7 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:43.560298 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf865a36-1262-4c57-ba9d-09ebe07abdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:43.560583 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf865a36-1262-4c57-ba9d-09ebe07abdd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:43.561366 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf865a36-1262-4c57-ba9d-09ebe07abdd7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:43.561669 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf865a36-1262-4c57-ba9d-09ebe07abdd7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:43.563491 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf865a36-1262-4c57-ba9d-09ebe07abdd7 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:43.577384 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 307/613] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:24:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:43.583200 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd8796-9910-4966-a9dc-229a5eb7d816 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:43.593127 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd8796-9910-4966-a9dc-229a5eb7d816 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:43.597675 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc151a-7ad5-4836-9bf4-41ca84956b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:43.598272 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc151a-7ad5-4836-9bf4-41ca84956b3d admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:43.598564 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc151a-7ad5-4836-9bf4-41ca84956b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:43.598848 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc151a-7ad5-4836-9bf4-41ca84956b3d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:43.599613 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc151a-7ad5-4836-9bf4-41ca84956b3d admin admin] RBAC: Adding query filter params (role.id=07f29be2087e43caaf6845ecf113b6e7, scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55, user.id=fa7dedfceea346ca997eedec181935c3) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:43.599929 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc151a-7ad5-4836-9bf4-41ca84956b3d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:43.601785 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc151a-7ad5-4836-9bf4-41ca84956b3d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:43.608004 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 307/614] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:24:43 2021] GET /identity/v3/role_assignments?user.id=fa7dedfceea346ca997eedec181935c3&scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55&role.id=07f29be2087e43caaf6845ecf113b6e7 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:45.780731 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d2756-ee2d-41bd-989e-b5420f8ca111 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:45.781287 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d2756-ee2d-41bd-989e-b5420f8ca111 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:45.781372 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d2756-ee2d-41bd-989e-b5420f8ca111 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:45.782976 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 308/615] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:24:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:45.788408 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dfeb5-fdd0-49d6-9290-26c61f9d7a79 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:45.788863 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dfeb5-fdd0-49d6-9290-26c61f9d7a79 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:45.789009 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dfeb5-fdd0-49d6-9290-26c61f9d7a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:45.811804 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-e05dfeb5-fdd0-49d6-9290-26c61f9d7a79 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:45.812993 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e05dfeb5-fdd0-49d6-9290-26c61f9d7a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:45.820164 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 308/616] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:45 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:45.843899 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d2756-ee2d-41bd-989e-b5420f8ca111 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:45.856450 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d2756-ee2d-41bd-989e-b5420f8ca111 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:45.860567 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a863c2-501f-434c-ad43-cf554c7814b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:45.861331 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a863c2-501f-434c-ad43-cf554c7814b0 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:45.861615 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a863c2-501f-434c-ad43-cf554c7814b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:45.861893 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a863c2-501f-434c-ad43-cf554c7814b0 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:45.873272 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a863c2-501f-434c-ad43-cf554c7814b0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:24:45.879901 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-30a863c2-501f-434c-ad43-cf554c7814b0 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 16 14:24:45.881040 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 309/617] 10.222.0.64 () {56 vars in 1141 bytes} [Thu Dec 16 14:24:45 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:45.887019 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05dfeb5-fdd0-49d6-9290-26c61f9d7a79 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:45.895672 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05dfeb5-fdd0-49d6-9290-26c61f9d7a79 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:45.900668 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2e842-9102-4222-a839-ad803dbcc456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:45.901300 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2e842-9102-4222-a839-ad803dbcc456 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:45.901592 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2e842-9102-4222-a839-ad803dbcc456 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:45.901876 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2e842-9102-4222-a839-ad803dbcc456 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:45.902600 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2e842-9102-4222-a839-ad803dbcc456 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:45.902903 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2e842-9102-4222-a839-ad803dbcc456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:45.904589 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2e842-9102-4222-a839-ad803dbcc456 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:45.913831 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 309/618] 10.222.0.64 () {56 vars in 1136 bytes} [Thu Dec 16 14:24:45 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:45.920156 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a863c2-501f-434c-ad43-cf554c7814b0 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:45.930412 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a863c2-501f-434c-ad43-cf554c7814b0 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:45.934642 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6768be1-6a2b-4bc4-9dd3-9dbb9e3d6396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:45.935380 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6768be1-6a2b-4bc4-9dd3-9dbb9e3d6396 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:45.935668 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6768be1-6a2b-4bc4-9dd3-9dbb9e3d6396 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:45.935951 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6768be1-6a2b-4bc4-9dd3-9dbb9e3d6396 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:45.948273 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6768be1-6a2b-4bc4-9dd3-9dbb9e3d6396 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:45.950153 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6768be1-6a2b-4bc4-9dd3-9dbb9e3d6396 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:45.969042 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-e6768be1-6a2b-4bc4-9dd3-9dbb9e3d6396 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:45.970224 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 310/619] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:45.975977 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2e842-9102-4222-a839-ad803dbcc456 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:45.986103 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2e842-9102-4222-a839-ad803dbcc456 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:45.990327 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac7e72-23be-4e8b-928f-d655cf0dcc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:45.990921 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac7e72-23be-4e8b-928f-d655cf0dcc5f admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:45.991208 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac7e72-23be-4e8b-928f-d655cf0dcc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:45.991485 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac7e72-23be-4e8b-928f-d655cf0dcc5f admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:45.992167 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac7e72-23be-4e8b-928f-d655cf0dcc5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:45.992501 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac7e72-23be-4e8b-928f-d655cf0dcc5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:45.994133 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac7e72-23be-4e8b-928f-d655cf0dcc5f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:46.008159 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 310/620] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:46.013791 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6768be1-6a2b-4bc4-9dd3-9dbb9e3d6396 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:46.023166 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6768be1-6a2b-4bc4-9dd3-9dbb9e3d6396 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:46.027948 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc28a7-5556-4442-b27f-d8e1bb49122d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:46.028688 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc28a7-5556-4442-b27f-d8e1bb49122d admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:46.029008 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc28a7-5556-4442-b27f-d8e1bb49122d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:46.029299 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc28a7-5556-4442-b27f-d8e1bb49122d admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:46.042941 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc28a7-5556-4442-b27f-d8e1bb49122d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:46.044911 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc28a7-5556-4442-b27f-d8e1bb49122d admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:46.062891 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-6ebc28a7-5556-4442-b27f-d8e1bb49122d admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 16 14:24:46.063998 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 311/621] 10.222.0.64 () {56 vars in 1138 bytes} [Thu Dec 16 14:24:46 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:46.069994 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac7e72-23be-4e8b-928f-d655cf0dcc5f admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:46.079371 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac7e72-23be-4e8b-928f-d655cf0dcc5f admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:46.083546 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747003c2-6a53-4134-b40c-79adb3eb6fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:46.084137 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747003c2-6a53-4134-b40c-79adb3eb6fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:46.084423 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747003c2-6a53-4134-b40c-79adb3eb6fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:46.084697 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747003c2-6a53-4134-b40c-79adb3eb6fb3 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:46.085509 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747003c2-6a53-4134-b40c-79adb3eb6fb3 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:46.085801 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747003c2-6a53-4134-b40c-79adb3eb6fb3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:46.088144 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747003c2-6a53-4134-b40c-79adb3eb6fb3 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:46.116689 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 311/622] 10.222.0.64 () {56 vars in 1170 bytes} [Thu Dec 16 14:24:46 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:24:46.122390 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc28a7-5556-4442-b27f-d8e1bb49122d admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:46.131711 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc28a7-5556-4442-b27f-d8e1bb49122d admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:46.136421 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff95d7-4006-455d-93db-a0121bb55c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:46.137030 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff95d7-4006-455d-93db-a0121bb55c20 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:46.137317 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff95d7-4006-455d-93db-a0121bb55c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:46.137599 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff95d7-4006-455d-93db-a0121bb55c20 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:46.145388 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff95d7-4006-455d-93db-a0121bb55c20 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:46.147118 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff95d7-4006-455d-93db-a0121bb55c20 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:46.156009 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 312/623] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:24:46 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:24:46.161745 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747003c2-6a53-4134-b40c-79adb3eb6fb3 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:46.171089 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747003c2-6a53-4134-b40c-79adb3eb6fb3 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:46.175290 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3bcc0-4939-44ef-9110-4a9c20b3eaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:46.176003 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3bcc0-4939-44ef-9110-4a9c20b3eaf2 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:46.176293 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3bcc0-4939-44ef-9110-4a9c20b3eaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:46.176574 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3bcc0-4939-44ef-9110-4a9c20b3eaf2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:46.188151 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3bcc0-4939-44ef-9110-4a9c20b3eaf2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:46.190006 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3bcc0-4939-44ef-9110-4a9c20b3eaf2 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:46.207951 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-4de3bcc0-4939-44ef-9110-4a9c20b3eaf2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:46.209107 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 312/624] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:24:46.216743 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff95d7-4006-455d-93db-a0121bb55c20 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:46.225412 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff95d7-4006-455d-93db-a0121bb55c20 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:46.230157 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad208ef-ad74-4e1b-98c3-f367d6e09a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:46.230732 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad208ef-ad74-4e1b-98c3-f367d6e09a5d admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:46.231020 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad208ef-ad74-4e1b-98c3-f367d6e09a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:46.231297 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad208ef-ad74-4e1b-98c3-f367d6e09a5d admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:46.231979 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad208ef-ad74-4e1b-98c3-f367d6e09a5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:46.232281 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad208ef-ad74-4e1b-98c3-f367d6e09a5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:46.233926 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad208ef-ad74-4e1b-98c3-f367d6e09a5d admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:46.247460 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 313/625] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:46.253198 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3bcc0-4939-44ef-9110-4a9c20b3eaf2 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:46.262501 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3bcc0-4939-44ef-9110-4a9c20b3eaf2 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:46.269729 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e30471-7cb5-4498-ad0f-dccd10afc95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:46.270454 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e30471-7cb5-4498-ad0f-dccd10afc95f admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:46.270747 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e30471-7cb5-4498-ad0f-dccd10afc95f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:46.271033 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e30471-7cb5-4498-ad0f-dccd10afc95f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:46.280074 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e30471-7cb5-4498-ad0f-dccd10afc95f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:46.282059 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e30471-7cb5-4498-ad0f-dccd10afc95f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:46.296369 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-a6e30471-7cb5-4498-ad0f-dccd10afc95f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:24:46.297489 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 313/626] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:24:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:46.303413 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad208ef-ad74-4e1b-98c3-f367d6e09a5d admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:46.313665 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad208ef-ad74-4e1b-98c3-f367d6e09a5d admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:46.318142 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2b162-874e-4c0e-9f9f-d0abda7e4fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:46.318734 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2b162-874e-4c0e-9f9f-d0abda7e4fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:46.319031 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2b162-874e-4c0e-9f9f-d0abda7e4fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:46.319312 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2b162-874e-4c0e-9f9f-d0abda7e4fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:46.320055 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2b162-874e-4c0e-9f9f-d0abda7e4fa3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:46.320360 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2b162-874e-4c0e-9f9f-d0abda7e4fa3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:46.322263 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2b162-874e-4c0e-9f9f-d0abda7e4fa3 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:46.335318 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 314/627] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:24:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:46.341440 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e30471-7cb5-4498-ad0f-dccd10afc95f admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:46.353064 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e30471-7cb5-4498-ad0f-dccd10afc95f admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:46.357270 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1b51f-b084-4c5f-b94e-a1ed04ad0e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:46.357856 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1b51f-b084-4c5f-b94e-a1ed04ad0e85 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:46.358145 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1b51f-b084-4c5f-b94e-a1ed04ad0e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:46.358423 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1b51f-b084-4c5f-b94e-a1ed04ad0e85 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:46.359205 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1b51f-b084-4c5f-b94e-a1ed04ad0e85 admin admin] RBAC: Adding query filter params (role.id=0cc0d33666514991897c60dd152be949, scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55, user.id=fa7dedfceea346ca997eedec181935c3) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:46.359510 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1b51f-b084-4c5f-b94e-a1ed04ad0e85 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:46.361393 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1b51f-b084-4c5f-b94e-a1ed04ad0e85 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:46.367117 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 314/628] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:24:46 2021] GET /identity/v3/role_assignments?user.id=fa7dedfceea346ca997eedec181935c3&scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55&role.id=0cc0d33666514991897c60dd152be949 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:48.467731 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc6843-8a1f-44a4-b792-e090ab18763c None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:48.468254 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc6843-8a1f-44a4-b792-e090ab18763c None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:48.468341 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc6843-8a1f-44a4-b792-e090ab18763c None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:48.470012 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 315/629] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:24:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:48.475293 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3974e-9030-4a46-a8f1-c0ca78e193e9 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:48.475711 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3974e-9030-4a46-a8f1-c0ca78e193e9 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:48.475858 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3974e-9030-4a46-a8f1-c0ca78e193e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:48.499107 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-caf3974e-9030-4a46-a8f1-c0ca78e193e9 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:48.500236 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-caf3974e-9030-4a46-a8f1-c0ca78e193e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:48.507268 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 315/630] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:48 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:24:48.528881 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc6843-8a1f-44a4-b792-e090ab18763c None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:48.541079 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc6843-8a1f-44a4-b792-e090ab18763c None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:48.545051 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48302b3d-6804-444d-bf67-757f4cf7419a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:48.545782 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48302b3d-6804-444d-bf67-757f4cf7419a admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:48.546067 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48302b3d-6804-444d-bf67-757f4cf7419a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:48.546352 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48302b3d-6804-444d-bf67-757f4cf7419a admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:48.558120 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48302b3d-6804-444d-bf67-757f4cf7419a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:24:48.564906 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-48302b3d-6804-444d-bf67-757f4cf7419a admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 16 14:24:48.565988 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 316/631] 10.222.0.64 () {56 vars in 1141 bytes} [Thu Dec 16 14:24:48 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:48.571903 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3974e-9030-4a46-a8f1-c0ca78e193e9 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:48.580292 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3974e-9030-4a46-a8f1-c0ca78e193e9 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:48.584326 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1956442-437b-4940-92aa-c4437302fa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:48.584945 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1956442-437b-4940-92aa-c4437302fa64 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:48.585232 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1956442-437b-4940-92aa-c4437302fa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:48.585513 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1956442-437b-4940-92aa-c4437302fa64 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:48.586210 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1956442-437b-4940-92aa-c4437302fa64 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:48.586508 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1956442-437b-4940-92aa-c4437302fa64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:48.588061 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1956442-437b-4940-92aa-c4437302fa64 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:48.596130 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 316/632] 10.222.0.64 () {56 vars in 1136 bytes} [Thu Dec 16 14:24:48 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:48.601323 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48302b3d-6804-444d-bf67-757f4cf7419a admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:48.611381 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48302b3d-6804-444d-bf67-757f4cf7419a admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:48.616165 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d48d4-7f48-49e5-ac30-e040996baa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:48.616901 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d48d4-7f48-49e5-ac30-e040996baa3b admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:48.617189 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d48d4-7f48-49e5-ac30-e040996baa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:48.618002 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d48d4-7f48-49e5-ac30-e040996baa3b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:48.629082 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d48d4-7f48-49e5-ac30-e040996baa3b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:48.630876 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d48d4-7f48-49e5-ac30-e040996baa3b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:48.647352 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-e77d48d4-7f48-49e5-ac30-e040996baa3b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:48.648406 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 317/633] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:48.653916 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1956442-437b-4940-92aa-c4437302fa64 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:48.663492 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1956442-437b-4940-92aa-c4437302fa64 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:48.668219 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349d3c5-bf19-4c4d-91d6-6f174a72650e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:48.668838 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349d3c5-bf19-4c4d-91d6-6f174a72650e admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:48.669128 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349d3c5-bf19-4c4d-91d6-6f174a72650e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:48.669407 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349d3c5-bf19-4c4d-91d6-6f174a72650e admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:48.670092 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349d3c5-bf19-4c4d-91d6-6f174a72650e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:48.670387 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349d3c5-bf19-4c4d-91d6-6f174a72650e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:48.671955 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349d3c5-bf19-4c4d-91d6-6f174a72650e admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:48.685324 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 317/634] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:48.690949 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d48d4-7f48-49e5-ac30-e040996baa3b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:48.701064 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d48d4-7f48-49e5-ac30-e040996baa3b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:48.705773 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ab233-f824-4854-bbc6-68aa3792f877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:48.706660 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ab233-f824-4854-bbc6-68aa3792f877 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:48.706956 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ab233-f824-4854-bbc6-68aa3792f877 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:48.707248 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ab233-f824-4854-bbc6-68aa3792f877 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:48.720566 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ab233-f824-4854-bbc6-68aa3792f877 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:48.722602 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ab233-f824-4854-bbc6-68aa3792f877 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:48.741708 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-136ab233-f824-4854-bbc6-68aa3792f877 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 16 14:24:48.743446 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 318/635] 10.222.0.64 () {56 vars in 1138 bytes} [Thu Dec 16 14:24:48 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:48.749295 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349d3c5-bf19-4c4d-91d6-6f174a72650e admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:48.758749 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349d3c5-bf19-4c4d-91d6-6f174a72650e admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:48.762983 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303eea7f-534c-49d1-a611-903363238068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:48.763583 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303eea7f-534c-49d1-a611-903363238068 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:48.763871 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303eea7f-534c-49d1-a611-903363238068 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:48.764154 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303eea7f-534c-49d1-a611-903363238068 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:48.764970 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303eea7f-534c-49d1-a611-903363238068 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:48.765273 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303eea7f-534c-49d1-a611-903363238068 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:48.767098 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303eea7f-534c-49d1-a611-903363238068 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:48.796399 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 318/636] 10.222.0.64 () {56 vars in 1170 bytes} [Thu Dec 16 14:24:48 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:48.802018 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ab233-f824-4854-bbc6-68aa3792f877 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:48.811440 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ab233-f824-4854-bbc6-68aa3792f877 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:48.815566 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d018c-3a52-4f4e-85b8-957e21452994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:48.816536 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d018c-3a52-4f4e-85b8-957e21452994 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:48.816851 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d018c-3a52-4f4e-85b8-957e21452994 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:48.817137 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d018c-3a52-4f4e-85b8-957e21452994 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:48.828802 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d018c-3a52-4f4e-85b8-957e21452994 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:48.830634 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d018c-3a52-4f4e-85b8-957e21452994 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:48.847676 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-748d018c-3a52-4f4e-85b8-957e21452994 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:48.848803 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 319/637] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:48.855058 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303eea7f-534c-49d1-a611-903363238068 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:48.864830 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303eea7f-534c-49d1-a611-903363238068 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:48.870286 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810d610-24f5-48d1-94c9-b08a4d771e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:48.870872 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810d610-24f5-48d1-94c9-b08a4d771e2e admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:48.871165 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810d610-24f5-48d1-94c9-b08a4d771e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:48.871449 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810d610-24f5-48d1-94c9-b08a4d771e2e admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:48.872138 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810d610-24f5-48d1-94c9-b08a4d771e2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:48.872438 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810d610-24f5-48d1-94c9-b08a4d771e2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:48.874050 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810d610-24f5-48d1-94c9-b08a4d771e2e admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:48.887907 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 319/638] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:48.894761 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d018c-3a52-4f4e-85b8-957e21452994 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:48.904034 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d018c-3a52-4f4e-85b8-957e21452994 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:48.908680 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a0038-2e83-402c-aff7-54e3004488d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:48.909428 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a0038-2e83-402c-aff7-54e3004488d1 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:48.909720 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a0038-2e83-402c-aff7-54e3004488d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:48.910003 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a0038-2e83-402c-aff7-54e3004488d1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:48.919141 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a0038-2e83-402c-aff7-54e3004488d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:48.921145 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a0038-2e83-402c-aff7-54e3004488d1 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:48.935446 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-700a0038-2e83-402c-aff7-54e3004488d1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:24:48.936559 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 320/639] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:24:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:48.942643 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810d610-24f5-48d1-94c9-b08a4d771e2e admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:48.952499 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810d610-24f5-48d1-94c9-b08a4d771e2e admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:48.956550 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffe428-53ee-4eb9-bf7c-3011fa8ce271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:48.957160 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffe428-53ee-4eb9-bf7c-3011fa8ce271 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:48.957451 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffe428-53ee-4eb9-bf7c-3011fa8ce271 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:48.957734 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffe428-53ee-4eb9-bf7c-3011fa8ce271 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:48.958463 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffe428-53ee-4eb9-bf7c-3011fa8ce271 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:48.958762 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffe428-53ee-4eb9-bf7c-3011fa8ce271 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:48.960567 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffe428-53ee-4eb9-bf7c-3011fa8ce271 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:48.972915 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 320/640] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:24:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:48.978581 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a0038-2e83-402c-aff7-54e3004488d1 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:48.987891 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a0038-2e83-402c-aff7-54e3004488d1 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:48.992009 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40bdb0-c5ba-468a-9f11-e50f9b453f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:48.993359 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40bdb0-c5ba-468a-9f11-e50f9b453f53 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:48.993650 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40bdb0-c5ba-468a-9f11-e50f9b453f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:48.993933 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40bdb0-c5ba-468a-9f11-e50f9b453f53 admin admin] PATH_INFO: `/v3/projects/244c8ef98d0445c6a0279c46d5cb7e55/users/fa7dedfceea346ca997eedec181935c3/roles/0cc0d33666514991897c60dd152be949` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:48.995964 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f40bdb0-c5ba-468a-9f11-e50f9b453f53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=244c8ef98d0445c6a0279c46d5cb7e55, user_id=fa7dedfceea346ca997eedec181935c3, role_id=0cc0d33666514991897c60dd152be949)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:48.998664 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f40bdb0-c5ba-468a-9f11-e50f9b453f53 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:49.011591 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 321/641] 10.222.0.64 () {58 vars in 1460 bytes} [Thu Dec 16 14:24:48 2021] PUT /identity/v3/projects/244c8ef98d0445c6a0279c46d5cb7e55/users/fa7dedfceea346ca997eedec181935c3/roles/0cc0d33666514991897c60dd152be949 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:24:51.121740 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1400463-2821-43c8-bbd6-4e962c308367 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:51.122230 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1400463-2821-43c8-bbd6-4e962c308367 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:51.122230 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1400463-2821-43c8-bbd6-4e962c308367 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:51.123899 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 321/642] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:24:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:51.129151 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d5d2b-3d8c-43af-a536-c01de5e57f5b None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:51.129567 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d5d2b-3d8c-43af-a536-c01de5e57f5b None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:51.129720 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d5d2b-3d8c-43af-a536-c01de5e57f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:51.152309 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-a93d5d2b-3d8c-43af-a536-c01de5e57f5b None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:51.153520 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-a93d5d2b-3d8c-43af-a536-c01de5e57f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:51.219985 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 322/643] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:51 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:51.243714 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1400463-2821-43c8-bbd6-4e962c308367 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:51.256063 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1400463-2821-43c8-bbd6-4e962c308367 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:51.260340 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a5b31-5c26-4cbb-923f-5dafdbb6f6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:51.261114 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a5b31-5c26-4cbb-923f-5dafdbb6f6bb admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:51.261410 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a5b31-5c26-4cbb-923f-5dafdbb6f6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:51.261698 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a5b31-5c26-4cbb-923f-5dafdbb6f6bb admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:51.274959 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a5b31-5c26-4cbb-923f-5dafdbb6f6bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:24:51.281834 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-a79a5b31-5c26-4cbb-923f-5dafdbb6f6bb admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 16 14:24:51.283001 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 322/644] 10.222.0.64 () {56 vars in 1141 bytes} [Thu Dec 16 14:24:51 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:51.289793 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d5d2b-3d8c-43af-a536-c01de5e57f5b None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:51.298964 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d5d2b-3d8c-43af-a536-c01de5e57f5b None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:51.303297 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55c2e6-34e6-472a-abd6-48feba460d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:51.303912 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55c2e6-34e6-472a-abd6-48feba460d14 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:51.304204 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55c2e6-34e6-472a-abd6-48feba460d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:51.304488 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55c2e6-34e6-472a-abd6-48feba460d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:51.305255 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55c2e6-34e6-472a-abd6-48feba460d14 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:51.305562 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55c2e6-34e6-472a-abd6-48feba460d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:51.307169 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55c2e6-34e6-472a-abd6-48feba460d14 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:51.316323 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 323/645] 10.222.0.64 () {56 vars in 1136 bytes} [Thu Dec 16 14:24:51 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:51.322126 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a5b31-5c26-4cbb-923f-5dafdbb6f6bb admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:51.331980 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a5b31-5c26-4cbb-923f-5dafdbb6f6bb admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:51.336662 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208049a-0f3e-4d88-9ffe-553fdeac9f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:51.337413 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208049a-0f3e-4d88-9ffe-553fdeac9f8a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:51.337699 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208049a-0f3e-4d88-9ffe-553fdeac9f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:51.337978 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208049a-0f3e-4d88-9ffe-553fdeac9f8a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:51.349626 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208049a-0f3e-4d88-9ffe-553fdeac9f8a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:51.351515 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208049a-0f3e-4d88-9ffe-553fdeac9f8a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:51.369685 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-0208049a-0f3e-4d88-9ffe-553fdeac9f8a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:51.370824 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 323/646] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:51.376650 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55c2e6-34e6-472a-abd6-48feba460d14 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:51.386965 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55c2e6-34e6-472a-abd6-48feba460d14 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:51.391311 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88892aed-8de8-4bdb-ac29-2b1a38120186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:51.391913 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88892aed-8de8-4bdb-ac29-2b1a38120186 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:51.392207 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88892aed-8de8-4bdb-ac29-2b1a38120186 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:51.392497 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88892aed-8de8-4bdb-ac29-2b1a38120186 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:51.393239 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88892aed-8de8-4bdb-ac29-2b1a38120186 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:51.393546 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88892aed-8de8-4bdb-ac29-2b1a38120186 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:51.395270 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88892aed-8de8-4bdb-ac29-2b1a38120186 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:51.408541 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 324/647] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:51.414135 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208049a-0f3e-4d88-9ffe-553fdeac9f8a admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:51.423332 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208049a-0f3e-4d88-9ffe-553fdeac9f8a admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:51.427379 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f329c-2993-438f-82ec-4cd98411ea0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:51.428097 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f329c-2993-438f-82ec-4cd98411ea0f admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:51.428384 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f329c-2993-438f-82ec-4cd98411ea0f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:51.428664 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f329c-2993-438f-82ec-4cd98411ea0f admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:51.442441 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f329c-2993-438f-82ec-4cd98411ea0f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:51.444410 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f329c-2993-438f-82ec-4cd98411ea0f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:51.463573 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-d69f329c-2993-438f-82ec-4cd98411ea0f admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 16 14:24:51.464611 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 324/648] 10.222.0.64 () {56 vars in 1138 bytes} [Thu Dec 16 14:24:51 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:51.470158 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88892aed-8de8-4bdb-ac29-2b1a38120186 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:51.479481 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88892aed-8de8-4bdb-ac29-2b1a38120186 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:51.483597 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3083775-da19-40c7-92b9-559d69236f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:51.484191 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3083775-da19-40c7-92b9-559d69236f15 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:51.484482 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3083775-da19-40c7-92b9-559d69236f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:51.484767 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3083775-da19-40c7-92b9-559d69236f15 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:51.485588 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3083775-da19-40c7-92b9-559d69236f15 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:51.485902 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3083775-da19-40c7-92b9-559d69236f15 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:51.488233 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3083775-da19-40c7-92b9-559d69236f15 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:51.517590 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 325/649] 10.222.0.64 () {56 vars in 1170 bytes} [Thu Dec 16 14:24:51 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:51.523289 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f329c-2993-438f-82ec-4cd98411ea0f admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:51.533396 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f329c-2993-438f-82ec-4cd98411ea0f admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:51.537679 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d4f50-2405-45ca-9b74-4180bd3fae13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:51.538254 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d4f50-2405-45ca-9b74-4180bd3fae13 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:51.538546 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d4f50-2405-45ca-9b74-4180bd3fae13 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:51.538829 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d4f50-2405-45ca-9b74-4180bd3fae13 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:51.546563 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d4f50-2405-45ca-9b74-4180bd3fae13 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:51.548296 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d4f50-2405-45ca-9b74-4180bd3fae13 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:51.556542 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 325/650] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:24:51 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:24:51.562047 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3083775-da19-40c7-92b9-559d69236f15 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:51.572108 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3083775-da19-40c7-92b9-559d69236f15 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:51.576211 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c0990-97a3-45d7-a160-122fe3097ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:51.576959 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c0990-97a3-45d7-a160-122fe3097ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:51.577247 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c0990-97a3-45d7-a160-122fe3097ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:51.577529 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c0990-97a3-45d7-a160-122fe3097ff1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:51.589734 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c0990-97a3-45d7-a160-122fe3097ff1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:51.591573 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c0990-97a3-45d7-a160-122fe3097ff1 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:51.608284 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-a76c0990-97a3-45d7-a160-122fe3097ff1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:51.609389 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 326/651] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:51.614958 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d4f50-2405-45ca-9b74-4180bd3fae13 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:51.623473 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d4f50-2405-45ca-9b74-4180bd3fae13 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:51.627719 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5b3a2-7ce7-4876-b9e6-fc8ac305c271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:51.628226 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5b3a2-7ce7-4876-b9e6-fc8ac305c271 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:51.628516 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5b3a2-7ce7-4876-b9e6-fc8ac305c271 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:51.628827 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5b3a2-7ce7-4876-b9e6-fc8ac305c271 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:51.629512 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5b3a2-7ce7-4876-b9e6-fc8ac305c271 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:51.629810 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5b3a2-7ce7-4876-b9e6-fc8ac305c271 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:51.631361 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5b3a2-7ce7-4876-b9e6-fc8ac305c271 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:51.644079 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 326/652] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:51.649937 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c0990-97a3-45d7-a160-122fe3097ff1 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:51.659057 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c0990-97a3-45d7-a160-122fe3097ff1 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:51.663134 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ed59f-8783-485b-88cf-8bd0f2f26b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:51.663838 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ed59f-8783-485b-88cf-8bd0f2f26b47 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:51.664130 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ed59f-8783-485b-88cf-8bd0f2f26b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:51.664414 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ed59f-8783-485b-88cf-8bd0f2f26b47 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:51.672669 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ed59f-8783-485b-88cf-8bd0f2f26b47 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:51.674634 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ed59f-8783-485b-88cf-8bd0f2f26b47 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:51.687752 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-a07ed59f-8783-485b-88cf-8bd0f2f26b47 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:24:51.688805 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 327/653] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:24:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:51.694799 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5b3a2-7ce7-4876-b9e6-fc8ac305c271 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:51.704423 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5b3a2-7ce7-4876-b9e6-fc8ac305c271 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:51.709670 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff98420-b39e-4ecd-a9a4-771675816db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:51.710274 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff98420-b39e-4ecd-a9a4-771675816db6 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:51.710563 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff98420-b39e-4ecd-a9a4-771675816db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:51.711418 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff98420-b39e-4ecd-a9a4-771675816db6 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:51.712185 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff98420-b39e-4ecd-a9a4-771675816db6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:51.712489 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff98420-b39e-4ecd-a9a4-771675816db6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:51.714381 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff98420-b39e-4ecd-a9a4-771675816db6 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:51.727632 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 327/654] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:24:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:51.733647 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ed59f-8783-485b-88cf-8bd0f2f26b47 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:51.743199 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ed59f-8783-485b-88cf-8bd0f2f26b47 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:51.747475 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191c5fa-f428-4e09-8571-e3bdfb316448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:51.748062 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191c5fa-f428-4e09-8571-e3bdfb316448 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:51.748356 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191c5fa-f428-4e09-8571-e3bdfb316448 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:51.748642 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191c5fa-f428-4e09-8571-e3bdfb316448 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:51.749469 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191c5fa-f428-4e09-8571-e3bdfb316448 admin admin] RBAC: Adding query filter params (role.id=0cc0d33666514991897c60dd152be949, scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55, user.id=fa7dedfceea346ca997eedec181935c3) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:51.749778 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191c5fa-f428-4e09-8571-e3bdfb316448 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:51.751648 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191c5fa-f428-4e09-8571-e3bdfb316448 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:51.757606 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 328/655] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:24:51 2021] GET /identity/v3/role_assignments?user.id=fa7dedfceea346ca997eedec181935c3&scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55&role.id=0cc0d33666514991897c60dd152be949 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:53.882664 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62aeab4-9f98-468e-913b-8ef9f3d1ee03 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:53.883185 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62aeab4-9f98-468e-913b-8ef9f3d1ee03 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:53.883270 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62aeab4-9f98-468e-913b-8ef9f3d1ee03 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:53.884933 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 328/656] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:24:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:53.890294 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50913f-08fa-4f07-ad0d-fef487385504 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:53.890760 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50913f-08fa-4f07-ad0d-fef487385504 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:53.890873 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50913f-08fa-4f07-ad0d-fef487385504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:53.913127 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-2b50913f-08fa-4f07-ad0d-fef487385504 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:53.914788 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-2b50913f-08fa-4f07-ad0d-fef487385504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:53.921859 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 329/657] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:53 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:24:53.945390 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62aeab4-9f98-468e-913b-8ef9f3d1ee03 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:53.957671 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62aeab4-9f98-468e-913b-8ef9f3d1ee03 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:53.961765 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1918faa-8a8c-4282-b3f7-6cb74c2bb579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:53.962495 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1918faa-8a8c-4282-b3f7-6cb74c2bb579 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:53.962782 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1918faa-8a8c-4282-b3f7-6cb74c2bb579 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:53.963066 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1918faa-8a8c-4282-b3f7-6cb74c2bb579 admin admin] PATH_INFO: `/v3/services/image` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:53.963709 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1918faa-8a8c-4282-b3f7-6cb74c2bb579 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:53.965351 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1918faa-8a8c-4282-b3f7-6cb74c2bb579 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:53.976139 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-f1918faa-8a8c-4282-b3f7-6cb74c2bb579 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 16 14:24:53.977839 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 329/658] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Dec 16 14:24:53 2021] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:53.984044 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50913f-08fa-4f07-ad0d-fef487385504 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:53.993671 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50913f-08fa-4f07-ad0d-fef487385504 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:53.997873 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0b634-a6ec-46c7-9925-5a50b09c5e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:53.998517 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0b634-a6ec-46c7-9925-5a50b09c5e81 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:53.998808 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0b634-a6ec-46c7-9925-5a50b09c5e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:53.999088 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0b634-a6ec-46c7-9925-5a50b09c5e81 admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:53.999773 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0b634-a6ec-46c7-9925-5a50b09c5e81 admin admin] RBAC: Adding query filter params (name=image) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:54.000073 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0b634-a6ec-46c7-9925-5a50b09c5e81 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:54.001721 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0b634-a6ec-46c7-9925-5a50b09c5e81 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:54.006716 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 330/659] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:53 2021] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:54.012508 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1918faa-8a8c-4282-b3f7-6cb74c2bb579 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:54.022272 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1918faa-8a8c-4282-b3f7-6cb74c2bb579 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:54.027019 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251dd7d7-d5ca-488a-ac36-e6bdc4b21ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:54.027618 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dd7d7-d5ca-488a-ac36-e6bdc4b21ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:54.027909 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dd7d7-d5ca-488a-ac36-e6bdc4b21ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:54.028195 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dd7d7-d5ca-488a-ac36-e6bdc4b21ec3 admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:54.028940 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251dd7d7-d5ca-488a-ac36-e6bdc4b21ec3 admin admin] RBAC: Adding query filter params (type=image) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:54.029242 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251dd7d7-d5ca-488a-ac36-e6bdc4b21ec3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:54.030852 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251dd7d7-d5ca-488a-ac36-e6bdc4b21ec3 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:54.035947 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 330/660] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:54 2021] GET /identity/v3/services?type=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:56.146034 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bfd81-c013-48bc-b70f-71376c8256ab None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:56.146538 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bfd81-c013-48bc-b70f-71376c8256ab None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:56.146538 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bfd81-c013-48bc-b70f-71376c8256ab None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:56.148834 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 331/661] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:24:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:56.154644 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31185a03-6199-4624-b6fe-55cba718635f None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:56.155384 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31185a03-6199-4624-b6fe-55cba718635f None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:56.155384 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31185a03-6199-4624-b6fe-55cba718635f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:56.178308 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-31185a03-6199-4624-b6fe-55cba718635f None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:56.179489 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-31185a03-6199-4624-b6fe-55cba718635f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:56.186944 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 331/662] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:56 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:24:56.211373 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794bfd81-c013-48bc-b70f-71376c8256ab None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:56.223462 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794bfd81-c013-48bc-b70f-71376c8256ab None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:56.227803 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adcb6e6-1856-4d92-9330-a6e66e3f4686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:56.228412 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcb6e6-1856-4d92-9330-a6e66e3f4686 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:56.228703 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcb6e6-1856-4d92-9330-a6e66e3f4686 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:56.229018 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcb6e6-1856-4d92-9330-a6e66e3f4686 admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:56.229706 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adcb6e6-1856-4d92-9330-a6e66e3f4686 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:56.231325 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adcb6e6-1856-4d92-9330-a6e66e3f4686 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:56.246293 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 332/663] 10.222.0.64 () {60 vars in 1162 bytes} [Thu Dec 16 14:24:56 2021] POST /identity/v3/services => generated 242 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:24:58.413088 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c6051-9529-4091-84ed-7c5d5f777119 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:58.413634 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c6051-9529-4091-84ed-7c5d5f777119 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:58.413836 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c6051-9529-4091-84ed-7c5d5f777119 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:58.415538 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 332/664] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:24:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:58.421293 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f747b6b-85d0-445e-9540-417b12e93219 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:58.421784 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f747b6b-85d0-445e-9540-417b12e93219 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:58.421869 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f747b6b-85d0-445e-9540-417b12e93219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:58.444081 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-4f747b6b-85d0-445e-9540-417b12e93219 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:58.445772 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-4f747b6b-85d0-445e-9540-417b12e93219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:58.463094 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 333/665] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:58 2021] POST /identity/v3/auth/tokens => generated 1712 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:58.486083 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c6051-9529-4091-84ed-7c5d5f777119 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:58.497984 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c6051-9529-4091-84ed-7c5d5f777119 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:58.502057 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3dce4-9334-42b1-b075-3099d5d68a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:58.502817 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3dce4-9334-42b1-b075-3099d5d68a45 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:58.503049 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3dce4-9334-42b1-b075-3099d5d68a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:58.503334 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3dce4-9334-42b1-b075-3099d5d68a45 admin admin] PATH_INFO: `/v3/services/image` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:58.503959 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3dce4-9334-42b1-b075-3099d5d68a45 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:58.505578 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3dce4-9334-42b1-b075-3099d5d68a45 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:58.516128 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-c9c3dce4-9334-42b1-b075-3099d5d68a45 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 16 14:24:58.517266 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 333/666] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Dec 16 14:24:58 2021] GET /identity/v3/services/image => generated 86 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:58.523199 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f747b6b-85d0-445e-9540-417b12e93219 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:58.531777 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f747b6b-85d0-445e-9540-417b12e93219 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:58.535947 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75bd31-30f7-4b67-968d-3cb35823797b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:58.536532 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75bd31-30f7-4b67-968d-3cb35823797b admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:58.536855 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75bd31-30f7-4b67-968d-3cb35823797b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:58.537141 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75bd31-30f7-4b67-968d-3cb35823797b admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:58.537810 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75bd31-30f7-4b67-968d-3cb35823797b admin admin] RBAC: Adding query filter params (name=image) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:58.538109 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75bd31-30f7-4b67-968d-3cb35823797b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:58.539693 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75bd31-30f7-4b67-968d-3cb35823797b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:58.544158 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 334/667] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:58 2021] GET /identity/v3/services?name=image => generated 122 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:58.549587 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3dce4-9334-42b1-b075-3099d5d68a45 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:58.559374 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3dce4-9334-42b1-b075-3099d5d68a45 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:58.563552 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec96d6-3e1c-46c0-99db-a219eee07d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:58.564137 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec96d6-3e1c-46c0-99db-a219eee07d0d admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:58.564431 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec96d6-3e1c-46c0-99db-a219eee07d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:58.564718 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec96d6-3e1c-46c0-99db-a219eee07d0d admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:58.565538 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec96d6-3e1c-46c0-99db-a219eee07d0d admin admin] RBAC: Adding query filter params (type=image) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:58.566114 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec96d6-3e1c-46c0-99db-a219eee07d0d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:58.567685 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec96d6-3e1c-46c0-99db-a219eee07d0d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:58.573091 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 334/668] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:58 2021] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:58.578620 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75bd31-30f7-4b67-968d-3cb35823797b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:58.587697 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75bd31-30f7-4b67-968d-3cb35823797b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:58.591816 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcd451-c319-41cf-9af9-c7341964f040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:58.592383 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcd451-c319-41cf-9af9-c7341964f040 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:58.592668 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcd451-c319-41cf-9af9-c7341964f040 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:58.592975 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcd451-c319-41cf-9af9-c7341964f040 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:58.593718 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addcd451-c319-41cf-9af9-c7341964f040 admin admin] RBAC: Adding query filter params (interface=public, service_id=b676ae6ae7d447679e14c7fc7cb3ece2, region_id=RegionOne) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:24:58.594020 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addcd451-c319-41cf-9af9-c7341964f040 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:58.595578 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addcd451-c319-41cf-9af9-c7341964f040 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:58.600601 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 335/669] 10.222.0.64 () {56 vars in 1272 bytes} [Thu Dec 16 14:24:58 2021] GET /identity/v3/endpoints?service_id=b676ae6ae7d447679e14c7fc7cb3ece2&interface=public®ion_id=RegionOne => generated 194 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:58.605804 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec96d6-3e1c-46c0-99db-a219eee07d0d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:58.614975 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec96d6-3e1c-46c0-99db-a219eee07d0d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:58.619562 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e445ee1-517b-4aca-a711-6f779f49e7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:58.620130 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e445ee1-517b-4aca-a711-6f779f49e7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:58.620416 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e445ee1-517b-4aca-a711-6f779f49e7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:58.620697 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e445ee1-517b-4aca-a711-6f779f49e7a3 admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:58.621371 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e445ee1-517b-4aca-a711-6f779f49e7a3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:58.622914 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e445ee1-517b-4aca-a711-6f779f49e7a3 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:24:58.628716 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 335/670] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Dec 16 14:24:58 2021] GET /identity/v3/services => generated 1022 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:25:00.716548 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef364b2-ce1c-484f-9ec4-41640b3e93b8 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:00.717125 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef364b2-ce1c-484f-9ec4-41640b3e93b8 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:00.717240 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef364b2-ce1c-484f-9ec4-41640b3e93b8 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:00.718837 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 336/671] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:25:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:00.724105 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b553b9-65fa-45ec-ad1b-6099ea78ae36 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:00.724501 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b553b9-65fa-45ec-ad1b-6099ea78ae36 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:00.724679 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b553b9-65fa-45ec-ad1b-6099ea78ae36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:00.748484 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-92b553b9-65fa-45ec-ad1b-6099ea78ae36 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:00.749653 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-92b553b9-65fa-45ec-ad1b-6099ea78ae36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:00.756524 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 336/672] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:00 2021] POST /identity/v3/auth/tokens => generated 1712 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:00.779909 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef364b2-ce1c-484f-9ec4-41640b3e93b8 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:00.792391 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef364b2-ce1c-484f-9ec4-41640b3e93b8 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:00.796382 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd9a26-4522-4a38-b961-8fa15bedb631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:00.797120 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd9a26-4522-4a38-b961-8fa15bedb631 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:00.797407 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd9a26-4522-4a38-b961-8fa15bedb631 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:00.797690 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd9a26-4522-4a38-b961-8fa15bedb631 admin admin] PATH_INFO: `/v3/services/image` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:00.798307 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd9a26-4522-4a38-b961-8fa15bedb631 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:00.799907 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd9a26-4522-4a38-b961-8fa15bedb631 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:00.809938 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-1dfd9a26-4522-4a38-b961-8fa15bedb631 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 16 14:25:00.811001 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 337/673] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Dec 16 14:25:00 2021] GET /identity/v3/services/image => generated 86 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:00.817226 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b553b9-65fa-45ec-ad1b-6099ea78ae36 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:00.825969 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b553b9-65fa-45ec-ad1b-6099ea78ae36 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:00.830168 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6eb7d0-1b57-4d14-823f-aab6a25666c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:00.830754 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6eb7d0-1b57-4d14-823f-aab6a25666c4 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:00.831042 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6eb7d0-1b57-4d14-823f-aab6a25666c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:00.831322 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6eb7d0-1b57-4d14-823f-aab6a25666c4 admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:00.831992 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6eb7d0-1b57-4d14-823f-aab6a25666c4 admin admin] RBAC: Adding query filter params (name=image) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:00.832290 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6eb7d0-1b57-4d14-823f-aab6a25666c4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:00.833876 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6eb7d0-1b57-4d14-823f-aab6a25666c4 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:00.839026 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 337/674] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:25:00 2021] GET /identity/v3/services?name=image => generated 122 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:00.844854 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd9a26-4522-4a38-b961-8fa15bedb631 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:00.855349 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd9a26-4522-4a38-b961-8fa15bedb631 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:00.859508 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284c4de-0037-4aa4-a546-86796524347d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:00.860101 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284c4de-0037-4aa4-a546-86796524347d admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:00.860394 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284c4de-0037-4aa4-a546-86796524347d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:00.860680 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284c4de-0037-4aa4-a546-86796524347d admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:00.861392 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284c4de-0037-4aa4-a546-86796524347d admin admin] RBAC: Adding query filter params (type=image) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:00.861700 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284c4de-0037-4aa4-a546-86796524347d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:00.863285 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284c4de-0037-4aa4-a546-86796524347d admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:00.868105 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 338/675] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:25:00 2021] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:00.873732 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6eb7d0-1b57-4d14-823f-aab6a25666c4 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:00.882894 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6eb7d0-1b57-4d14-823f-aab6a25666c4 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:00.887047 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce875d-e292-4303-a557-4e8b07c566ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:00.887616 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce875d-e292-4303-a557-4e8b07c566ee admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:00.887904 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce875d-e292-4303-a557-4e8b07c566ee admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:00.888186 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce875d-e292-4303-a557-4e8b07c566ee admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:00.888905 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce875d-e292-4303-a557-4e8b07c566ee admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:00.890460 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce875d-e292-4303-a557-4e8b07c566ee admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:00.907868 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 338/676] 10.222.0.64 () {60 vars in 1165 bytes} [Thu Dec 16 14:25:00 2021] POST /identity/v3/endpoints => generated 327 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:25:03.005185 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f8af5-5683-4166-87ac-045cba2a2dfb None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:03.005700 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f8af5-5683-4166-87ac-045cba2a2dfb None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:03.005787 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f8af5-5683-4166-87ac-045cba2a2dfb None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:03.007941 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 339/677] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:25:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:03.013305 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb1b7c-dd72-4822-b39d-e29fe010db82 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:03.013722 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb1b7c-dd72-4822-b39d-e29fe010db82 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:03.013877 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb1b7c-dd72-4822-b39d-e29fe010db82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:03.036339 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-7deb1b7c-dd72-4822-b39d-e29fe010db82 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:03.037520 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-7deb1b7c-dd72-4822-b39d-e29fe010db82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:03.053704 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 339/678] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:03 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:03.077339 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f8af5-5683-4166-87ac-045cba2a2dfb None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:03.089047 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f8af5-5683-4166-87ac-045cba2a2dfb None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:03.093143 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990f8f5-65f1-48e0-851d-2758b421724d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:03.093712 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990f8f5-65f1-48e0-851d-2758b421724d admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:03.094005 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990f8f5-65f1-48e0-851d-2758b421724d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:03.094292 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990f8f5-65f1-48e0-851d-2758b421724d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:03.101896 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990f8f5-65f1-48e0-851d-2758b421724d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:03.103631 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990f8f5-65f1-48e0-851d-2758b421724d admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:03.112464 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 340/679] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:25:03 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:25:03.118668 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb1b7c-dd72-4822-b39d-e29fe010db82 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:03.127685 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb1b7c-dd72-4822-b39d-e29fe010db82 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:03.131916 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c88765-1ddd-4237-8532-c8504a24a60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:03.133240 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c88765-1ddd-4237-8532-c8504a24a60a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:03.133536 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c88765-1ddd-4237-8532-c8504a24a60a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:03.133818 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c88765-1ddd-4237-8532-c8504a24a60a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:03.135013 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c88765-1ddd-4237-8532-c8504a24a60a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:03.136682 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c88765-1ddd-4237-8532-c8504a24a60a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:03.138193 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 340/680] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:25:03 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:05.441077 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3aed88-afab-4fb1-8f15-fdbab1c3513f None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:05.441678 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3aed88-afab-4fb1-8f15-fdbab1c3513f None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:05.441678 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3aed88-afab-4fb1-8f15-fdbab1c3513f None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:05.443335 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 341/681] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:25:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:05.448913 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41e62d-af9f-4662-9c16-49cb35b0baa9 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:05.449445 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41e62d-af9f-4662-9c16-49cb35b0baa9 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:05.449550 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41e62d-af9f-4662-9c16-49cb35b0baa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:05.471873 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-ca41e62d-af9f-4662-9c16-49cb35b0baa9 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:05.473040 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-ca41e62d-af9f-4662-9c16-49cb35b0baa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:05.480642 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 341/682] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:05 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:05.504927 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3aed88-afab-4fb1-8f15-fdbab1c3513f None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:05.525422 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3aed88-afab-4fb1-8f15-fdbab1c3513f None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:05.529457 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254997c-560b-4291-a274-b4078ec411f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:05.530176 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254997c-560b-4291-a274-b4078ec411f4 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:05.530463 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254997c-560b-4291-a274-b4078ec411f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:05.530744 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254997c-560b-4291-a274-b4078ec411f4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:05.543006 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254997c-560b-4291-a274-b4078ec411f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:05.544854 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254997c-560b-4291-a274-b4078ec411f4 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:05.561803 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-1254997c-560b-4291-a274-b4078ec411f4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:25:05.562943 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 342/683] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:25:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:05.569395 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41e62d-af9f-4662-9c16-49cb35b0baa9 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:05.578883 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41e62d-af9f-4662-9c16-49cb35b0baa9 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:05.583139 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6c66a-ea23-44c4-a125-b3b5e59467c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:05.583728 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6c66a-ea23-44c4-a125-b3b5e59467c3 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:05.584021 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6c66a-ea23-44c4-a125-b3b5e59467c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:05.584305 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6c66a-ea23-44c4-a125-b3b5e59467c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:05.585538 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6c66a-ea23-44c4-a125-b3b5e59467c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:05.585842 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6c66a-ea23-44c4-a125-b3b5e59467c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:05.587421 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6c66a-ea23-44c4-a125-b3b5e59467c3 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:05.602497 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 342/684] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:25:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:05.608294 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254997c-560b-4291-a274-b4078ec411f4 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:05.617705 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254997c-560b-4291-a274-b4078ec411f4 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:05.621907 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4b832-2ef6-4b42-8068-1476e74a3644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:05.622507 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4b832-2ef6-4b42-8068-1476e74a3644 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:05.622799 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4b832-2ef6-4b42-8068-1476e74a3644 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:05.623130 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4b832-2ef6-4b42-8068-1476e74a3644 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:05.623777 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4b832-2ef6-4b42-8068-1476e74a3644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:05.625727 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4b832-2ef6-4b42-8068-1476e74a3644 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:05.645706 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 343/685] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Dec 16 14:25:05 2021] POST /identity/v3/users => generated 248 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:25:07.769057 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63a8ff-c70b-43f2-856a-e31c60511dde None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:07.769912 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63a8ff-c70b-43f2-856a-e31c60511dde None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:07.770074 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63a8ff-c70b-43f2-856a-e31c60511dde None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:07.771856 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 343/686] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:25:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:07.778375 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b220afb-2959-48e6-88b6-be1bef67a3a0 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:07.778934 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b220afb-2959-48e6-88b6-be1bef67a3a0 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:07.779032 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b220afb-2959-48e6-88b6-be1bef67a3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:07.805445 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-5b220afb-2959-48e6-88b6-be1bef67a3a0 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:07.807491 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-5b220afb-2959-48e6-88b6-be1bef67a3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:07.816750 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 344/687] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:07 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:07.841535 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63a8ff-c70b-43f2-856a-e31c60511dde None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:07.854016 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63a8ff-c70b-43f2-856a-e31c60511dde None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:07.858357 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7c592-4fb3-40fb-8031-efdc764e0808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:07.859083 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7c592-4fb3-40fb-8031-efdc764e0808 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:07.859375 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7c592-4fb3-40fb-8031-efdc764e0808 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:07.859656 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7c592-4fb3-40fb-8031-efdc764e0808 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:07.872829 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7c592-4fb3-40fb-8031-efdc764e0808 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:25:07.879400 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-eca7c592-4fb3-40fb-8031-efdc764e0808 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:25:07.880609 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 344/688] 10.222.0.64 () {56 vars in 1123 bytes} [Thu Dec 16 14:25:07 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:25:07.887362 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b220afb-2959-48e6-88b6-be1bef67a3a0 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:07.896317 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b220afb-2959-48e6-88b6-be1bef67a3a0 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:07.900568 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2f574-adde-4320-ac07-a2465eeb83e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:07.901238 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2f574-adde-4320-ac07-a2465eeb83e3 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:07.901528 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2f574-adde-4320-ac07-a2465eeb83e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:07.901811 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2f574-adde-4320-ac07-a2465eeb83e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:07.902537 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2f574-adde-4320-ac07-a2465eeb83e3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:07.902840 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2f574-adde-4320-ac07-a2465eeb83e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:07.904479 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2f574-adde-4320-ac07-a2465eeb83e3 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:07.914268 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 345/689] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Dec 16 14:25:07 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:07.920466 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7c592-4fb3-40fb-8031-efdc764e0808 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:07.934891 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7c592-4fb3-40fb-8031-efdc764e0808 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:07.939144 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0d5d6-4d92-400d-9cc1-60c9e20f5f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:07.939862 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0d5d6-4d92-400d-9cc1-60c9e20f5f69 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:07.940145 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0d5d6-4d92-400d-9cc1-60c9e20f5f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:07.940678 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0d5d6-4d92-400d-9cc1-60c9e20f5f69 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:07.952303 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0d5d6-4d92-400d-9cc1-60c9e20f5f69 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:07.954157 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0d5d6-4d92-400d-9cc1-60c9e20f5f69 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:07.971129 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-23e0d5d6-4d92-400d-9cc1-60c9e20f5f69 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:25:07.972256 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 345/690] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:25:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:07.978625 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2f574-adde-4320-ac07-a2465eeb83e3 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:07.988052 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2f574-adde-4320-ac07-a2465eeb83e3 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:07.992952 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d375b-0dd7-4782-9184-2b595184b17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:07.993551 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d375b-0dd7-4782-9184-2b595184b17c admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:07.993901 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d375b-0dd7-4782-9184-2b595184b17c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:07.994122 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d375b-0dd7-4782-9184-2b595184b17c admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:07.994819 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d375b-0dd7-4782-9184-2b595184b17c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:07.995122 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d375b-0dd7-4782-9184-2b595184b17c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:07.996704 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d375b-0dd7-4782-9184-2b595184b17c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:08.009388 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 346/691] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:25:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:25:08.015137 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0d5d6-4d92-400d-9cc1-60c9e20f5f69 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:08.025196 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0d5d6-4d92-400d-9cc1-60c9e20f5f69 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:08.029476 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7b907-7ded-407c-b466-5840e7ffda5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:08.030185 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7b907-7ded-407c-b466-5840e7ffda5a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:08.030479 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7b907-7ded-407c-b466-5840e7ffda5a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:08.030763 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7b907-7ded-407c-b466-5840e7ffda5a admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:08.044841 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7b907-7ded-407c-b466-5840e7ffda5a admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:08.047567 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7b907-7ded-407c-b466-5840e7ffda5a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:08.066950 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-4ec7b907-7ded-407c-b466-5840e7ffda5a admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 16 14:25:08.068123 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 346/692] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:25:08 2021] GET /identity/v3/users/cinder => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:08.074039 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d375b-0dd7-4782-9184-2b595184b17c admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:08.083446 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d375b-0dd7-4782-9184-2b595184b17c admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:08.087664 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bca17f-179c-4854-9cd4-b0c514e4c712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:08.088262 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bca17f-179c-4854-9cd4-b0c514e4c712 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:08.088556 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bca17f-179c-4854-9cd4-b0c514e4c712 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:08.088867 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bca17f-179c-4854-9cd4-b0c514e4c712 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:08.089661 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bca17f-179c-4854-9cd4-b0c514e4c712 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:08.089966 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bca17f-179c-4854-9cd4-b0c514e4c712 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:08.091803 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bca17f-179c-4854-9cd4-b0c514e4c712 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:08.121760 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 347/693] 10.222.0.64 () {56 vars in 1158 bytes} [Thu Dec 16 14:25:08 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:08.127873 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7b907-7ded-407c-b466-5840e7ffda5a admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:08.137817 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7b907-7ded-407c-b466-5840e7ffda5a admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:08.143790 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767ff67-19f2-4e68-bb18-d8bd072966c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:08.144366 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767ff67-19f2-4e68-bb18-d8bd072966c7 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:08.144658 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767ff67-19f2-4e68-bb18-d8bd072966c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:08.144979 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767ff67-19f2-4e68-bb18-d8bd072966c7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:08.154783 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767ff67-19f2-4e68-bb18-d8bd072966c7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:08.156799 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767ff67-19f2-4e68-bb18-d8bd072966c7 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:08.165888 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 347/694] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:25:08 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:25:08.172155 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bca17f-179c-4854-9cd4-b0c514e4c712 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:08.182169 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bca17f-179c-4854-9cd4-b0c514e4c712 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:08.186317 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba63026-12f9-4117-8f07-118ba866833c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:08.187032 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba63026-12f9-4117-8f07-118ba866833c admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:08.187320 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba63026-12f9-4117-8f07-118ba866833c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:08.187603 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba63026-12f9-4117-8f07-118ba866833c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:08.199867 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba63026-12f9-4117-8f07-118ba866833c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:08.201730 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba63026-12f9-4117-8f07-118ba866833c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:08.218313 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-3ba63026-12f9-4117-8f07-118ba866833c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:25:08.219420 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 348/695] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:25:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:08.225288 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767ff67-19f2-4e68-bb18-d8bd072966c7 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:08.234524 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767ff67-19f2-4e68-bb18-d8bd072966c7 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:08.239012 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba5f7d-a1be-4d63-a2c5-301cba05e48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:08.239572 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba5f7d-a1be-4d63-a2c5-301cba05e48f admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:08.239865 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba5f7d-a1be-4d63-a2c5-301cba05e48f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:08.240155 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba5f7d-a1be-4d63-a2c5-301cba05e48f admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:08.240884 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba5f7d-a1be-4d63-a2c5-301cba05e48f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:08.241962 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba5f7d-a1be-4d63-a2c5-301cba05e48f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:08.243955 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba5f7d-a1be-4d63-a2c5-301cba05e48f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:08.256543 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 348/696] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:25:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:08.262264 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba63026-12f9-4117-8f07-118ba866833c admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:08.271638 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba63026-12f9-4117-8f07-118ba866833c admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:08.276386 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c27c7-672c-4e6e-a548-eb541368bccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:08.277081 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c27c7-672c-4e6e-a548-eb541368bccc admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:08.277374 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c27c7-672c-4e6e-a548-eb541368bccc admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:08.277654 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c27c7-672c-4e6e-a548-eb541368bccc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:08.286023 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c27c7-672c-4e6e-a548-eb541368bccc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:08.288593 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c27c7-672c-4e6e-a548-eb541368bccc admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:08.301865 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-524c27c7-672c-4e6e-a548-eb541368bccc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:25:08.302941 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 349/697] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:25:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:08.309126 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba5f7d-a1be-4d63-a2c5-301cba05e48f admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:08.318837 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba5f7d-a1be-4d63-a2c5-301cba05e48f admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:08.322914 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e6dff-f27f-4331-8685-2c4ded8a84a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:08.323499 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e6dff-f27f-4331-8685-2c4ded8a84a2 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:08.323787 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e6dff-f27f-4331-8685-2c4ded8a84a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:08.324061 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e6dff-f27f-4331-8685-2c4ded8a84a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:08.324831 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e6dff-f27f-4331-8685-2c4ded8a84a2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:08.325139 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e6dff-f27f-4331-8685-2c4ded8a84a2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:08.326963 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e6dff-f27f-4331-8685-2c4ded8a84a2 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:08.341673 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 349/698] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:25:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:08.348157 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c27c7-672c-4e6e-a548-eb541368bccc admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:08.358527 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c27c7-672c-4e6e-a548-eb541368bccc admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:08.362713 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42abccf-559e-4f1f-abd3-8163fa55d9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:08.363294 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42abccf-559e-4f1f-abd3-8163fa55d9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:08.363583 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42abccf-559e-4f1f-abd3-8163fa55d9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:08.363866 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42abccf-559e-4f1f-abd3-8163fa55d9a3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:08.364644 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42abccf-559e-4f1f-abd3-8163fa55d9a3 admin admin] RBAC: Adding query filter params (role.id=07f29be2087e43caaf6845ecf113b6e7, scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55, user.id=0050dc5fdd5641318319ff698112188c) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:08.364973 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42abccf-559e-4f1f-abd3-8163fa55d9a3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:08.366811 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42abccf-559e-4f1f-abd3-8163fa55d9a3 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:08.372536 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 350/699] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:25:08 2021] GET /identity/v3/role_assignments?user.id=0050dc5fdd5641318319ff698112188c&scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55&role.id=07f29be2087e43caaf6845ecf113b6e7 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:10.420443 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982f345-a589-4654-b499-bc03e6106877 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:10.421027 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982f345-a589-4654-b499-bc03e6106877 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:10.421027 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982f345-a589-4654-b499-bc03e6106877 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:10.422670 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 350/700] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:25:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:10.427801 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1d3f8-899f-426b-af78-f26d8ef42ad9 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:10.428173 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1d3f8-899f-426b-af78-f26d8ef42ad9 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:10.428376 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1d3f8-899f-426b-af78-f26d8ef42ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:10.451943 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-b3e1d3f8-899f-426b-af78-f26d8ef42ad9 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:10.453127 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-b3e1d3f8-899f-426b-af78-f26d8ef42ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:10.460666 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 351/701] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:10 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:10.482703 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982f345-a589-4654-b499-bc03e6106877 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:10.494250 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982f345-a589-4654-b499-bc03e6106877 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:10.498203 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea428e-5cd0-4282-ba0f-72bf6d2b47f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:10.498906 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea428e-5cd0-4282-ba0f-72bf6d2b47f1 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:10.499191 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea428e-5cd0-4282-ba0f-72bf6d2b47f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:10.499466 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea428e-5cd0-4282-ba0f-72bf6d2b47f1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:10.511316 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea428e-5cd0-4282-ba0f-72bf6d2b47f1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:25:10.517874 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-7cea428e-5cd0-4282-ba0f-72bf6d2b47f1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:25:10.518966 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 351/702] 10.222.0.64 () {56 vars in 1123 bytes} [Thu Dec 16 14:25:10 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:10.525612 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1d3f8-899f-426b-af78-f26d8ef42ad9 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:10.534195 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1d3f8-899f-426b-af78-f26d8ef42ad9 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:10.538406 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c3444-21b5-42dd-bdd6-333d765f2497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:10.538997 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c3444-21b5-42dd-bdd6-333d765f2497 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:10.539282 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c3444-21b5-42dd-bdd6-333d765f2497 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:10.539567 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c3444-21b5-42dd-bdd6-333d765f2497 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:10.540286 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c3444-21b5-42dd-bdd6-333d765f2497 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:10.540587 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c3444-21b5-42dd-bdd6-333d765f2497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:10.542216 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c3444-21b5-42dd-bdd6-333d765f2497 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:10.550352 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 352/703] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Dec 16 14:25:10 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:10.556404 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea428e-5cd0-4282-ba0f-72bf6d2b47f1 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:10.566297 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea428e-5cd0-4282-ba0f-72bf6d2b47f1 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:10.571280 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044f8b0-feeb-4676-ad2f-ebe3600b115f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:10.571980 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044f8b0-feeb-4676-ad2f-ebe3600b115f admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:10.572311 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044f8b0-feeb-4676-ad2f-ebe3600b115f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:10.572542 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044f8b0-feeb-4676-ad2f-ebe3600b115f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:10.583636 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044f8b0-feeb-4676-ad2f-ebe3600b115f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:10.585491 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044f8b0-feeb-4676-ad2f-ebe3600b115f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:10.602166 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-9044f8b0-feeb-4676-ad2f-ebe3600b115f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:25:10.603209 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 352/704] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:25:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:10.608643 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c3444-21b5-42dd-bdd6-333d765f2497 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:10.618405 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c3444-21b5-42dd-bdd6-333d765f2497 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:10.622559 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351a662-7902-4504-bfdb-cc9c431f3674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:10.623142 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351a662-7902-4504-bfdb-cc9c431f3674 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:10.623435 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351a662-7902-4504-bfdb-cc9c431f3674 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:10.623721 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351a662-7902-4504-bfdb-cc9c431f3674 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:10.624412 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351a662-7902-4504-bfdb-cc9c431f3674 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:10.624715 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351a662-7902-4504-bfdb-cc9c431f3674 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:10.626326 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351a662-7902-4504-bfdb-cc9c431f3674 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:10.639074 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 353/705] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:25:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:10.644472 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044f8b0-feeb-4676-ad2f-ebe3600b115f admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:10.653653 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044f8b0-feeb-4676-ad2f-ebe3600b115f admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:10.657824 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78916a1-ee1c-4562-93b3-b750aa0af0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:10.658537 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78916a1-ee1c-4562-93b3-b750aa0af0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:10.658820 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78916a1-ee1c-4562-93b3-b750aa0af0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:10.659097 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78916a1-ee1c-4562-93b3-b750aa0af0e1 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:10.672203 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78916a1-ee1c-4562-93b3-b750aa0af0e1 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:10.674157 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78916a1-ee1c-4562-93b3-b750aa0af0e1 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:10.692925 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-b78916a1-ee1c-4562-93b3-b750aa0af0e1 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 16 14:25:10.694121 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 353/706] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:25:10 2021] GET /identity/v3/users/cinder => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:10.700382 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351a662-7902-4504-bfdb-cc9c431f3674 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:10.710011 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351a662-7902-4504-bfdb-cc9c431f3674 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:10.714334 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c686a-2d32-46e9-a0e7-3eab214720cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:10.714930 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c686a-2d32-46e9-a0e7-3eab214720cd admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:10.715221 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c686a-2d32-46e9-a0e7-3eab214720cd admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:10.715510 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c686a-2d32-46e9-a0e7-3eab214720cd admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:10.716300 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c686a-2d32-46e9-a0e7-3eab214720cd admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:10.716607 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c686a-2d32-46e9-a0e7-3eab214720cd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:10.718491 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c686a-2d32-46e9-a0e7-3eab214720cd admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:10.747023 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 354/707] 10.222.0.64 () {56 vars in 1158 bytes} [Thu Dec 16 14:25:10 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:25:10.752684 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78916a1-ee1c-4562-93b3-b750aa0af0e1 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:10.762848 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78916a1-ee1c-4562-93b3-b750aa0af0e1 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:10.767007 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2933de-41de-4fda-ac12-d8e150cfb2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:10.767713 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2933de-41de-4fda-ac12-d8e150cfb2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:10.768001 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2933de-41de-4fda-ac12-d8e150cfb2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:10.768278 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2933de-41de-4fda-ac12-d8e150cfb2c7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:10.780303 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2933de-41de-4fda-ac12-d8e150cfb2c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:10.782146 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2933de-41de-4fda-ac12-d8e150cfb2c7 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:10.799045 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-9c2933de-41de-4fda-ac12-d8e150cfb2c7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:25:10.800102 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 354/708] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:25:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:25:10.805830 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c686a-2d32-46e9-a0e7-3eab214720cd admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:10.815417 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c686a-2d32-46e9-a0e7-3eab214720cd admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:10.820102 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09510a8-ab35-4a82-8d0d-ccbcd48f301b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:10.820694 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09510a8-ab35-4a82-8d0d-ccbcd48f301b admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:10.821010 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09510a8-ab35-4a82-8d0d-ccbcd48f301b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:10.821294 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09510a8-ab35-4a82-8d0d-ccbcd48f301b admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:10.821984 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09510a8-ab35-4a82-8d0d-ccbcd48f301b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:10.822286 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09510a8-ab35-4a82-8d0d-ccbcd48f301b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:10.823865 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09510a8-ab35-4a82-8d0d-ccbcd48f301b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:10.836273 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 355/709] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:25:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:10.841883 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2933de-41de-4fda-ac12-d8e150cfb2c7 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:10.851726 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2933de-41de-4fda-ac12-d8e150cfb2c7 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:10.856032 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304a941-e1ac-469c-bd28-07c6f57bddc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:10.856752 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304a941-e1ac-469c-bd28-07c6f57bddc3 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:10.856960 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304a941-e1ac-469c-bd28-07c6f57bddc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:10.857246 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304a941-e1ac-469c-bd28-07c6f57bddc3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:10.865936 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b304a941-e1ac-469c-bd28-07c6f57bddc3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:10.867885 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b304a941-e1ac-469c-bd28-07c6f57bddc3 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:10.882132 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-b304a941-e1ac-469c-bd28-07c6f57bddc3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:25:10.883267 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 355/710] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:25:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:10.889052 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09510a8-ab35-4a82-8d0d-ccbcd48f301b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:10.899329 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09510a8-ab35-4a82-8d0d-ccbcd48f301b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:10.903713 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d25414-8839-4b8e-8cd9-853d47ce2380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:10.904308 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d25414-8839-4b8e-8cd9-853d47ce2380 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:10.904593 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d25414-8839-4b8e-8cd9-853d47ce2380 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:10.904900 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d25414-8839-4b8e-8cd9-853d47ce2380 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:10.905663 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d25414-8839-4b8e-8cd9-853d47ce2380 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:10.905966 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d25414-8839-4b8e-8cd9-853d47ce2380 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:10.907811 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d25414-8839-4b8e-8cd9-853d47ce2380 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:10.921154 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 356/711] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:25:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:10.927397 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304a941-e1ac-469c-bd28-07c6f57bddc3 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:10.936911 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304a941-e1ac-469c-bd28-07c6f57bddc3 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:10.941444 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55912bd7-aa7e-4ac7-ae36-bf8ede917835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:10.942262 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55912bd7-aa7e-4ac7-ae36-bf8ede917835 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:10.942555 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55912bd7-aa7e-4ac7-ae36-bf8ede917835 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:10.942842 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55912bd7-aa7e-4ac7-ae36-bf8ede917835 admin admin] PATH_INFO: `/v3/projects/244c8ef98d0445c6a0279c46d5cb7e55/users/0050dc5fdd5641318319ff698112188c/roles/07f29be2087e43caaf6845ecf113b6e7` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:10.964294 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55912bd7-aa7e-4ac7-ae36-bf8ede917835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=244c8ef98d0445c6a0279c46d5cb7e55, user_id=0050dc5fdd5641318319ff698112188c, role_id=07f29be2087e43caaf6845ecf113b6e7)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:10.967027 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55912bd7-aa7e-4ac7-ae36-bf8ede917835 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:10.980753 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 356/712] 10.222.0.64 () {58 vars in 1460 bytes} [Thu Dec 16 14:25:10 2021] PUT /identity/v3/projects/244c8ef98d0445c6a0279c46d5cb7e55/users/0050dc5fdd5641318319ff698112188c/roles/07f29be2087e43caaf6845ecf113b6e7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:25:13.057744 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dff6f2-6aac-4f15-826f-2c9165e605df None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:13.058345 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dff6f2-6aac-4f15-826f-2c9165e605df None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:13.058345 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dff6f2-6aac-4f15-826f-2c9165e605df None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:13.059982 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 357/713] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:25:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:13.065603 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f9946-4d5b-49d4-90e7-ac492daef03f None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:13.066078 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f9946-4d5b-49d4-90e7-ac492daef03f None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:13.066181 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f9946-4d5b-49d4-90e7-ac492daef03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:13.088886 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-413f9946-4d5b-49d4-90e7-ac492daef03f None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:13.090060 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-413f9946-4d5b-49d4-90e7-ac492daef03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:13.155454 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 357/714] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:13 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:13.178229 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dff6f2-6aac-4f15-826f-2c9165e605df None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:13.190406 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dff6f2-6aac-4f15-826f-2c9165e605df None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:13.194964 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4e05e-707b-4c48-8617-e97a7f2601b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:13.195680 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4e05e-707b-4c48-8617-e97a7f2601b0 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:13.195967 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4e05e-707b-4c48-8617-e97a7f2601b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:13.196251 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4e05e-707b-4c48-8617-e97a7f2601b0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:13.208024 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4e05e-707b-4c48-8617-e97a7f2601b0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:25:13.215276 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-7fa4e05e-707b-4c48-8617-e97a7f2601b0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:25:13.216489 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 358/715] 10.222.0.64 () {56 vars in 1123 bytes} [Thu Dec 16 14:25:13 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:13.222560 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f9946-4d5b-49d4-90e7-ac492daef03f None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:13.231697 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f9946-4d5b-49d4-90e7-ac492daef03f None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:13.236345 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9047d17-452f-420b-8bd9-a52d1c7e80c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:13.237073 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9047d17-452f-420b-8bd9-a52d1c7e80c0 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:13.237301 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9047d17-452f-420b-8bd9-a52d1c7e80c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:13.237586 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9047d17-452f-420b-8bd9-a52d1c7e80c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:13.238316 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9047d17-452f-420b-8bd9-a52d1c7e80c0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:13.238622 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9047d17-452f-420b-8bd9-a52d1c7e80c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:13.240226 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9047d17-452f-420b-8bd9-a52d1c7e80c0 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:13.249566 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 358/716] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Dec 16 14:25:13 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:13.255205 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4e05e-707b-4c48-8617-e97a7f2601b0 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:13.265999 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4e05e-707b-4c48-8617-e97a7f2601b0 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:13.270377 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae9333-8d84-4e15-a6fb-2da179fb8185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:13.271109 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae9333-8d84-4e15-a6fb-2da179fb8185 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:13.271401 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae9333-8d84-4e15-a6fb-2da179fb8185 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:13.271687 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae9333-8d84-4e15-a6fb-2da179fb8185 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:13.284175 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae9333-8d84-4e15-a6fb-2da179fb8185 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:13.286084 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae9333-8d84-4e15-a6fb-2da179fb8185 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:13.305362 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-0fae9333-8d84-4e15-a6fb-2da179fb8185 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:25:13.306512 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 359/717] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:25:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:13.312465 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9047d17-452f-420b-8bd9-a52d1c7e80c0 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:13.326230 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9047d17-452f-420b-8bd9-a52d1c7e80c0 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:13.331193 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b2c28-359f-4c17-8c93-1752047156d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:13.331838 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b2c28-359f-4c17-8c93-1752047156d3 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:13.332133 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b2c28-359f-4c17-8c93-1752047156d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:13.332421 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b2c28-359f-4c17-8c93-1752047156d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:13.333153 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b2c28-359f-4c17-8c93-1752047156d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:13.333456 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b2c28-359f-4c17-8c93-1752047156d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:13.335643 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b2c28-359f-4c17-8c93-1752047156d3 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:13.348627 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 359/718] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:25:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:13.354448 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae9333-8d84-4e15-a6fb-2da179fb8185 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:13.364063 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae9333-8d84-4e15-a6fb-2da179fb8185 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:13.368305 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5f7f5-c7d1-4f38-8d6d-c42a229c5d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:13.369058 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5f7f5-c7d1-4f38-8d6d-c42a229c5d36 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:13.369347 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5f7f5-c7d1-4f38-8d6d-c42a229c5d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:13.369631 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5f7f5-c7d1-4f38-8d6d-c42a229c5d36 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:13.383446 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5f7f5-c7d1-4f38-8d6d-c42a229c5d36 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:13.385586 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5f7f5-c7d1-4f38-8d6d-c42a229c5d36 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:13.403314 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-69b5f7f5-c7d1-4f38-8d6d-c42a229c5d36 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 16 14:25:13.404392 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 360/719] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:25:13 2021] GET /identity/v3/users/cinder => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:13.410181 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b2c28-359f-4c17-8c93-1752047156d3 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:13.419318 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b2c28-359f-4c17-8c93-1752047156d3 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:13.423413 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f00dcb-3684-47af-9657-9099e4a7e496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:13.423997 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f00dcb-3684-47af-9657-9099e4a7e496 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:13.424282 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f00dcb-3684-47af-9657-9099e4a7e496 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:13.424561 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f00dcb-3684-47af-9657-9099e4a7e496 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:13.425372 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f00dcb-3684-47af-9657-9099e4a7e496 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:13.425672 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f00dcb-3684-47af-9657-9099e4a7e496 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:13.427470 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f00dcb-3684-47af-9657-9099e4a7e496 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:13.456950 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 360/720] 10.222.0.64 () {56 vars in 1158 bytes} [Thu Dec 16 14:25:13 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:13.463139 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5f7f5-c7d1-4f38-8d6d-c42a229c5d36 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:13.472377 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5f7f5-c7d1-4f38-8d6d-c42a229c5d36 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:13.476493 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2f929-17b6-4a33-a987-75a714ee4017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:13.477090 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2f929-17b6-4a33-a987-75a714ee4017 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:13.477378 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2f929-17b6-4a33-a987-75a714ee4017 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:13.477659 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2f929-17b6-4a33-a987-75a714ee4017 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:13.485093 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2f929-17b6-4a33-a987-75a714ee4017 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:13.486811 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2f929-17b6-4a33-a987-75a714ee4017 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:13.494960 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 361/721] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:25:13 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:25:13.500356 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f00dcb-3684-47af-9657-9099e4a7e496 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:13.509875 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f00dcb-3684-47af-9657-9099e4a7e496 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:13.514025 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e3ffe-34b1-4ba4-bcd5-05ad90c84f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:13.514726 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e3ffe-34b1-4ba4-bcd5-05ad90c84f78 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:13.515009 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e3ffe-34b1-4ba4-bcd5-05ad90c84f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:13.515288 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e3ffe-34b1-4ba4-bcd5-05ad90c84f78 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:13.527201 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e3ffe-34b1-4ba4-bcd5-05ad90c84f78 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:13.529016 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e3ffe-34b1-4ba4-bcd5-05ad90c84f78 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:13.545022 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-4e4e3ffe-34b1-4ba4-bcd5-05ad90c84f78 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:25:13.546057 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 361/722] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:25:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:13.551488 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2f929-17b6-4a33-a987-75a714ee4017 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:13.560425 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2f929-17b6-4a33-a987-75a714ee4017 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:13.564657 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a355d40-888c-458e-a10a-e201a661a55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:13.565533 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a355d40-888c-458e-a10a-e201a661a55d admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:13.565822 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a355d40-888c-458e-a10a-e201a661a55d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:13.566109 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a355d40-888c-458e-a10a-e201a661a55d admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:13.566851 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a355d40-888c-458e-a10a-e201a661a55d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:13.567198 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a355d40-888c-458e-a10a-e201a661a55d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:13.569525 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a355d40-888c-458e-a10a-e201a661a55d admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:13.582232 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 362/723] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:25:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:13.587578 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e3ffe-34b1-4ba4-bcd5-05ad90c84f78 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:13.596644 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e3ffe-34b1-4ba4-bcd5-05ad90c84f78 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:13.600706 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a4c6e-e23c-4130-9863-eea2a482a189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:13.601430 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a4c6e-e23c-4130-9863-eea2a482a189 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:13.601717 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a4c6e-e23c-4130-9863-eea2a482a189 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:13.601994 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a4c6e-e23c-4130-9863-eea2a482a189 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:13.610136 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a4c6e-e23c-4130-9863-eea2a482a189 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:13.612034 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a4c6e-e23c-4130-9863-eea2a482a189 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:13.625572 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-c14a4c6e-e23c-4130-9863-eea2a482a189 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:25:13.626599 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 362/724] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:25:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:13.632838 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a355d40-888c-458e-a10a-e201a661a55d admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:13.642056 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a355d40-888c-458e-a10a-e201a661a55d admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:13.646525 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c8593-32ce-48e0-80cd-7424c49df911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:13.647165 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c8593-32ce-48e0-80cd-7424c49df911 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:13.647457 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c8593-32ce-48e0-80cd-7424c49df911 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:13.647744 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c8593-32ce-48e0-80cd-7424c49df911 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:13.648507 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c8593-32ce-48e0-80cd-7424c49df911 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:13.648848 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c8593-32ce-48e0-80cd-7424c49df911 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:13.650709 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c8593-32ce-48e0-80cd-7424c49df911 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:13.664046 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 363/725] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:25:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:25:13.670045 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a4c6e-e23c-4130-9863-eea2a482a189 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:13.679803 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a4c6e-e23c-4130-9863-eea2a482a189 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:13.683940 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb62e36-4a10-4f80-a6b8-5f0f39a54ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:13.684511 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb62e36-4a10-4f80-a6b8-5f0f39a54ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:13.684825 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb62e36-4a10-4f80-a6b8-5f0f39a54ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:13.685122 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb62e36-4a10-4f80-a6b8-5f0f39a54ad6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:13.685888 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb62e36-4a10-4f80-a6b8-5f0f39a54ad6 admin admin] RBAC: Adding query filter params (role.id=07f29be2087e43caaf6845ecf113b6e7, scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55, user.id=0050dc5fdd5641318319ff698112188c) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:13.686192 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb62e36-4a10-4f80-a6b8-5f0f39a54ad6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:13.687998 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb62e36-4a10-4f80-a6b8-5f0f39a54ad6 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:13.693881 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 363/726] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:25:13 2021] GET /identity/v3/role_assignments?user.id=0050dc5fdd5641318319ff698112188c&scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55&role.id=07f29be2087e43caaf6845ecf113b6e7 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:15.786321 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28d19b-5c0b-4857-a68d-61c2c106f041 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:15.786845 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28d19b-5c0b-4857-a68d-61c2c106f041 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:15.786962 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28d19b-5c0b-4857-a68d-61c2c106f041 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:15.788647 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 364/727] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:25:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:15.793722 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5a805-4a42-4b5e-92e8-9f53c28d040b None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:15.794119 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5a805-4a42-4b5e-92e8-9f53c28d040b None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:15.794292 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5a805-4a42-4b5e-92e8-9f53c28d040b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:15.817182 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-82c5a805-4a42-4b5e-92e8-9f53c28d040b None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:15.818360 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-82c5a805-4a42-4b5e-92e8-9f53c28d040b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:15.825989 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 364/728] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:15 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:15.848302 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28d19b-5c0b-4857-a68d-61c2c106f041 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:15.860344 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28d19b-5c0b-4857-a68d-61c2c106f041 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:15.864405 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a968c7-aeb8-4ae1-83b6-acb93a5787f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:15.865172 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a968c7-aeb8-4ae1-83b6-acb93a5787f5 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:15.865464 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a968c7-aeb8-4ae1-83b6-acb93a5787f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:15.866254 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a968c7-aeb8-4ae1-83b6-acb93a5787f5 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:15.866886 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a968c7-aeb8-4ae1-83b6-acb93a5787f5 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:15.868492 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a968c7-aeb8-4ae1-83b6-acb93a5787f5 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:15.879461 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-e3a968c7-aeb8-4ae1-83b6-acb93a5787f5 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 16 14:25:15.880549 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 365/729] 10.222.0.64 () {56 vars in 1150 bytes} [Thu Dec 16 14:25:15 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:15.887197 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5a805-4a42-4b5e-92e8-9f53c28d040b None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:15.895897 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5a805-4a42-4b5e-92e8-9f53c28d040b None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:15.900191 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a2a74-1c46-4b12-937e-a5376f06582d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:15.900803 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a2a74-1c46-4b12-937e-a5376f06582d admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:15.901115 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a2a74-1c46-4b12-937e-a5376f06582d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:15.901400 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a2a74-1c46-4b12-937e-a5376f06582d admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:15.902112 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a2a74-1c46-4b12-937e-a5376f06582d admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:15.902416 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a2a74-1c46-4b12-937e-a5376f06582d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:15.904003 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a2a74-1c46-4b12-937e-a5376f06582d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:15.908762 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 365/730] 10.222.0.64 () {56 vars in 1145 bytes} [Thu Dec 16 14:25:15 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:15.914544 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a968c7-aeb8-4ae1-83b6-acb93a5787f5 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:15.923938 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a968c7-aeb8-4ae1-83b6-acb93a5787f5 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:15.928671 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e35a0a-89c1-46b0-aa34-c1d1df97d957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:15.929287 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e35a0a-89c1-46b0-aa34-c1d1df97d957 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:15.929571 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e35a0a-89c1-46b0-aa34-c1d1df97d957 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:15.929853 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e35a0a-89c1-46b0-aa34-c1d1df97d957 admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:15.930525 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e35a0a-89c1-46b0-aa34-c1d1df97d957 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:15.930829 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e35a0a-89c1-46b0-aa34-c1d1df97d957 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:15.932396 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e35a0a-89c1-46b0-aa34-c1d1df97d957 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:15.936930 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 366/731] 10.222.0.64 () {56 vars in 1145 bytes} [Thu Dec 16 14:25:15 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:17.998106 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90938533-29d6-4c9c-a31d-9321c1240954 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:17.998630 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90938533-29d6-4c9c-a31d-9321c1240954 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:17.998742 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90938533-29d6-4c9c-a31d-9321c1240954 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:18.000324 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 366/732] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:25:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:18.005767 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefe3a1-cc4b-46f4-aa7a-a94b66cc9512 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:18.006219 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefe3a1-cc4b-46f4-aa7a-a94b66cc9512 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:18.006219 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefe3a1-cc4b-46f4-aa7a-a94b66cc9512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:18.028654 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-ccefe3a1-cc4b-46f4-aa7a-a94b66cc9512 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:18.029874 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-ccefe3a1-cc4b-46f4-aa7a-a94b66cc9512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:18.036849 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 367/733] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:18 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:18.060257 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90938533-29d6-4c9c-a31d-9321c1240954 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:18.072568 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90938533-29d6-4c9c-a31d-9321c1240954 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:18.076688 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012e9c5-df85-4832-be95-253d716bf8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:18.077306 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012e9c5-df85-4832-be95-253d716bf8ad admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:18.077597 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012e9c5-df85-4832-be95-253d716bf8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:18.077880 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012e9c5-df85-4832-be95-253d716bf8ad admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:18.078555 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6012e9c5-df85-4832-be95-253d716bf8ad admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:18.080131 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6012e9c5-df85-4832-be95-253d716bf8ad admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:18.093414 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 367/734] 10.222.0.64 () {60 vars in 1162 bytes} [Thu Dec 16 14:25:18 2021] POST /identity/v3/services => generated 251 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:25:20.171744 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518213d-b663-492c-a0fa-5165a0870568 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:20.172261 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518213d-b663-492c-a0fa-5165a0870568 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:20.172261 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518213d-b663-492c-a0fa-5165a0870568 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:20.173937 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 368/735] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:25:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:20.179586 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883e3f9-a8ef-45ee-9e39-45fad68ca63a None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:20.179981 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883e3f9-a8ef-45ee-9e39-45fad68ca63a None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:20.180152 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883e3f9-a8ef-45ee-9e39-45fad68ca63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:20.202182 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-3883e3f9-a8ef-45ee-9e39-45fad68ca63a None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:20.203321 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-3883e3f9-a8ef-45ee-9e39-45fad68ca63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:20.221180 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 368/736] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:20 2021] POST /identity/v3/auth/tokens => generated 1965 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:20.244594 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518213d-b663-492c-a0fa-5165a0870568 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:20.257848 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518213d-b663-492c-a0fa-5165a0870568 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:20.261824 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84510ec2-5c7f-4084-9fc2-6bc8658435f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:20.262559 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84510ec2-5c7f-4084-9fc2-6bc8658435f4 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:20.262845 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84510ec2-5c7f-4084-9fc2-6bc8658435f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:20.263132 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84510ec2-5c7f-4084-9fc2-6bc8658435f4 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:20.263767 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84510ec2-5c7f-4084-9fc2-6bc8658435f4 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:20.265413 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84510ec2-5c7f-4084-9fc2-6bc8658435f4 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:20.277106 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-84510ec2-5c7f-4084-9fc2-6bc8658435f4 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 16 14:25:20.278225 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 369/737] 10.222.0.64 () {56 vars in 1150 bytes} [Thu Dec 16 14:25:20 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:20.288925 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883e3f9-a8ef-45ee-9e39-45fad68ca63a None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:20.300493 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883e3f9-a8ef-45ee-9e39-45fad68ca63a None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:20.304829 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58200ab-187f-4d8f-8b25-72ed7d5da758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:20.305427 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58200ab-187f-4d8f-8b25-72ed7d5da758 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:20.305719 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58200ab-187f-4d8f-8b25-72ed7d5da758 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:20.306003 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58200ab-187f-4d8f-8b25-72ed7d5da758 admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:20.306679 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58200ab-187f-4d8f-8b25-72ed7d5da758 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:20.306983 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58200ab-187f-4d8f-8b25-72ed7d5da758 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:20.308549 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58200ab-187f-4d8f-8b25-72ed7d5da758 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:20.313350 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 369/738] 10.222.0.64 () {56 vars in 1145 bytes} [Thu Dec 16 14:25:20 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:20.319350 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84510ec2-5c7f-4084-9fc2-6bc8658435f4 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:20.328857 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84510ec2-5c7f-4084-9fc2-6bc8658435f4 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:20.333360 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103bf18-1b95-4c87-8c9e-3326e63867af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:20.334424 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103bf18-1b95-4c87-8c9e-3326e63867af admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:20.334760 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103bf18-1b95-4c87-8c9e-3326e63867af admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:20.335042 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103bf18-1b95-4c87-8c9e-3326e63867af admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:20.335712 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103bf18-1b95-4c87-8c9e-3326e63867af admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:20.336061 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103bf18-1b95-4c87-8c9e-3326e63867af admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:20.337794 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103bf18-1b95-4c87-8c9e-3326e63867af admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:20.357527 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 370/739] 10.222.0.64 () {56 vars in 1145 bytes} [Thu Dec 16 14:25:20 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:25:20.363663 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58200ab-187f-4d8f-8b25-72ed7d5da758 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:20.373317 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58200ab-187f-4d8f-8b25-72ed7d5da758 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:20.377703 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed73e17-20d8-4704-9dba-684d7f378071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:20.378300 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed73e17-20d8-4704-9dba-684d7f378071 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:20.378639 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed73e17-20d8-4704-9dba-684d7f378071 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:20.378957 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed73e17-20d8-4704-9dba-684d7f378071 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:20.379873 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed73e17-20d8-4704-9dba-684d7f378071 admin admin] RBAC: Adding query filter params (interface=public, service_id=5ab88b82935d42a0add58cf2fc6832bb, region_id=RegionOne) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:20.380258 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed73e17-20d8-4704-9dba-684d7f378071 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:20.382043 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed73e17-20d8-4704-9dba-684d7f378071 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:20.388256 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 370/740] 10.222.0.64 () {56 vars in 1272 bytes} [Thu Dec 16 14:25:20 2021] GET /identity/v3/endpoints?service_id=5ab88b82935d42a0add58cf2fc6832bb&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:20.394348 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103bf18-1b95-4c87-8c9e-3326e63867af admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:20.404443 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103bf18-1b95-4c87-8c9e-3326e63867af admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:20.408665 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4ffda-278d-4617-904e-6e436431d72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:20.409295 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4ffda-278d-4617-904e-6e436431d72f admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:20.409588 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4ffda-278d-4617-904e-6e436431d72f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:20.409872 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4ffda-278d-4617-904e-6e436431d72f admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:20.410540 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4ffda-278d-4617-904e-6e436431d72f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:20.412195 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4ffda-278d-4617-904e-6e436431d72f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:20.418679 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 371/741] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Dec 16 14:25:20 2021] GET /identity/v3/services => generated 1261 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:25:22.528694 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95458bb1-dac9-4f27-b648-1cfd40e9c34a None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:22.529303 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95458bb1-dac9-4f27-b648-1cfd40e9c34a None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:22.529413 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95458bb1-dac9-4f27-b648-1cfd40e9c34a None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:22.531959 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 371/742] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:25:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:22.537520 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efdc44-19f9-4747-a847-6c1a8617d6f3 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:22.537989 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efdc44-19f9-4747-a847-6c1a8617d6f3 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:22.538096 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efdc44-19f9-4747-a847-6c1a8617d6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:22.560682 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-53efdc44-19f9-4747-a847-6c1a8617d6f3 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:22.561831 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-53efdc44-19f9-4747-a847-6c1a8617d6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:22.569870 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 372/743] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:22 2021] POST /identity/v3/auth/tokens => generated 1965 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:25:22.592727 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95458bb1-dac9-4f27-b648-1cfd40e9c34a None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:22.607199 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95458bb1-dac9-4f27-b648-1cfd40e9c34a None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:22.612150 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79628371-d978-46fd-ad43-301167d5977b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:22.613028 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79628371-d978-46fd-ad43-301167d5977b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:22.613354 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79628371-d978-46fd-ad43-301167d5977b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:22.613642 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79628371-d978-46fd-ad43-301167d5977b admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:22.614275 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79628371-d978-46fd-ad43-301167d5977b admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:22.616373 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79628371-d978-46fd-ad43-301167d5977b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:22.627732 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-79628371-d978-46fd-ad43-301167d5977b admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 16 14:25:22.628888 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 372/744] 10.222.0.64 () {56 vars in 1150 bytes} [Thu Dec 16 14:25:22 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:22.636419 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efdc44-19f9-4747-a847-6c1a8617d6f3 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:22.647249 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efdc44-19f9-4747-a847-6c1a8617d6f3 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:22.651873 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd0f48-787b-4685-baf0-5750a268ac34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:22.652486 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd0f48-787b-4685-baf0-5750a268ac34 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:22.652812 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd0f48-787b-4685-baf0-5750a268ac34 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:22.653089 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd0f48-787b-4685-baf0-5750a268ac34 admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:22.653777 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd0f48-787b-4685-baf0-5750a268ac34 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:22.654082 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd0f48-787b-4685-baf0-5750a268ac34 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:22.655676 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd0f48-787b-4685-baf0-5750a268ac34 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:22.660649 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 373/745] 10.222.0.64 () {56 vars in 1145 bytes} [Thu Dec 16 14:25:22 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:22.667246 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79628371-d978-46fd-ad43-301167d5977b admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:22.676849 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79628371-d978-46fd-ad43-301167d5977b admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:22.681703 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f155a7e-908f-4016-8834-d3e7c7109231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:22.682308 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f155a7e-908f-4016-8834-d3e7c7109231 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:22.682599 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f155a7e-908f-4016-8834-d3e7c7109231 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:22.682913 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f155a7e-908f-4016-8834-d3e7c7109231 admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:22.683602 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f155a7e-908f-4016-8834-d3e7c7109231 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:22.683904 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f155a7e-908f-4016-8834-d3e7c7109231 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:22.685546 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f155a7e-908f-4016-8834-d3e7c7109231 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:22.691229 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 373/746] 10.222.0.64 () {56 vars in 1145 bytes} [Thu Dec 16 14:25:22 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:22.697916 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd0f48-787b-4685-baf0-5750a268ac34 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:22.708568 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd0f48-787b-4685-baf0-5750a268ac34 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:22.713040 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1a18a-d3ce-4921-ae6a-4acaa925961c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:22.713645 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1a18a-d3ce-4921-ae6a-4acaa925961c admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:22.713946 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1a18a-d3ce-4921-ae6a-4acaa925961c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:22.714212 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1a18a-d3ce-4921-ae6a-4acaa925961c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:22.714924 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1a18a-d3ce-4921-ae6a-4acaa925961c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:22.716548 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1a18a-d3ce-4921-ae6a-4acaa925961c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:22.736193 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 374/747] 10.222.0.64 () {60 vars in 1165 bytes} [Thu Dec 16 14:25:22 2021] POST /identity/v3/endpoints => generated 346 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:25:24.866986 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559b554-787c-4f76-81d1-433a94c6beb7 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:24.867525 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559b554-787c-4f76-81d1-433a94c6beb7 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:24.867616 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559b554-787c-4f76-81d1-433a94c6beb7 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:24.869239 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 374/748] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:25:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:24.874899 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c8052-d7e9-486c-82a3-9e9b5d1bc78a None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:24.875359 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c8052-d7e9-486c-82a3-9e9b5d1bc78a None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:24.875501 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c8052-d7e9-486c-82a3-9e9b5d1bc78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:24.897752 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-961c8052-d7e9-486c-82a3-9e9b5d1bc78a None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:24.898890 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-961c8052-d7e9-486c-82a3-9e9b5d1bc78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:24.916378 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 375/749] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:24 2021] POST /identity/v3/auth/tokens => generated 2151 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:25:24.938096 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559b554-787c-4f76-81d1-433a94c6beb7 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:24.950217 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559b554-787c-4f76-81d1-433a94c6beb7 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:24.955963 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dac8a-bb12-40c1-aea7-91180900fe26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:24.956686 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dac8a-bb12-40c1-aea7-91180900fe26 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:24.957016 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dac8a-bb12-40c1-aea7-91180900fe26 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:24.957301 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dac8a-bb12-40c1-aea7-91180900fe26 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:24.957929 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9dac8a-bb12-40c1-aea7-91180900fe26 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:24.959997 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9dac8a-bb12-40c1-aea7-91180900fe26 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:24.970876 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-ba9dac8a-bb12-40c1-aea7-91180900fe26 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Dec 16 14:25:24.971971 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 375/750] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:25:24 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:24.978793 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c8052-d7e9-486c-82a3-9e9b5d1bc78a None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:24.987529 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c8052-d7e9-486c-82a3-9e9b5d1bc78a None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:24.991743 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f7d52-13ae-416b-a65e-717a631feef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:24.992339 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f7d52-13ae-416b-a65e-717a631feef0 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:24.992633 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f7d52-13ae-416b-a65e-717a631feef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:24.992959 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f7d52-13ae-416b-a65e-717a631feef0 admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:24.993636 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f7d52-13ae-416b-a65e-717a631feef0 admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:24.993940 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f7d52-13ae-416b-a65e-717a631feef0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:24.995530 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f7d52-13ae-416b-a65e-717a631feef0 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:25.002032 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 376/751] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:25:24 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:25.007726 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dac8a-bb12-40c1-aea7-91180900fe26 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:25.018364 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dac8a-bb12-40c1-aea7-91180900fe26 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:25.023245 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5d1e6-54ea-42b2-8beb-c4feaa2c0fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:25.023825 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5d1e6-54ea-42b2-8beb-c4feaa2c0fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:25.024113 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5d1e6-54ea-42b2-8beb-c4feaa2c0fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:25.024391 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5d1e6-54ea-42b2-8beb-c4feaa2c0fb1 admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:25.025102 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5d1e6-54ea-42b2-8beb-c4feaa2c0fb1 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:25.025397 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5d1e6-54ea-42b2-8beb-c4feaa2c0fb1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:25.026960 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5d1e6-54ea-42b2-8beb-c4feaa2c0fb1 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:25.031544 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 376/752] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:25:25 2021] GET /identity/v3/services?type=volumev2 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:27.094369 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116eb8c2-97f2-4ddf-915f-49e0b3bd295a None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:27.094871 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116eb8c2-97f2-4ddf-915f-49e0b3bd295a None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:27.094982 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116eb8c2-97f2-4ddf-915f-49e0b3bd295a None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:27.096622 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 377/753] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:25:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:27.102464 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12a92c-649a-4931-b07e-a25f1e631c2c None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:27.102873 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12a92c-649a-4931-b07e-a25f1e631c2c None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:27.103031 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12a92c-649a-4931-b07e-a25f1e631c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:27.124297 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-ea12a92c-649a-4931-b07e-a25f1e631c2c None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:27.125386 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-ea12a92c-649a-4931-b07e-a25f1e631c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:27.132187 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 377/754] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:27 2021] POST /identity/v3/auth/tokens => generated 2151 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:27.154455 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116eb8c2-97f2-4ddf-915f-49e0b3bd295a None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:27.166726 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116eb8c2-97f2-4ddf-915f-49e0b3bd295a None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:27.170687 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5fb79-86cf-49cb-9cb8-88d7143ca417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:27.171262 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5fb79-86cf-49cb-9cb8-88d7143ca417 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:27.171548 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5fb79-86cf-49cb-9cb8-88d7143ca417 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:27.171824 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5fb79-86cf-49cb-9cb8-88d7143ca417 admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:27.172489 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5fb79-86cf-49cb-9cb8-88d7143ca417 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:27.174094 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5fb79-86cf-49cb-9cb8-88d7143ca417 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:27.186366 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 378/755] 10.222.0.64 () {60 vars in 1162 bytes} [Thu Dec 16 14:25:27 2021] POST /identity/v3/services => generated 251 bytes in 32 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:25:29.247242 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79706dc3-e28e-4afb-9037-25aea5c2a150 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:29.247808 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79706dc3-e28e-4afb-9037-25aea5c2a150 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:29.247808 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79706dc3-e28e-4afb-9037-25aea5c2a150 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:29.249597 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 378/756] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:25:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:29.255109 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba788c-d680-4ce1-b613-b8ab43c9738a None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:29.256147 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba788c-d680-4ce1-b613-b8ab43c9738a None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:29.256252 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba788c-d680-4ce1-b613-b8ab43c9738a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:29.280099 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-8eba788c-d680-4ce1-b613-b8ab43c9738a None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:29.281321 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-8eba788c-d680-4ce1-b613-b8ab43c9738a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:29.299427 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 379/757] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:29 2021] POST /identity/v3/auth/tokens => generated 2252 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:29.323611 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79706dc3-e28e-4afb-9037-25aea5c2a150 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:29.335666 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79706dc3-e28e-4afb-9037-25aea5c2a150 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:29.339876 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7f751-e3d8-4937-aa8d-aa1803e079ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:29.340610 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7f751-e3d8-4937-aa8d-aa1803e079ca admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:29.340941 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7f751-e3d8-4937-aa8d-aa1803e079ca admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:29.341223 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7f751-e3d8-4937-aa8d-aa1803e079ca admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:29.341864 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7f751-e3d8-4937-aa8d-aa1803e079ca admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:29.343478 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7f751-e3d8-4937-aa8d-aa1803e079ca admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:29.354539 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-54f7f751-e3d8-4937-aa8d-aa1803e079ca admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Dec 16 14:25:29.355726 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 379/758] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:25:29 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:29.362063 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba788c-d680-4ce1-b613-b8ab43c9738a None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:29.371533 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba788c-d680-4ce1-b613-b8ab43c9738a None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:29.375773 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5baf96-c81b-46f3-a7eb-8403f520e78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:29.376377 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5baf96-c81b-46f3-a7eb-8403f520e78f admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:29.376665 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5baf96-c81b-46f3-a7eb-8403f520e78f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:29.376975 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5baf96-c81b-46f3-a7eb-8403f520e78f admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:29.377662 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5baf96-c81b-46f3-a7eb-8403f520e78f admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:29.377962 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5baf96-c81b-46f3-a7eb-8403f520e78f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:29.379578 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5baf96-c81b-46f3-a7eb-8403f520e78f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:29.385527 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 380/759] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:25:29 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:29.391474 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7f751-e3d8-4937-aa8d-aa1803e079ca admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:29.401177 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7f751-e3d8-4937-aa8d-aa1803e079ca admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:29.405409 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb4aba-a6ec-4eb3-9962-6ff73c8915cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:29.405990 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb4aba-a6ec-4eb3-9962-6ff73c8915cd admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:29.406279 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb4aba-a6ec-4eb3-9962-6ff73c8915cd admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:29.406561 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb4aba-a6ec-4eb3-9962-6ff73c8915cd admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:29.407227 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb4aba-a6ec-4eb3-9962-6ff73c8915cd admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:29.407526 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb4aba-a6ec-4eb3-9962-6ff73c8915cd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:29.409120 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb4aba-a6ec-4eb3-9962-6ff73c8915cd admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:29.413786 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 380/760] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:25:29 2021] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:29.419600 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5baf96-c81b-46f3-a7eb-8403f520e78f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:29.429999 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5baf96-c81b-46f3-a7eb-8403f520e78f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:29.434368 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1b7aa-969c-4656-aa02-464634282ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:29.434960 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1b7aa-969c-4656-aa02-464634282ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:29.435244 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1b7aa-969c-4656-aa02-464634282ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:29.435522 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1b7aa-969c-4656-aa02-464634282ab6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:29.436283 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1b7aa-969c-4656-aa02-464634282ab6 admin admin] RBAC: Adding query filter params (interface=public, service_id=94f129684c854418baa15b5e21467474, region_id=RegionOne) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:29.436584 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1b7aa-969c-4656-aa02-464634282ab6 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:29.438218 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1b7aa-969c-4656-aa02-464634282ab6 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:29.444683 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 381/761] 10.222.0.64 () {56 vars in 1272 bytes} [Thu Dec 16 14:25:29 2021] GET /identity/v3/endpoints?service_id=94f129684c854418baa15b5e21467474&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:29.450274 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb4aba-a6ec-4eb3-9962-6ff73c8915cd admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:29.459506 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb4aba-a6ec-4eb3-9962-6ff73c8915cd admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:29.463796 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079a46d-1b54-4baa-8e8e-702c9fa76558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:29.464373 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079a46d-1b54-4baa-8e8e-702c9fa76558 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:29.464664 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079a46d-1b54-4baa-8e8e-702c9fa76558 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:29.464987 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079a46d-1b54-4baa-8e8e-702c9fa76558 admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:29.465640 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079a46d-1b54-4baa-8e8e-702c9fa76558 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:29.467212 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079a46d-1b54-4baa-8e8e-702c9fa76558 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:29.473014 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 381/762] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Dec 16 14:25:29 2021] GET /identity/v3/services => generated 1500 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:25:31.515611 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6d92a-f0e2-4b02-a064-981f5ab89eda None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:31.516134 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6d92a-f0e2-4b02-a064-981f5ab89eda None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:31.516647 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6d92a-f0e2-4b02-a064-981f5ab89eda None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:31.519904 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 382/763] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:25:31 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:31.525656 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161c2b3-25a4-48ae-94e5-b848b39ef98f None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:31.526117 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161c2b3-25a4-48ae-94e5-b848b39ef98f None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:31.526207 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161c2b3-25a4-48ae-94e5-b848b39ef98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:31.548013 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-5161c2b3-25a4-48ae-94e5-b848b39ef98f None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:31.549194 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-5161c2b3-25a4-48ae-94e5-b848b39ef98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:31.556693 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 382/764] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:31 2021] POST /identity/v3/auth/tokens => generated 2252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:31.579417 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6d92a-f0e2-4b02-a064-981f5ab89eda None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:31.591260 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6d92a-f0e2-4b02-a064-981f5ab89eda None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:31.595291 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533e9f2-2719-4305-a04e-c9869a06a304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:31.596004 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533e9f2-2719-4305-a04e-c9869a06a304 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:31.596293 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533e9f2-2719-4305-a04e-c9869a06a304 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:31.596577 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533e9f2-2719-4305-a04e-c9869a06a304 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:31.597247 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533e9f2-2719-4305-a04e-c9869a06a304 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:31.598826 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533e9f2-2719-4305-a04e-c9869a06a304 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:31.609132 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-6533e9f2-2719-4305-a04e-c9869a06a304 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Dec 16 14:25:31.610167 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 383/765] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:25:31 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:31.616511 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161c2b3-25a4-48ae-94e5-b848b39ef98f None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:31.625025 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161c2b3-25a4-48ae-94e5-b848b39ef98f None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:31.629211 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b5fe2-993e-48f9-9b7a-932707c03665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:31.629791 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b5fe2-993e-48f9-9b7a-932707c03665 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:31.630107 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b5fe2-993e-48f9-9b7a-932707c03665 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:31.631034 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b5fe2-993e-48f9-9b7a-932707c03665 admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:31.631702 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b5fe2-993e-48f9-9b7a-932707c03665 admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:31.632002 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b5fe2-993e-48f9-9b7a-932707c03665 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:31.633596 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b5fe2-993e-48f9-9b7a-932707c03665 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:31.638081 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 383/766] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:25:31 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:31.643587 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533e9f2-2719-4305-a04e-c9869a06a304 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:31.652667 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533e9f2-2719-4305-a04e-c9869a06a304 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:31.656881 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b016a5-8674-41af-a126-31bcd7db06c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:31.657454 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b016a5-8674-41af-a126-31bcd7db06c4 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:31.657743 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b016a5-8674-41af-a126-31bcd7db06c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:31.658026 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b016a5-8674-41af-a126-31bcd7db06c4 admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:31.658694 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b016a5-8674-41af-a126-31bcd7db06c4 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:31.658991 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b016a5-8674-41af-a126-31bcd7db06c4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:31.660553 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b016a5-8674-41af-a126-31bcd7db06c4 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:31.665080 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 384/767] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:25:31 2021] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:31.670200 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b5fe2-993e-48f9-9b7a-932707c03665 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:31.679702 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b5fe2-993e-48f9-9b7a-932707c03665 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:31.683828 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0531ca8-2919-48fd-a523-0fbc0c0ef08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:31.684390 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0531ca8-2919-48fd-a523-0fbc0c0ef08a admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:31.684671 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0531ca8-2919-48fd-a523-0fbc0c0ef08a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:31.684991 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0531ca8-2919-48fd-a523-0fbc0c0ef08a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:31.685664 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0531ca8-2919-48fd-a523-0fbc0c0ef08a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:31.687188 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0531ca8-2919-48fd-a523-0fbc0c0ef08a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:31.704766 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 384/768] 10.222.0.64 () {60 vars in 1165 bytes} [Thu Dec 16 14:25:31 2021] POST /identity/v3/endpoints => generated 346 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:25:33.753928 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd4135-58d9-42dc-a12e-59418b539155 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:33.754505 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd4135-58d9-42dc-a12e-59418b539155 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:33.754505 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd4135-58d9-42dc-a12e-59418b539155 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:33.756660 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 385/769] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:25:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:33.761997 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81025009-84da-4fbf-ac04-47797ed3ed21 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:33.762437 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81025009-84da-4fbf-ac04-47797ed3ed21 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:33.762638 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81025009-84da-4fbf-ac04-47797ed3ed21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:33.785178 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-81025009-84da-4fbf-ac04-47797ed3ed21 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:33.786332 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-81025009-84da-4fbf-ac04-47797ed3ed21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:33.806059 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 385/770] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:33 2021] POST /identity/v3/auth/tokens => generated 2438 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:33.828980 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd4135-58d9-42dc-a12e-59418b539155 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:33.841970 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd4135-58d9-42dc-a12e-59418b539155 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:33.846140 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f554990-2185-4019-9c1f-45c1b6f45069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:33.846874 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f554990-2185-4019-9c1f-45c1b6f45069 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:33.847161 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f554990-2185-4019-9c1f-45c1b6f45069 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:33.847447 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f554990-2185-4019-9c1f-45c1b6f45069 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:33.848078 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f554990-2185-4019-9c1f-45c1b6f45069 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:33.849714 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f554990-2185-4019-9c1f-45c1b6f45069 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:33.860495 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-5f554990-2185-4019-9c1f-45c1b6f45069 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 16 14:25:33.861668 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 386/771] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:25:33 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:33.868170 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81025009-84da-4fbf-ac04-47797ed3ed21 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:33.876976 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81025009-84da-4fbf-ac04-47797ed3ed21 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:33.881819 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0600ff-665c-447e-afdb-b833fb034435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:33.882411 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0600ff-665c-447e-afdb-b833fb034435 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:33.882702 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0600ff-665c-447e-afdb-b833fb034435 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:33.882991 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0600ff-665c-447e-afdb-b833fb034435 admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:33.883672 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0600ff-665c-447e-afdb-b833fb034435 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:33.883969 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0600ff-665c-447e-afdb-b833fb034435 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:33.885596 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0600ff-665c-447e-afdb-b833fb034435 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:33.890584 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 386/772] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:25:33 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:33.897674 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f554990-2185-4019-9c1f-45c1b6f45069 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:33.907591 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f554990-2185-4019-9c1f-45c1b6f45069 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:33.911864 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c3ff7-a4ae-439c-a497-df91c691e0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:33.912456 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c3ff7-a4ae-439c-a497-df91c691e0eb admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:33.912745 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c3ff7-a4ae-439c-a497-df91c691e0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:33.913058 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c3ff7-a4ae-439c-a497-df91c691e0eb admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:33.913734 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c3ff7-a4ae-439c-a497-df91c691e0eb admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:33.914035 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c3ff7-a4ae-439c-a497-df91c691e0eb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:33.915617 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c3ff7-a4ae-439c-a497-df91c691e0eb admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:33.920232 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 387/773] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:25:33 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:36.022443 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641de836-1841-45f7-b639-c38b2a2fb0c8 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:36.023036 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641de836-1841-45f7-b639-c38b2a2fb0c8 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:36.023036 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641de836-1841-45f7-b639-c38b2a2fb0c8 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:36.024663 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 387/774] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:25:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:36.029969 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ace161-f8ec-4f0d-be0a-126d6157b9a1 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:36.030402 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ace161-f8ec-4f0d-be0a-126d6157b9a1 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:36.030542 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ace161-f8ec-4f0d-be0a-126d6157b9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:36.052953 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-13ace161-f8ec-4f0d-be0a-126d6157b9a1 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:36.054104 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-13ace161-f8ec-4f0d-be0a-126d6157b9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:36.061145 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 388/775] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:36 2021] POST /identity/v3/auth/tokens => generated 2438 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:36.085076 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641de836-1841-45f7-b639-c38b2a2fb0c8 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:36.097120 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641de836-1841-45f7-b639-c38b2a2fb0c8 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:36.101444 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f916b-19fb-41b1-903d-dd0d8584954b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:36.102027 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f916b-19fb-41b1-903d-dd0d8584954b admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:36.102313 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f916b-19fb-41b1-903d-dd0d8584954b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:36.102590 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f916b-19fb-41b1-903d-dd0d8584954b admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:36.103272 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f916b-19fb-41b1-903d-dd0d8584954b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:36.104858 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f916b-19fb-41b1-903d-dd0d8584954b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:36.118546 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 388/776] 10.222.0.64 () {60 vars in 1162 bytes} [Thu Dec 16 14:25:36 2021] POST /identity/v3/services => generated 251 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:25:38.205660 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdff2f7-e763-4f58-a9e2-c60804a96322 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:38.206210 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdff2f7-e763-4f58-a9e2-c60804a96322 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:38.206210 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdff2f7-e763-4f58-a9e2-c60804a96322 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:38.207933 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 389/777] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:25:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:38.213047 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c2054-4c25-4e90-bf84-1636cecab91b None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:38.213454 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c2054-4c25-4e90-bf84-1636cecab91b None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:38.213643 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c2054-4c25-4e90-bf84-1636cecab91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:38.235613 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-f13c2054-4c25-4e90-bf84-1636cecab91b None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:38.236743 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-f13c2054-4c25-4e90-bf84-1636cecab91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:38.254269 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 389/778] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:38 2021] POST /identity/v3/auth/tokens => generated 2539 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:38.276596 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdff2f7-e763-4f58-a9e2-c60804a96322 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:38.288973 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdff2f7-e763-4f58-a9e2-c60804a96322 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:38.292937 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509fcca-2399-4e57-b5ab-5b877b31190e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:38.293645 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509fcca-2399-4e57-b5ab-5b877b31190e admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:38.293930 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509fcca-2399-4e57-b5ab-5b877b31190e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:38.294207 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509fcca-2399-4e57-b5ab-5b877b31190e admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:38.294826 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509fcca-2399-4e57-b5ab-5b877b31190e admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:38.296388 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509fcca-2399-4e57-b5ab-5b877b31190e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:38.306427 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-9509fcca-2399-4e57-b5ab-5b877b31190e admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 16 14:25:38.307457 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 390/779] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:25:38 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:38.313298 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c2054-4c25-4e90-bf84-1636cecab91b None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:38.322046 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c2054-4c25-4e90-bf84-1636cecab91b None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:38.326249 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ab447-b7a6-4f2f-9fdc-c89bba1d6ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:38.326836 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ab447-b7a6-4f2f-9fdc-c89bba1d6ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:38.327127 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ab447-b7a6-4f2f-9fdc-c89bba1d6ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:38.327409 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ab447-b7a6-4f2f-9fdc-c89bba1d6ff7 admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:38.328081 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ab447-b7a6-4f2f-9fdc-c89bba1d6ff7 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:38.328381 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ab447-b7a6-4f2f-9fdc-c89bba1d6ff7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:38.329978 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ab447-b7a6-4f2f-9fdc-c89bba1d6ff7 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:38.335052 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 390/780] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:25:38 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:38.340452 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509fcca-2399-4e57-b5ab-5b877b31190e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:38.350153 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509fcca-2399-4e57-b5ab-5b877b31190e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:38.354270 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636dc904-f6e1-4c4e-981c-234174af082a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:38.354838 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dc904-f6e1-4c4e-981c-234174af082a admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:38.355125 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dc904-f6e1-4c4e-981c-234174af082a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:38.355404 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dc904-f6e1-4c4e-981c-234174af082a admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:38.356065 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636dc904-f6e1-4c4e-981c-234174af082a admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:38.356363 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636dc904-f6e1-4c4e-981c-234174af082a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:38.357934 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636dc904-f6e1-4c4e-981c-234174af082a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:38.362431 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 391/781] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:25:38 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:38.367920 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ab447-b7a6-4f2f-9fdc-c89bba1d6ff7 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:38.377292 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ab447-b7a6-4f2f-9fdc-c89bba1d6ff7 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:38.382426 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273f8ba-fb57-464b-b00d-765e16e4f3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:38.382995 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273f8ba-fb57-464b-b00d-765e16e4f3ca admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:38.383279 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273f8ba-fb57-464b-b00d-765e16e4f3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:38.383558 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273f8ba-fb57-464b-b00d-765e16e4f3ca admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:38.384296 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273f8ba-fb57-464b-b00d-765e16e4f3ca admin admin] RBAC: Adding query filter params (interface=public, service_id=a57df65f23274889badb15c9895ee68d, region_id=RegionOne) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:38.384597 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273f8ba-fb57-464b-b00d-765e16e4f3ca admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:38.386181 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273f8ba-fb57-464b-b00d-765e16e4f3ca admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:38.391342 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 391/782] 10.222.0.64 () {56 vars in 1272 bytes} [Thu Dec 16 14:25:38 2021] GET /identity/v3/endpoints?service_id=a57df65f23274889badb15c9895ee68d&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:38.397091 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636dc904-f6e1-4c4e-981c-234174af082a admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:38.406089 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636dc904-f6e1-4c4e-981c-234174af082a admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:38.410734 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f74f8a-f5f6-4b94-9149-361c3d0c4240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:38.411923 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f74f8a-f5f6-4b94-9149-361c3d0c4240 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:38.412212 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f74f8a-f5f6-4b94-9149-361c3d0c4240 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:38.412491 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f74f8a-f5f6-4b94-9149-361c3d0c4240 admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:38.413166 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f74f8a-f5f6-4b94-9149-361c3d0c4240 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:38.414704 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f74f8a-f5f6-4b94-9149-361c3d0c4240 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:38.420680 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 392/783] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Dec 16 14:25:38 2021] GET /identity/v3/services => generated 1739 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:25:40.443125 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d68c74-dffd-4f39-92ab-665168ad3edc None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:40.443674 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d68c74-dffd-4f39-92ab-665168ad3edc None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:40.443674 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d68c74-dffd-4f39-92ab-665168ad3edc None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:40.445378 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 392/784] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:25:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:40.450590 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e85047-4422-4c74-b743-ce2ae12d8080 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:40.451000 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e85047-4422-4c74-b743-ce2ae12d8080 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:40.451149 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e85047-4422-4c74-b743-ce2ae12d8080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:40.472520 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-61e85047-4422-4c74-b743-ce2ae12d8080 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:40.473669 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-61e85047-4422-4c74-b743-ce2ae12d8080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:40.481034 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 393/785] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:40 2021] POST /identity/v3/auth/tokens => generated 2539 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:40.504358 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d68c74-dffd-4f39-92ab-665168ad3edc None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:40.516118 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d68c74-dffd-4f39-92ab-665168ad3edc None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:40.520183 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479daa39-d22e-4dc3-b466-2b30d73341a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:40.520952 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479daa39-d22e-4dc3-b466-2b30d73341a7 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:40.521744 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479daa39-d22e-4dc3-b466-2b30d73341a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:40.522037 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479daa39-d22e-4dc3-b466-2b30d73341a7 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:40.522654 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479daa39-d22e-4dc3-b466-2b30d73341a7 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:40.524226 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479daa39-d22e-4dc3-b466-2b30d73341a7 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:40.534397 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-479daa39-d22e-4dc3-b466-2b30d73341a7 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 16 14:25:40.535429 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 393/786] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:25:40 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:40.541703 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e85047-4422-4c74-b743-ce2ae12d8080 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:40.550254 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e85047-4422-4c74-b743-ce2ae12d8080 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:40.554435 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a79e30-9cf3-48e9-ad1d-b5d0b4dd3acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:40.555018 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a79e30-9cf3-48e9-ad1d-b5d0b4dd3acc admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:40.555309 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a79e30-9cf3-48e9-ad1d-b5d0b4dd3acc admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:40.555592 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a79e30-9cf3-48e9-ad1d-b5d0b4dd3acc admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:40.556268 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a79e30-9cf3-48e9-ad1d-b5d0b4dd3acc admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:40.556570 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a79e30-9cf3-48e9-ad1d-b5d0b4dd3acc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:40.558196 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a79e30-9cf3-48e9-ad1d-b5d0b4dd3acc admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:40.562746 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 394/787] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:25:40 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:40.568221 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479daa39-d22e-4dc3-b466-2b30d73341a7 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:40.577300 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479daa39-d22e-4dc3-b466-2b30d73341a7 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:40.581588 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0fa4c-8f72-4c34-ba58-c043708db50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:40.582155 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0fa4c-8f72-4c34-ba58-c043708db50a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:40.582447 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0fa4c-8f72-4c34-ba58-c043708db50a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:40.582730 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0fa4c-8f72-4c34-ba58-c043708db50a admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:40.583396 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0fa4c-8f72-4c34-ba58-c043708db50a admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:40.583692 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0fa4c-8f72-4c34-ba58-c043708db50a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:40.585763 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0fa4c-8f72-4c34-ba58-c043708db50a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:40.590276 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 394/788] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:25:40 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:40.595372 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a79e30-9cf3-48e9-ad1d-b5d0b4dd3acc admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:40.605008 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a79e30-9cf3-48e9-ad1d-b5d0b4dd3acc admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:40.609359 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fbead-3754-486a-b1b4-3719da7b55bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:40.609935 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fbead-3754-486a-b1b4-3719da7b55bf admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:40.610229 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fbead-3754-486a-b1b4-3719da7b55bf admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:40.610512 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fbead-3754-486a-b1b4-3719da7b55bf admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:40.611197 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fbead-3754-486a-b1b4-3719da7b55bf admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:40.612764 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fbead-3754-486a-b1b4-3719da7b55bf admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:40.630567 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 395/789] 10.222.0.64 () {60 vars in 1165 bytes} [Thu Dec 16 14:25:40 2021] POST /identity/v3/endpoints => generated 346 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:25:42.721486 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00547982-6260-4e08-b879-003dcaf25fd5 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:42.722004 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00547982-6260-4e08-b879-003dcaf25fd5 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:42.722114 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00547982-6260-4e08-b879-003dcaf25fd5 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:42.723826 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 395/790] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:25:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:42.729652 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f00da-adc6-4d23-be70-4df90d3f59f6 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:42.730100 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f00da-adc6-4d23-be70-4df90d3f59f6 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:42.730197 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f00da-adc6-4d23-be70-4df90d3f59f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:42.752223 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-5d7f00da-adc6-4d23-be70-4df90d3f59f6 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:42.753374 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-5d7f00da-adc6-4d23-be70-4df90d3f59f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:42.770571 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 396/791] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:42 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:42.795084 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00547982-6260-4e08-b879-003dcaf25fd5 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:42.806903 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00547982-6260-4e08-b879-003dcaf25fd5 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:42.810924 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d2d5b-a771-466b-a57a-2e71d4ea89c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:42.811508 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d2d5b-a771-466b-a57a-2e71d4ea89c4 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:42.811799 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d2d5b-a771-466b-a57a-2e71d4ea89c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:42.812084 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d2d5b-a771-466b-a57a-2e71d4ea89c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:42.812747 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d2d5b-a771-466b-a57a-2e71d4ea89c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:42.814866 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d2d5b-a771-466b-a57a-2e71d4ea89c4 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:42.816216 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.common [None req-046d2d5b-a771-466b-a57a-2e71d4ea89c4 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Dec 16 14:25:42.835206 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.sql.core [None req-046d2d5b-a771-466b-a57a-2e71d4ea89c4 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Dec 16 14:25:42.835206 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Dec 16 14:25:42.835206 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [parameters: {'id': '75a48da1db3f4e049bcb269bdf0dc44d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Dec 16 14:25:42.835206 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=67595) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Dec 16 14:25:42.848933 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-046d2d5b-a771-466b-a57a-2e71d4ea89c4 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 75a48da1db3f4e049bcb269bdf0dc44d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 75a48da1db3f4e049bcb269bdf0dc44d. Dec 16 14:25:42.850657 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 396/792] 10.222.0.64 () {60 vars in 1161 bytes} [Thu Dec 16 14:25:42 2021] POST /identity/v3/projects => generated 262 bytes in 56 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:42.856585 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f00da-adc6-4d23-be70-4df90d3f59f6 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:42.865710 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f00da-adc6-4d23-be70-4df90d3f59f6 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:42.870048 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367020a-80c9-4c5f-a5b2-595d8424f82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:42.870764 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367020a-80c9-4c5f-a5b2-595d8424f82d admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:42.871057 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367020a-80c9-4c5f-a5b2-595d8424f82d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:42.871344 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367020a-80c9-4c5f-a5b2-595d8424f82d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:42.879315 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367020a-80c9-4c5f-a5b2-595d8424f82d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:42.881317 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367020a-80c9-4c5f-a5b2-595d8424f82d admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:42.896791 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-0367020a-80c9-4c5f-a5b2-595d8424f82d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:25:42.897855 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 397/793] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:25:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:42.903754 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d2d5b-a771-466b-a57a-2e71d4ea89c4 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:42.914214 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d2d5b-a771-466b-a57a-2e71d4ea89c4 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:42.918499 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d7b4b-5da8-45de-a352-996990b64a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:42.919073 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d7b4b-5da8-45de-a352-996990b64a3e admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:42.919365 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d7b4b-5da8-45de-a352-996990b64a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:42.919654 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d7b4b-5da8-45de-a352-996990b64a3e admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:42.920362 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d7b4b-5da8-45de-a352-996990b64a3e admin admin] RBAC: Adding query filter params (name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:42.920666 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d7b4b-5da8-45de-a352-996990b64a3e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:42.922775 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d7b4b-5da8-45de-a352-996990b64a3e admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:42.938980 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 397/794] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Dec 16 14:25:42 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:45.054862 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5550a-0e5c-4569-89b1-d0967c41edbb None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:45.055420 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5550a-0e5c-4569-89b1-d0967c41edbb None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:45.055420 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5550a-0e5c-4569-89b1-d0967c41edbb None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:45.057118 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 398/795] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:25:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:45.062463 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa34c4-2732-4de3-967f-e15c4e595b75 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:45.062898 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa34c4-2732-4de3-967f-e15c4e595b75 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:45.063050 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa34c4-2732-4de3-967f-e15c4e595b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:45.087723 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-fdfa34c4-2732-4de3-967f-e15c4e595b75 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:45.089220 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-fdfa34c4-2732-4de3-967f-e15c4e595b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:45.096308 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 398/796] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:45 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:45.121328 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5550a-0e5c-4569-89b1-d0967c41edbb None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:45.133700 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5550a-0e5c-4569-89b1-d0967c41edbb None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:45.138007 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433852c3-5fe6-4357-9bc0-22dc53da4f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:45.138622 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433852c3-5fe6-4357-9bc0-22dc53da4f78 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:45.138932 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433852c3-5fe6-4357-9bc0-22dc53da4f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:45.139214 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433852c3-5fe6-4357-9bc0-22dc53da4f78 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:45.139862 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433852c3-5fe6-4357-9bc0-22dc53da4f78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:45.141725 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433852c3-5fe6-4357-9bc0-22dc53da4f78 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:45.143102 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.common [None req-433852c3-5fe6-4357-9bc0-22dc53da4f78 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Dec 16 14:25:45.156925 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.sql.core [None req-433852c3-5fe6-4357-9bc0-22dc53da4f78 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Dec 16 14:25:45.156925 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Dec 16 14:25:45.156925 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [parameters: {'user_id': '69dac61ff468461087fdc964914b3233', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Dec 16 14:25:45.156925 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=67594) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Dec 16 14:25:45.170031 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-433852c3-5fe6-4357-9bc0-22dc53da4f78 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Dec 16 14:25:45.171249 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 399/797] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:25:45 2021] POST /identity/v3/users => generated 160 bytes in 50 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:45.177968 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa34c4-2732-4de3-967f-e15c4e595b75 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:45.187153 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa34c4-2732-4de3-967f-e15c4e595b75 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:45.191623 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8bdce-f088-40ae-843d-d799af71e8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:45.192340 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8bdce-f088-40ae-843d-d799af71e8bf admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:45.192625 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8bdce-f088-40ae-843d-d799af71e8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:45.193609 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8bdce-f088-40ae-843d-d799af71e8bf admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:45.209762 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8bdce-f088-40ae-843d-d799af71e8bf admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:45.211890 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8bdce-f088-40ae-843d-d799af71e8bf admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:45.230740 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-3fa8bdce-f088-40ae-843d-d799af71e8bf admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 16 14:25:45.231876 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 399/798] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:25:45 2021] GET /identity/v3/users/cinder => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:45.237941 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433852c3-5fe6-4357-9bc0-22dc53da4f78 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:45.249164 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433852c3-5fe6-4357-9bc0-22dc53da4f78 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:45.253490 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2ca92-50a7-4c0f-b154-41bbbd693a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:45.254078 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2ca92-50a7-4c0f-b154-41bbbd693a3d admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:45.254371 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2ca92-50a7-4c0f-b154-41bbbd693a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:45.254654 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2ca92-50a7-4c0f-b154-41bbbd693a3d admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:45.255410 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2ca92-50a7-4c0f-b154-41bbbd693a3d admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:45.255741 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2ca92-50a7-4c0f-b154-41bbbd693a3d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:45.257872 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2ca92-50a7-4c0f-b154-41bbbd693a3d admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:45.289499 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 400/799] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Dec 16 14:25:45 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:47.532121 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33160cc-2cf0-40ae-902c-486e9d5471c1 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:47.532644 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33160cc-2cf0-40ae-902c-486e9d5471c1 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:47.532730 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33160cc-2cf0-40ae-902c-486e9d5471c1 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:47.534391 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 400/800] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:25:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:47.540080 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e53990-b27e-4522-87f8-f03cd6d51b35 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:47.540481 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e53990-b27e-4522-87f8-f03cd6d51b35 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:47.540636 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e53990-b27e-4522-87f8-f03cd6d51b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:47.562210 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-54e53990-b27e-4522-87f8-f03cd6d51b35 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:47.563918 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-54e53990-b27e-4522-87f8-f03cd6d51b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:47.570904 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 401/801] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:47 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:47.594631 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33160cc-2cf0-40ae-902c-486e9d5471c1 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:47.606814 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33160cc-2cf0-40ae-902c-486e9d5471c1 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:47.610873 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcced3-67ae-4288-9d8a-aad4f0a46f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:47.611574 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcced3-67ae-4288-9d8a-aad4f0a46f6a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:47.611864 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcced3-67ae-4288-9d8a-aad4f0a46f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:47.612148 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcced3-67ae-4288-9d8a-aad4f0a46f6a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:47.623678 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbcced3-67ae-4288-9d8a-aad4f0a46f6a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:47.625507 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbcced3-67ae-4288-9d8a-aad4f0a46f6a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:47.642308 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-bdbcced3-67ae-4288-9d8a-aad4f0a46f6a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:25:47.643379 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 401/802] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:25:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:47.649948 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e53990-b27e-4522-87f8-f03cd6d51b35 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:47.658516 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e53990-b27e-4522-87f8-f03cd6d51b35 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:47.662778 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc195ab-4f4e-45ba-ad29-525b19f4b18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:47.663364 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc195ab-4f4e-45ba-ad29-525b19f4b18f admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:47.663656 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc195ab-4f4e-45ba-ad29-525b19f4b18f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:47.663941 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc195ab-4f4e-45ba-ad29-525b19f4b18f admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:47.664829 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc195ab-4f4e-45ba-ad29-525b19f4b18f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:47.665143 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc195ab-4f4e-45ba-ad29-525b19f4b18f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:47.666723 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc195ab-4f4e-45ba-ad29-525b19f4b18f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:47.678901 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 402/803] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:25:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:47.684457 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcced3-67ae-4288-9d8a-aad4f0a46f6a admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:47.694559 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcced3-67ae-4288-9d8a-aad4f0a46f6a admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:47.698753 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b0ea3-1eb9-411e-a401-985f0e710373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:47.699334 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b0ea3-1eb9-411e-a401-985f0e710373 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:47.699624 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b0ea3-1eb9-411e-a401-985f0e710373 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:47.699909 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b0ea3-1eb9-411e-a401-985f0e710373 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:47.700555 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b0ea3-1eb9-411e-a401-985f0e710373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:47.702472 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b0ea3-1eb9-411e-a401-985f0e710373 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:47.722959 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 402/804] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Dec 16 14:25:47 2021] POST /identity/v3/users => generated 249 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:25:49.790680 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ee4bb-8268-436c-950c-2d74cb07db63 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:49.791201 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ee4bb-8268-436c-950c-2d74cb07db63 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:49.791288 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ee4bb-8268-436c-950c-2d74cb07db63 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:49.792953 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 403/805] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:25:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:49.798283 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceb5d6-88e6-41d7-a436-f97fab54df0b None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:49.798739 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceb5d6-88e6-41d7-a436-f97fab54df0b None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:49.798853 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceb5d6-88e6-41d7-a436-f97fab54df0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:49.822269 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-b9ceb5d6-88e6-41d7-a436-f97fab54df0b None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:49.823410 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-b9ceb5d6-88e6-41d7-a436-f97fab54df0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:49.830559 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 403/806] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:49 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:49.853989 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ee4bb-8268-436c-950c-2d74cb07db63 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:49.866393 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ee4bb-8268-436c-950c-2d74cb07db63 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:49.870464 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca478b86-fbb4-487c-861f-cdf68e16dc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:49.871171 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca478b86-fbb4-487c-861f-cdf68e16dc87 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:49.871459 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca478b86-fbb4-487c-861f-cdf68e16dc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:49.871738 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca478b86-fbb4-487c-861f-cdf68e16dc87 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:49.883201 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca478b86-fbb4-487c-861f-cdf68e16dc87 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:25:49.889465 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-ca478b86-fbb4-487c-861f-cdf68e16dc87 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:25:49.890542 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 404/807] 10.222.0.64 () {56 vars in 1123 bytes} [Thu Dec 16 14:25:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:49.897053 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ceb5d6-88e6-41d7-a436-f97fab54df0b None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:49.905626 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ceb5d6-88e6-41d7-a436-f97fab54df0b None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:49.909844 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a29da-997d-4768-94aa-56d9bb3cd069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:49.910433 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a29da-997d-4768-94aa-56d9bb3cd069 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:49.910726 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a29da-997d-4768-94aa-56d9bb3cd069 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:49.911011 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a29da-997d-4768-94aa-56d9bb3cd069 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:49.911728 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a29da-997d-4768-94aa-56d9bb3cd069 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:49.912025 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a29da-997d-4768-94aa-56d9bb3cd069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:49.913631 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a29da-997d-4768-94aa-56d9bb3cd069 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:49.921909 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 404/808] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Dec 16 14:25:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:49.927231 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca478b86-fbb4-487c-861f-cdf68e16dc87 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:49.937096 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca478b86-fbb4-487c-861f-cdf68e16dc87 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:49.941790 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d16cc-9df6-44e4-b3fa-0685d27f9430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:49.943077 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d16cc-9df6-44e4-b3fa-0685d27f9430 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:49.943368 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d16cc-9df6-44e4-b3fa-0685d27f9430 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:49.943654 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d16cc-9df6-44e4-b3fa-0685d27f9430 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:49.954753 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d16cc-9df6-44e4-b3fa-0685d27f9430 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:49.956568 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d16cc-9df6-44e4-b3fa-0685d27f9430 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:49.974037 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-d45d16cc-9df6-44e4-b3fa-0685d27f9430 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:25:49.975127 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 405/809] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:25:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:25:49.980905 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a29da-997d-4768-94aa-56d9bb3cd069 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:49.990201 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a29da-997d-4768-94aa-56d9bb3cd069 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:49.994570 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f82a0-8f36-47b4-8717-1a01e3292e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:49.995152 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f82a0-8f36-47b4-8717-1a01e3292e8d admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:49.995447 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f82a0-8f36-47b4-8717-1a01e3292e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:49.995735 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f82a0-8f36-47b4-8717-1a01e3292e8d admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:49.996419 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f82a0-8f36-47b4-8717-1a01e3292e8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:49.996724 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f82a0-8f36-47b4-8717-1a01e3292e8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:49.998328 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f82a0-8f36-47b4-8717-1a01e3292e8d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:50.011124 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 405/810] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:25:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:50.016555 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d16cc-9df6-44e4-b3fa-0685d27f9430 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:50.026376 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d16cc-9df6-44e4-b3fa-0685d27f9430 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:50.030562 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc21e09-8d21-4d13-9272-63f88811ef0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:50.031273 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc21e09-8d21-4d13-9272-63f88811ef0c admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:50.031567 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc21e09-8d21-4d13-9272-63f88811ef0c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:50.031846 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc21e09-8d21-4d13-9272-63f88811ef0c admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:50.044789 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc21e09-8d21-4d13-9272-63f88811ef0c admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:50.046741 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc21e09-8d21-4d13-9272-63f88811ef0c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:50.064579 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-dbc21e09-8d21-4d13-9272-63f88811ef0c admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 16 14:25:50.065656 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 406/811] 10.222.0.64 () {56 vars in 1123 bytes} [Thu Dec 16 14:25:50 2021] GET /identity/v3/users/neutron => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:50.071201 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f82a0-8f36-47b4-8717-1a01e3292e8d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:50.080418 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f82a0-8f36-47b4-8717-1a01e3292e8d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:50.084682 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79857bd1-cc3e-4e0a-8358-87fd476d5412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:50.085301 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79857bd1-cc3e-4e0a-8358-87fd476d5412 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:50.085668 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79857bd1-cc3e-4e0a-8358-87fd476d5412 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:50.085875 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79857bd1-cc3e-4e0a-8358-87fd476d5412 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:50.086646 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79857bd1-cc3e-4e0a-8358-87fd476d5412 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:50.086948 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79857bd1-cc3e-4e0a-8358-87fd476d5412 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:50.088744 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79857bd1-cc3e-4e0a-8358-87fd476d5412 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:50.117258 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 406/812] 10.222.0.64 () {56 vars in 1160 bytes} [Thu Dec 16 14:25:50 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:50.122722 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc21e09-8d21-4d13-9272-63f88811ef0c admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:50.131864 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc21e09-8d21-4d13-9272-63f88811ef0c admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:50.136056 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7569f-747a-42bc-8dbf-4352885373ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:50.136620 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7569f-747a-42bc-8dbf-4352885373ee admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:50.136945 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7569f-747a-42bc-8dbf-4352885373ee admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:50.137234 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7569f-747a-42bc-8dbf-4352885373ee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:50.144671 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7569f-747a-42bc-8dbf-4352885373ee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:50.146432 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7569f-747a-42bc-8dbf-4352885373ee admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:50.155144 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 407/813] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:25:50 2021] GET /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:25:50.160750 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79857bd1-cc3e-4e0a-8358-87fd476d5412 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:50.170554 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79857bd1-cc3e-4e0a-8358-87fd476d5412 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:50.174815 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d1817-0c3c-492f-a834-094cc888c610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:50.175520 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d1817-0c3c-492f-a834-094cc888c610 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:50.175812 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d1817-0c3c-492f-a834-094cc888c610 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:50.176410 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d1817-0c3c-492f-a834-094cc888c610 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:50.188104 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d1817-0c3c-492f-a834-094cc888c610 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:50.190195 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d1817-0c3c-492f-a834-094cc888c610 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:50.206705 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-029d1817-0c3c-492f-a834-094cc888c610 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:25:50.207775 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 407/814] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:25:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:50.213444 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7569f-747a-42bc-8dbf-4352885373ee admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:50.221862 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7569f-747a-42bc-8dbf-4352885373ee admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:50.226768 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4437b-1376-4a6b-b771-b91a6e6da780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:50.227348 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4437b-1376-4a6b-b771-b91a6e6da780 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:50.227634 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4437b-1376-4a6b-b771-b91a6e6da780 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:50.227916 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4437b-1376-4a6b-b771-b91a6e6da780 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:50.228604 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4437b-1376-4a6b-b771-b91a6e6da780 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:50.228945 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4437b-1376-4a6b-b771-b91a6e6da780 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:50.230511 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4437b-1376-4a6b-b771-b91a6e6da780 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:50.243349 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 408/815] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:25:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:50.249034 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d1817-0c3c-492f-a834-094cc888c610 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:50.258211 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d1817-0c3c-492f-a834-094cc888c610 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:50.262387 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832258fc-ba46-4051-91d3-989010ddbeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:50.263091 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832258fc-ba46-4051-91d3-989010ddbeee admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:50.263372 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832258fc-ba46-4051-91d3-989010ddbeee admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:50.263650 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832258fc-ba46-4051-91d3-989010ddbeee admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:50.272571 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832258fc-ba46-4051-91d3-989010ddbeee admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:50.274554 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832258fc-ba46-4051-91d3-989010ddbeee admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:50.288469 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-832258fc-ba46-4051-91d3-989010ddbeee admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:25:50.289715 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 408/816] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:25:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:50.295698 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4437b-1376-4a6b-b771-b91a6e6da780 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:50.305075 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4437b-1376-4a6b-b771-b91a6e6da780 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:50.309314 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9e398-809b-4bfa-8a9b-9e8349ab96b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:50.309897 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9e398-809b-4bfa-8a9b-9e8349ab96b4 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:50.310188 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9e398-809b-4bfa-8a9b-9e8349ab96b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:50.310476 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9e398-809b-4bfa-8a9b-9e8349ab96b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:50.311219 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9e398-809b-4bfa-8a9b-9e8349ab96b4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:50.311526 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9e398-809b-4bfa-8a9b-9e8349ab96b4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:50.313657 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9e398-809b-4bfa-8a9b-9e8349ab96b4 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:50.325960 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 409/817] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:25:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:50.331628 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832258fc-ba46-4051-91d3-989010ddbeee admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:50.342280 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832258fc-ba46-4051-91d3-989010ddbeee admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:50.347106 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f383df-2b4e-4896-afd5-a3d96c7c7779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:50.347730 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f383df-2b4e-4896-afd5-a3d96c7c7779 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:50.348089 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f383df-2b4e-4896-afd5-a3d96c7c7779 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:50.348486 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f383df-2b4e-4896-afd5-a3d96c7c7779 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:50.350144 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f383df-2b4e-4896-afd5-a3d96c7c7779 admin admin] RBAC: Adding query filter params (role.id=07f29be2087e43caaf6845ecf113b6e7, scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55, user.id=34e25627f3384826b35caf92a804c6d8) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:50.350532 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f383df-2b4e-4896-afd5-a3d96c7c7779 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:50.353212 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f383df-2b4e-4896-afd5-a3d96c7c7779 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:50.359798 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 409/818] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:25:50 2021] GET /identity/v3/role_assignments?user.id=34e25627f3384826b35caf92a804c6d8&scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55&role.id=07f29be2087e43caaf6845ecf113b6e7 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:52.419394 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc292e-58fb-470c-b7fb-b7754e5bce31 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:52.419916 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc292e-58fb-470c-b7fb-b7754e5bce31 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:52.420001 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc292e-58fb-470c-b7fb-b7754e5bce31 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:52.421683 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 410/819] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:25:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:52.426921 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813576e-3fc4-4497-8a24-c2091131f88b None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:52.427306 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813576e-3fc4-4497-8a24-c2091131f88b None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:52.427492 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813576e-3fc4-4497-8a24-c2091131f88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:52.449979 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-8813576e-3fc4-4497-8a24-c2091131f88b None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:52.451101 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-8813576e-3fc4-4497-8a24-c2091131f88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:52.457951 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 410/820] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:52 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:52.480060 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc292e-58fb-470c-b7fb-b7754e5bce31 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:52.492445 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc292e-58fb-470c-b7fb-b7754e5bce31 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:52.496508 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b03230-5065-4662-9540-02fec11d6451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:52.497257 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b03230-5065-4662-9540-02fec11d6451 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:52.497551 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b03230-5065-4662-9540-02fec11d6451 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:52.497837 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b03230-5065-4662-9540-02fec11d6451 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:52.509483 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b03230-5065-4662-9540-02fec11d6451 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:25:52.515818 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-78b03230-5065-4662-9540-02fec11d6451 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:25:52.516906 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 411/821] 10.222.0.64 () {56 vars in 1123 bytes} [Thu Dec 16 14:25:52 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:52.522605 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813576e-3fc4-4497-8a24-c2091131f88b None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:52.531006 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813576e-3fc4-4497-8a24-c2091131f88b None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:52.535269 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16740b84-e0e0-41b2-89ab-950bb7bbfd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:52.535853 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16740b84-e0e0-41b2-89ab-950bb7bbfd34 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:52.536168 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16740b84-e0e0-41b2-89ab-950bb7bbfd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:52.536457 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16740b84-e0e0-41b2-89ab-950bb7bbfd34 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:52.537206 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16740b84-e0e0-41b2-89ab-950bb7bbfd34 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:52.537508 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16740b84-e0e0-41b2-89ab-950bb7bbfd34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:52.539078 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16740b84-e0e0-41b2-89ab-950bb7bbfd34 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:52.547217 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 411/822] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Dec 16 14:25:52 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:25:52.553057 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b03230-5065-4662-9540-02fec11d6451 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:52.564475 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b03230-5065-4662-9540-02fec11d6451 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:52.569372 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc3f68-3a45-4beb-8ce6-39618bf13285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:52.570076 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc3f68-3a45-4beb-8ce6-39618bf13285 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:52.570368 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc3f68-3a45-4beb-8ce6-39618bf13285 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:52.570654 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc3f68-3a45-4beb-8ce6-39618bf13285 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:52.581700 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc3f68-3a45-4beb-8ce6-39618bf13285 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:52.583520 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc3f68-3a45-4beb-8ce6-39618bf13285 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:52.600265 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-5acc3f68-3a45-4beb-8ce6-39618bf13285 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:25:52.601440 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 412/823] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:25:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:52.607201 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16740b84-e0e0-41b2-89ab-950bb7bbfd34 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:52.617133 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16740b84-e0e0-41b2-89ab-950bb7bbfd34 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:52.621334 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9e76f-c9af-4d5f-bc94-eea049b7292c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:52.621917 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9e76f-c9af-4d5f-bc94-eea049b7292c admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:52.622205 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9e76f-c9af-4d5f-bc94-eea049b7292c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:52.622487 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9e76f-c9af-4d5f-bc94-eea049b7292c admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:52.623167 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9e76f-c9af-4d5f-bc94-eea049b7292c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:52.623467 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9e76f-c9af-4d5f-bc94-eea049b7292c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:52.625054 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9e76f-c9af-4d5f-bc94-eea049b7292c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:52.637778 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 412/824] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:25:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:52.643248 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc3f68-3a45-4beb-8ce6-39618bf13285 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:52.652405 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc3f68-3a45-4beb-8ce6-39618bf13285 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:52.656702 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3436e-c4d5-4b2f-af76-4cee496c8e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:52.657441 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3436e-c4d5-4b2f-af76-4cee496c8e75 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:52.657727 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3436e-c4d5-4b2f-af76-4cee496c8e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:52.658011 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3436e-c4d5-4b2f-af76-4cee496c8e75 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:52.670407 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3436e-c4d5-4b2f-af76-4cee496c8e75 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:52.672350 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3436e-c4d5-4b2f-af76-4cee496c8e75 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:52.690127 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-95e3436e-c4d5-4b2f-af76-4cee496c8e75 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 16 14:25:52.691180 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 413/825] 10.222.0.64 () {56 vars in 1123 bytes} [Thu Dec 16 14:25:52 2021] GET /identity/v3/users/neutron => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:52.697569 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9e76f-c9af-4d5f-bc94-eea049b7292c admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:52.706795 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9e76f-c9af-4d5f-bc94-eea049b7292c admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:52.711015 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2a5e5-739e-4d79-be95-bf0bb9ed96f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:52.711597 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2a5e5-739e-4d79-be95-bf0bb9ed96f5 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:52.711887 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2a5e5-739e-4d79-be95-bf0bb9ed96f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:52.712167 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2a5e5-739e-4d79-be95-bf0bb9ed96f5 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:52.712968 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2a5e5-739e-4d79-be95-bf0bb9ed96f5 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:52.713273 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2a5e5-739e-4d79-be95-bf0bb9ed96f5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:52.715074 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2a5e5-739e-4d79-be95-bf0bb9ed96f5 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:52.744365 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 413/826] 10.222.0.64 () {56 vars in 1160 bytes} [Thu Dec 16 14:25:52 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:52.749981 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3436e-c4d5-4b2f-af76-4cee496c8e75 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:52.759820 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3436e-c4d5-4b2f-af76-4cee496c8e75 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:52.763980 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f99f5-f208-4ccb-a10c-0ab005ef2996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:52.764685 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f99f5-f208-4ccb-a10c-0ab005ef2996 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:52.765006 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f99f5-f208-4ccb-a10c-0ab005ef2996 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:52.765289 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f99f5-f208-4ccb-a10c-0ab005ef2996 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:52.776815 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f99f5-f208-4ccb-a10c-0ab005ef2996 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:52.778653 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f99f5-f208-4ccb-a10c-0ab005ef2996 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:52.795916 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-261f99f5-f208-4ccb-a10c-0ab005ef2996 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:25:52.797072 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 414/827] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:25:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:52.803388 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2a5e5-739e-4d79-be95-bf0bb9ed96f5 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:52.812898 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2a5e5-739e-4d79-be95-bf0bb9ed96f5 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:52.818120 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bacd9-d3ae-4c68-bc76-c6d1a60d952b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:52.818715 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bacd9-d3ae-4c68-bc76-c6d1a60d952b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:52.819008 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bacd9-d3ae-4c68-bc76-c6d1a60d952b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:52.819293 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bacd9-d3ae-4c68-bc76-c6d1a60d952b admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:52.819985 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165bacd9-d3ae-4c68-bc76-c6d1a60d952b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:52.820286 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165bacd9-d3ae-4c68-bc76-c6d1a60d952b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:52.821899 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165bacd9-d3ae-4c68-bc76-c6d1a60d952b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:52.834565 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 414/828] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:25:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:52.840137 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f99f5-f208-4ccb-a10c-0ab005ef2996 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:52.850092 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f99f5-f208-4ccb-a10c-0ab005ef2996 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:52.854687 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5c8dc-4651-4483-b956-b6ad23568a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:52.855083 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5c8dc-4651-4483-b956-b6ad23568a9d admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:52.855377 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5c8dc-4651-4483-b956-b6ad23568a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:52.855665 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5c8dc-4651-4483-b956-b6ad23568a9d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:52.865158 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5c8dc-4651-4483-b956-b6ad23568a9d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:52.867129 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5c8dc-4651-4483-b956-b6ad23568a9d admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:52.881139 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-a7b5c8dc-4651-4483-b956-b6ad23568a9d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:25:52.882276 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 415/829] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:25:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:52.888397 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bacd9-d3ae-4c68-bc76-c6d1a60d952b admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:52.897790 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bacd9-d3ae-4c68-bc76-c6d1a60d952b admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:52.901992 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f27ef-da5e-40bf-9eaa-8f7fc42e4250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:52.902572 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f27ef-da5e-40bf-9eaa-8f7fc42e4250 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:52.902857 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f27ef-da5e-40bf-9eaa-8f7fc42e4250 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:52.903137 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f27ef-da5e-40bf-9eaa-8f7fc42e4250 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:52.903874 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f27ef-da5e-40bf-9eaa-8f7fc42e4250 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:52.904169 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f27ef-da5e-40bf-9eaa-8f7fc42e4250 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:52.906027 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f27ef-da5e-40bf-9eaa-8f7fc42e4250 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:52.919529 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 415/830] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:25:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:52.926043 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5c8dc-4651-4483-b956-b6ad23568a9d admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:52.937417 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5c8dc-4651-4483-b956-b6ad23568a9d admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:52.941923 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718210c2-ae27-491d-863e-fdc55baad292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:52.942762 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718210c2-ae27-491d-863e-fdc55baad292 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:52.943054 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718210c2-ae27-491d-863e-fdc55baad292 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:52.943342 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718210c2-ae27-491d-863e-fdc55baad292 admin admin] PATH_INFO: `/v3/projects/244c8ef98d0445c6a0279c46d5cb7e55/users/34e25627f3384826b35caf92a804c6d8/roles/07f29be2087e43caaf6845ecf113b6e7` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:52.962423 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718210c2-ae27-491d-863e-fdc55baad292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=244c8ef98d0445c6a0279c46d5cb7e55, user_id=34e25627f3384826b35caf92a804c6d8, role_id=07f29be2087e43caaf6845ecf113b6e7)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:52.965064 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718210c2-ae27-491d-863e-fdc55baad292 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:52.977586 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 416/831] 10.222.0.64 () {58 vars in 1460 bytes} [Thu Dec 16 14:25:52 2021] PUT /identity/v3/projects/244c8ef98d0445c6a0279c46d5cb7e55/users/34e25627f3384826b35caf92a804c6d8/roles/07f29be2087e43caaf6845ecf113b6e7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:25:55.004719 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60b932-264b-45ea-b828-d6aaa28b6bc0 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:55.005306 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60b932-264b-45ea-b828-d6aaa28b6bc0 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:55.005306 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60b932-264b-45ea-b828-d6aaa28b6bc0 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:55.006981 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 416/832] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:25:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:55.012075 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea10e4-f10c-483d-879e-2915261cd760 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:55.012475 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea10e4-f10c-483d-879e-2915261cd760 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:55.012637 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea10e4-f10c-483d-879e-2915261cd760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:55.034516 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-84ea10e4-f10c-483d-879e-2915261cd760 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:55.035641 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-84ea10e4-f10c-483d-879e-2915261cd760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:55.098256 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 417/833] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:55 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:55.122551 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60b932-264b-45ea-b828-d6aaa28b6bc0 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:55.135601 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60b932-264b-45ea-b828-d6aaa28b6bc0 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:55.139778 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca21c6-35b6-4e37-a5e2-3c8f0e1f2b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:55.140494 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca21c6-35b6-4e37-a5e2-3c8f0e1f2b49 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:55.140801 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca21c6-35b6-4e37-a5e2-3c8f0e1f2b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:55.141098 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca21c6-35b6-4e37-a5e2-3c8f0e1f2b49 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:55.153263 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca21c6-35b6-4e37-a5e2-3c8f0e1f2b49 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:25:55.159651 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-51ca21c6-35b6-4e37-a5e2-3c8f0e1f2b49 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:25:55.160804 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 417/834] 10.222.0.64 () {56 vars in 1123 bytes} [Thu Dec 16 14:25:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:55.167054 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea10e4-f10c-483d-879e-2915261cd760 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:55.175897 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea10e4-f10c-483d-879e-2915261cd760 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:55.180212 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954528b-0124-4b7c-b0a9-d1b0a4b80316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:55.180857 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954528b-0124-4b7c-b0a9-d1b0a4b80316 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:55.181159 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954528b-0124-4b7c-b0a9-d1b0a4b80316 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:55.181445 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954528b-0124-4b7c-b0a9-d1b0a4b80316 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:55.182167 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954528b-0124-4b7c-b0a9-d1b0a4b80316 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:55.182470 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954528b-0124-4b7c-b0a9-d1b0a4b80316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:55.184094 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954528b-0124-4b7c-b0a9-d1b0a4b80316 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:55.193589 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 418/835] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Dec 16 14:25:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:55.199627 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca21c6-35b6-4e37-a5e2-3c8f0e1f2b49 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:55.210987 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca21c6-35b6-4e37-a5e2-3c8f0e1f2b49 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:55.215419 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953e172-34cb-4d2c-9f74-7a3e52d92f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:55.216136 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953e172-34cb-4d2c-9f74-7a3e52d92f09 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:55.216427 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953e172-34cb-4d2c-9f74-7a3e52d92f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:55.216714 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953e172-34cb-4d2c-9f74-7a3e52d92f09 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:55.228233 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953e172-34cb-4d2c-9f74-7a3e52d92f09 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:55.230101 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953e172-34cb-4d2c-9f74-7a3e52d92f09 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:55.247468 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-1953e172-34cb-4d2c-9f74-7a3e52d92f09 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:25:55.248622 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 418/836] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:25:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:55.255137 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954528b-0124-4b7c-b0a9-d1b0a4b80316 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:55.265024 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954528b-0124-4b7c-b0a9-d1b0a4b80316 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:55.269357 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604d70f-f864-46be-b74f-80f6fd756c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:55.269961 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604d70f-f864-46be-b74f-80f6fd756c6e admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:55.270259 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604d70f-f864-46be-b74f-80f6fd756c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:55.271075 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604d70f-f864-46be-b74f-80f6fd756c6e admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:55.271776 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604d70f-f864-46be-b74f-80f6fd756c6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:55.272080 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604d70f-f864-46be-b74f-80f6fd756c6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:55.273752 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604d70f-f864-46be-b74f-80f6fd756c6e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:55.286328 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 419/837] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:25:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:55.292066 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953e172-34cb-4d2c-9f74-7a3e52d92f09 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:55.301309 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953e172-34cb-4d2c-9f74-7a3e52d92f09 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:55.305669 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297d777-0ecd-4d30-a0b1-da0ae23375d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:55.306409 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297d777-0ecd-4d30-a0b1-da0ae23375d0 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:55.306699 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297d777-0ecd-4d30-a0b1-da0ae23375d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:55.306983 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297d777-0ecd-4d30-a0b1-da0ae23375d0 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:55.320152 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297d777-0ecd-4d30-a0b1-da0ae23375d0 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:55.322166 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297d777-0ecd-4d30-a0b1-da0ae23375d0 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:55.339860 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-8297d777-0ecd-4d30-a0b1-da0ae23375d0 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 16 14:25:55.340930 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 419/838] 10.222.0.64 () {56 vars in 1123 bytes} [Thu Dec 16 14:25:55 2021] GET /identity/v3/users/neutron => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:55.346580 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604d70f-f864-46be-b74f-80f6fd756c6e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:55.356795 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604d70f-f864-46be-b74f-80f6fd756c6e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:55.360950 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3209c1-c385-4e8e-8eef-6f47d91e6f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:55.361534 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3209c1-c385-4e8e-8eef-6f47d91e6f4b admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:55.361819 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3209c1-c385-4e8e-8eef-6f47d91e6f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:55.362095 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3209c1-c385-4e8e-8eef-6f47d91e6f4b admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:55.362869 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3209c1-c385-4e8e-8eef-6f47d91e6f4b admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:55.363166 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3209c1-c385-4e8e-8eef-6f47d91e6f4b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:55.365015 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3209c1-c385-4e8e-8eef-6f47d91e6f4b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:55.393904 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 420/839] 10.222.0.64 () {56 vars in 1160 bytes} [Thu Dec 16 14:25:55 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:55.400134 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297d777-0ecd-4d30-a0b1-da0ae23375d0 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:55.409613 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297d777-0ecd-4d30-a0b1-da0ae23375d0 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:55.413881 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ec761-dcde-4398-b8ba-f08d1b428991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:55.414446 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ec761-dcde-4398-b8ba-f08d1b428991 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:55.414736 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ec761-dcde-4398-b8ba-f08d1b428991 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:55.415018 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ec761-dcde-4398-b8ba-f08d1b428991 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:55.422471 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ec761-dcde-4398-b8ba-f08d1b428991 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:55.424185 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ec761-dcde-4398-b8ba-f08d1b428991 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:55.432957 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 420/840] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:25:55 2021] GET /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:25:55.438773 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3209c1-c385-4e8e-8eef-6f47d91e6f4b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:55.448539 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3209c1-c385-4e8e-8eef-6f47d91e6f4b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:55.452920 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683e49b-48bb-4985-8af1-d91fb88789ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:55.453634 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683e49b-48bb-4985-8af1-d91fb88789ac admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:55.453921 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683e49b-48bb-4985-8af1-d91fb88789ac admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:55.454203 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683e49b-48bb-4985-8af1-d91fb88789ac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:55.467285 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683e49b-48bb-4985-8af1-d91fb88789ac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:55.469145 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683e49b-48bb-4985-8af1-d91fb88789ac admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:55.485340 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-f683e49b-48bb-4985-8af1-d91fb88789ac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:25:55.486375 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 421/841] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:25:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:55.492644 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ec761-dcde-4398-b8ba-f08d1b428991 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:55.501578 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ec761-dcde-4398-b8ba-f08d1b428991 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:55.506550 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e6d22-0363-4656-b4ee-b5a6e73ac145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:55.507130 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e6d22-0363-4656-b4ee-b5a6e73ac145 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:55.507419 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e6d22-0363-4656-b4ee-b5a6e73ac145 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:55.507697 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e6d22-0363-4656-b4ee-b5a6e73ac145 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:55.508376 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e6d22-0363-4656-b4ee-b5a6e73ac145 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:55.508692 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e6d22-0363-4656-b4ee-b5a6e73ac145 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:55.510258 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e6d22-0363-4656-b4ee-b5a6e73ac145 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:55.522071 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 421/842] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:25:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:55.527340 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683e49b-48bb-4985-8af1-d91fb88789ac admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:55.536337 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683e49b-48bb-4985-8af1-d91fb88789ac admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:55.540445 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadf159-6de0-4a3e-9430-c9e99cc76a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:55.541176 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadf159-6de0-4a3e-9430-c9e99cc76a05 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:55.541461 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadf159-6de0-4a3e-9430-c9e99cc76a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:55.541740 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadf159-6de0-4a3e-9430-c9e99cc76a05 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:55.549859 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dadf159-6de0-4a3e-9430-c9e99cc76a05 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:55.552390 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dadf159-6de0-4a3e-9430-c9e99cc76a05 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:55.565568 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-6dadf159-6de0-4a3e-9430-c9e99cc76a05 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:25:55.566596 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 422/843] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:25:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:55.572804 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e6d22-0363-4656-b4ee-b5a6e73ac145 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:55.582105 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e6d22-0363-4656-b4ee-b5a6e73ac145 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:55.586384 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85195f9c-0ace-4de9-9798-fca43ef36566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:55.586959 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85195f9c-0ace-4de9-9798-fca43ef36566 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:55.587250 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85195f9c-0ace-4de9-9798-fca43ef36566 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:55.587534 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85195f9c-0ace-4de9-9798-fca43ef36566 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:55.588266 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85195f9c-0ace-4de9-9798-fca43ef36566 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:55.588572 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85195f9c-0ace-4de9-9798-fca43ef36566 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:55.590417 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85195f9c-0ace-4de9-9798-fca43ef36566 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:55.602756 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 422/844] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:25:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:55.608343 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadf159-6de0-4a3e-9430-c9e99cc76a05 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:55.618182 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadf159-6de0-4a3e-9430-c9e99cc76a05 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:55.622328 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4f11b-80e3-4eb7-b750-46432b26d94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:55.622889 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4f11b-80e3-4eb7-b750-46432b26d94a admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:55.623177 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4f11b-80e3-4eb7-b750-46432b26d94a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:55.623457 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4f11b-80e3-4eb7-b750-46432b26d94a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:55.624248 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4f11b-80e3-4eb7-b750-46432b26d94a admin admin] RBAC: Adding query filter params (role.id=07f29be2087e43caaf6845ecf113b6e7, scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55, user.id=34e25627f3384826b35caf92a804c6d8) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:55.624551 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4f11b-80e3-4eb7-b750-46432b26d94a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:55.626392 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4f11b-80e3-4eb7-b750-46432b26d94a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:55.632492 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 423/845] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:25:55 2021] GET /identity/v3/role_assignments?user.id=34e25627f3384826b35caf92a804c6d8&scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55&role.id=07f29be2087e43caaf6845ecf113b6e7 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:57.701738 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8b7d4-2f30-4597-8417-09020d11408a None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:57.702320 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8b7d4-2f30-4597-8417-09020d11408a None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:57.702320 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8b7d4-2f30-4597-8417-09020d11408a None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:57.703987 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 423/846] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:25:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:57.709119 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d49814-f56e-4471-9441-bce241674654 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:57.709549 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d49814-f56e-4471-9441-bce241674654 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:57.709689 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d49814-f56e-4471-9441-bce241674654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:57.732821 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-95d49814-f56e-4471-9441-bce241674654 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:57.734048 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-95d49814-f56e-4471-9441-bce241674654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:57.741547 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 424/847] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:57 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:57.764072 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8b7d4-2f30-4597-8417-09020d11408a None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:57.780136 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8b7d4-2f30-4597-8417-09020d11408a None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:57.784362 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310c2bb-9267-4227-bf34-d4a13bbafa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:57.785105 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310c2bb-9267-4227-bf34-d4a13bbafa68 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:57.785399 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310c2bb-9267-4227-bf34-d4a13bbafa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:57.785684 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310c2bb-9267-4227-bf34-d4a13bbafa68 admin admin] PATH_INFO: `/v3/services/network` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:57.786931 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310c2bb-9267-4227-bf34-d4a13bbafa68 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:57.788498 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310c2bb-9267-4227-bf34-d4a13bbafa68 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:57.798686 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-d310c2bb-9267-4227-bf34-d4a13bbafa68 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 16 14:25:57.799752 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 424/848] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:25:57 2021] GET /identity/v3/services/network => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:57.805762 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d49814-f56e-4471-9441-bce241674654 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:57.814669 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d49814-f56e-4471-9441-bce241674654 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:57.818983 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314590c-c904-4e97-89bb-2800cdc52336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:57.819574 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314590c-c904-4e97-89bb-2800cdc52336 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:57.819861 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314590c-c904-4e97-89bb-2800cdc52336 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:57.820145 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314590c-c904-4e97-89bb-2800cdc52336 admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:57.820844 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314590c-c904-4e97-89bb-2800cdc52336 admin admin] RBAC: Adding query filter params (name=network) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:57.821149 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314590c-c904-4e97-89bb-2800cdc52336 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:57.822722 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314590c-c904-4e97-89bb-2800cdc52336 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:57.827438 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 425/849] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Dec 16 14:25:57 2021] GET /identity/v3/services?name=network => generated 124 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:57.832802 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310c2bb-9267-4227-bf34-d4a13bbafa68 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:57.842583 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310c2bb-9267-4227-bf34-d4a13bbafa68 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:57.846919 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317bdeb-8881-4f8c-b8c0-009f0ee4099c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:57.847504 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317bdeb-8881-4f8c-b8c0-009f0ee4099c admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:57.847791 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317bdeb-8881-4f8c-b8c0-009f0ee4099c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:57.848074 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317bdeb-8881-4f8c-b8c0-009f0ee4099c admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:57.848763 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317bdeb-8881-4f8c-b8c0-009f0ee4099c admin admin] RBAC: Adding query filter params (type=network) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:25:57.849098 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317bdeb-8881-4f8c-b8c0-009f0ee4099c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:57.850651 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317bdeb-8881-4f8c-b8c0-009f0ee4099c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:25:57.855058 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 425/850] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Dec 16 14:25:57 2021] GET /identity/v3/services?type=network => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:59.912152 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fa8c1-72ec-44df-9801-a0986b1d9c04 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:59.912694 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fa8c1-72ec-44df-9801-a0986b1d9c04 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:59.912694 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fa8c1-72ec-44df-9801-a0986b1d9c04 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:59.914506 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 426/851] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:25:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:59.919814 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37d341-5b11-4288-bb47-43d87269e4c5 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:59.920271 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37d341-5b11-4288-bb47-43d87269e4c5 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:59.920378 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37d341-5b11-4288-bb47-43d87269e4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:59.944026 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-6a37d341-5b11-4288-bb47-43d87269e4c5 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:59.945233 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-6a37d341-5b11-4288-bb47-43d87269e4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:59.952239 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 426/852] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:59 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:59.975751 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fa8c1-72ec-44df-9801-a0986b1d9c04 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:59.987478 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fa8c1-72ec-44df-9801-a0986b1d9c04 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:59.992077 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0abca3-f965-4b92-8f2f-6b38ad5e43f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:59.992657 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0abca3-f965-4b92-8f2f-6b38ad5e43f8 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:59.992984 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0abca3-f965-4b92-8f2f-6b38ad5e43f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:59.993266 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0abca3-f965-4b92-8f2f-6b38ad5e43f8 admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:59.993946 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0abca3-f965-4b92-8f2f-6b38ad5e43f8 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:59.995520 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0abca3-f965-4b92-8f2f-6b38ad5e43f8 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:00.009332 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 427/853] 10.222.0.64 () {60 vars in 1162 bytes} [Thu Dec 16 14:25:59 2021] POST /identity/v3/services => generated 240 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:26:02.078008 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b3d57-b4f6-45d4-98a2-3e07cd134ff3 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:02.078557 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b3d57-b4f6-45d4-98a2-3e07cd134ff3 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:02.078557 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b3d57-b4f6-45d4-98a2-3e07cd134ff3 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:02.080250 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 427/854] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:26:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:02.086054 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d4591-d5df-4ccd-89a3-ac925b9207c0 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:02.086485 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d4591-d5df-4ccd-89a3-ac925b9207c0 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:02.086625 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d4591-d5df-4ccd-89a3-ac925b9207c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:02.107999 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-b44d4591-d5df-4ccd-89a3-ac925b9207c0 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:02.109091 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-b44d4591-d5df-4ccd-89a3-ac925b9207c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:02.126611 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 428/855] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:02 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:26:02.150688 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b3d57-b4f6-45d4-98a2-3e07cd134ff3 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:02.162661 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b3d57-b4f6-45d4-98a2-3e07cd134ff3 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:02.166764 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc88e93-44b2-43de-a0bb-aaff9efcfb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:02.167480 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc88e93-44b2-43de-a0bb-aaff9efcfb9d admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:02.167769 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc88e93-44b2-43de-a0bb-aaff9efcfb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:02.168048 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc88e93-44b2-43de-a0bb-aaff9efcfb9d admin admin] PATH_INFO: `/v3/services/network` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:02.168674 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc88e93-44b2-43de-a0bb-aaff9efcfb9d admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:02.170294 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc88e93-44b2-43de-a0bb-aaff9efcfb9d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:02.180760 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-9fc88e93-44b2-43de-a0bb-aaff9efcfb9d admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 16 14:26:02.181886 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 428/856] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:26:02 2021] GET /identity/v3/services/network => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:02.188237 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d4591-d5df-4ccd-89a3-ac925b9207c0 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:02.197678 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d4591-d5df-4ccd-89a3-ac925b9207c0 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:02.202512 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a0028-5fd6-497d-8a32-47b196a9aee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:02.203151 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a0028-5fd6-497d-8a32-47b196a9aee8 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:02.203443 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a0028-5fd6-497d-8a32-47b196a9aee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:02.203727 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a0028-5fd6-497d-8a32-47b196a9aee8 admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:02.204409 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a0028-5fd6-497d-8a32-47b196a9aee8 admin admin] RBAC: Adding query filter params (name=network) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:02.204714 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a0028-5fd6-497d-8a32-47b196a9aee8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:02.206357 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a0028-5fd6-497d-8a32-47b196a9aee8 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:02.212002 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 429/857] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Dec 16 14:26:02 2021] GET /identity/v3/services?name=network => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:02.217782 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc88e93-44b2-43de-a0bb-aaff9efcfb9d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:02.228070 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc88e93-44b2-43de-a0bb-aaff9efcfb9d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:02.232324 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776b348-cf57-4a55-bb2b-7a0efd7b6215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:02.232947 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776b348-cf57-4a55-bb2b-7a0efd7b6215 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:02.233236 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776b348-cf57-4a55-bb2b-7a0efd7b6215 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:02.233519 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776b348-cf57-4a55-bb2b-7a0efd7b6215 admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:02.234192 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776b348-cf57-4a55-bb2b-7a0efd7b6215 admin admin] RBAC: Adding query filter params (type=network) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:02.234491 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776b348-cf57-4a55-bb2b-7a0efd7b6215 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:02.236047 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776b348-cf57-4a55-bb2b-7a0efd7b6215 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:02.241704 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 429/858] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Dec 16 14:26:02 2021] GET /identity/v3/services?type=network => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:02.247698 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a0028-5fd6-497d-8a32-47b196a9aee8 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:02.257387 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a0028-5fd6-497d-8a32-47b196a9aee8 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:02.261749 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b677296-501c-4714-9723-1b2f0393deea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:02.262363 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b677296-501c-4714-9723-1b2f0393deea admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:02.262693 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b677296-501c-4714-9723-1b2f0393deea admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:02.262983 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b677296-501c-4714-9723-1b2f0393deea admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:02.263754 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b677296-501c-4714-9723-1b2f0393deea admin admin] RBAC: Adding query filter params (interface=public, service_id=0f285152359f4303b4b64921501eb574, region_id=RegionOne) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:02.264066 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b677296-501c-4714-9723-1b2f0393deea admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:02.265709 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b677296-501c-4714-9723-1b2f0393deea admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:02.271915 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 430/859] 10.222.0.64 () {56 vars in 1272 bytes} [Thu Dec 16 14:26:02 2021] GET /identity/v3/endpoints?service_id=0f285152359f4303b4b64921501eb574&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:02.277702 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776b348-cf57-4a55-bb2b-7a0efd7b6215 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:02.287652 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776b348-cf57-4a55-bb2b-7a0efd7b6215 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:02.291930 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a956df-084b-4262-9d62-6b68cf3db57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:02.292502 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a956df-084b-4262-9d62-6b68cf3db57a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:02.292813 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a956df-084b-4262-9d62-6b68cf3db57a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:02.293105 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a956df-084b-4262-9d62-6b68cf3db57a admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:02.293757 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a956df-084b-4262-9d62-6b68cf3db57a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:02.295314 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a956df-084b-4262-9d62-6b68cf3db57a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:02.301720 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 430/860] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Dec 16 14:26:02 2021] GET /identity/v3/services => generated 1967 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:26:04.374356 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db371b-8fc9-42cf-9206-6515c1bf2ef0 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:04.374986 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db371b-8fc9-42cf-9206-6515c1bf2ef0 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:04.374986 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db371b-8fc9-42cf-9206-6515c1bf2ef0 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:04.376604 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 431/861] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:26:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:04.382399 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb6a28-f62c-4452-a088-857b5222b87b None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:04.382814 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb6a28-f62c-4452-a088-857b5222b87b None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:04.382962 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb6a28-f62c-4452-a088-857b5222b87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:04.404449 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-7ffb6a28-f62c-4452-a088-857b5222b87b None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:04.405676 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-7ffb6a28-f62c-4452-a088-857b5222b87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:04.413153 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 431/862] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:04 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:26:04.436109 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db371b-8fc9-42cf-9206-6515c1bf2ef0 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:04.448434 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db371b-8fc9-42cf-9206-6515c1bf2ef0 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:04.452623 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18586c-8a5c-49e0-85e1-69bc9101c11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:04.453381 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18586c-8a5c-49e0-85e1-69bc9101c11f admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:04.453677 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18586c-8a5c-49e0-85e1-69bc9101c11f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:04.453963 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18586c-8a5c-49e0-85e1-69bc9101c11f admin admin] PATH_INFO: `/v3/services/network` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:04.454594 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18586c-8a5c-49e0-85e1-69bc9101c11f admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:04.456193 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18586c-8a5c-49e0-85e1-69bc9101c11f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:04.466869 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-af18586c-8a5c-49e0-85e1-69bc9101c11f admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 16 14:26:04.467973 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 432/863] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:26:04 2021] GET /identity/v3/services/network => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:04.474703 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb6a28-f62c-4452-a088-857b5222b87b None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:04.483372 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb6a28-f62c-4452-a088-857b5222b87b None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:04.487642 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3e2a2-2ac8-4d6f-aefd-2f5558a86772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:04.488234 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3e2a2-2ac8-4d6f-aefd-2f5558a86772 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:04.488594 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3e2a2-2ac8-4d6f-aefd-2f5558a86772 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:04.489398 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3e2a2-2ac8-4d6f-aefd-2f5558a86772 admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:04.490076 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3e2a2-2ac8-4d6f-aefd-2f5558a86772 admin admin] RBAC: Adding query filter params (name=network) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:04.490378 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3e2a2-2ac8-4d6f-aefd-2f5558a86772 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:04.491959 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3e2a2-2ac8-4d6f-aefd-2f5558a86772 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:04.497022 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 432/864] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Dec 16 14:26:04 2021] GET /identity/v3/services?name=network => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:04.502795 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18586c-8a5c-49e0-85e1-69bc9101c11f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:04.512163 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18586c-8a5c-49e0-85e1-69bc9101c11f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:04.516339 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16ff28-f8d2-4ee0-bc94-20d98a321290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:04.516956 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16ff28-f8d2-4ee0-bc94-20d98a321290 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:04.517245 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16ff28-f8d2-4ee0-bc94-20d98a321290 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:04.517522 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16ff28-f8d2-4ee0-bc94-20d98a321290 admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:04.518191 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16ff28-f8d2-4ee0-bc94-20d98a321290 admin admin] RBAC: Adding query filter params (type=network) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:04.518490 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16ff28-f8d2-4ee0-bc94-20d98a321290 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:04.520573 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16ff28-f8d2-4ee0-bc94-20d98a321290 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:04.526007 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 433/865] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Dec 16 14:26:04 2021] GET /identity/v3/services?type=network => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:04.531985 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3e2a2-2ac8-4d6f-aefd-2f5558a86772 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:04.542230 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3e2a2-2ac8-4d6f-aefd-2f5558a86772 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:04.546552 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae36553-ab35-4374-9610-6c6f6c1f78dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:04.547136 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae36553-ab35-4374-9610-6c6f6c1f78dc admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:04.547429 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae36553-ab35-4374-9610-6c6f6c1f78dc admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:04.547716 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae36553-ab35-4374-9610-6c6f6c1f78dc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:04.548423 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae36553-ab35-4374-9610-6c6f6c1f78dc admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:04.550048 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae36553-ab35-4374-9610-6c6f6c1f78dc admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:04.568627 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 433/866] 10.222.0.64 () {60 vars in 1165 bytes} [Thu Dec 16 14:26:04 2021] POST /identity/v3/endpoints => generated 327 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:26:06.829041 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a34429-efe1-4b6b-be6a-adfbc1c5487d None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:06.829624 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a34429-efe1-4b6b-be6a-adfbc1c5487d None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:06.829624 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a34429-efe1-4b6b-be6a-adfbc1c5487d None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:06.831289 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 434/867] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:26:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:06.836753 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4df8c-6189-483f-a554-b053cfe760bd None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:06.837290 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4df8c-6189-483f-a554-b053cfe760bd None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:06.837432 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4df8c-6189-483f-a554-b053cfe760bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:06.859698 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-d2d4df8c-6189-483f-a554-b053cfe760bd None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:06.860885 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-d2d4df8c-6189-483f-a554-b053cfe760bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:06.880296 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 434/868] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:06 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:26:06.902564 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a34429-efe1-4b6b-be6a-adfbc1c5487d None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:06.915405 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a34429-efe1-4b6b-be6a-adfbc1c5487d None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:06.919591 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b116d06-0902-4ad4-b1d0-a278d20d4f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:06.920196 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b116d06-0902-4ad4-b1d0-a278d20d4f21 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:06.920486 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b116d06-0902-4ad4-b1d0-a278d20d4f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:06.920770 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b116d06-0902-4ad4-b1d0-a278d20d4f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:06.921530 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b116d06-0902-4ad4-b1d0-a278d20d4f21 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:06.923316 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b116d06-0902-4ad4-b1d0-a278d20d4f21 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:06.930459 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.sql.core [None req-0b116d06-0902-4ad4-b1d0-a278d20d4f21 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Dec 16 14:26:06.930459 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Dec 16 14:26:06.930459 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [parameters: {'id': '6ef26ce27ed74aa19edfaa81fdd02925', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Dec 16 14:26:06.930459 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=67594) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Dec 16 14:26:06.936292 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-0b116d06-0902-4ad4-b1d0-a278d20d4f21 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Dec 16 14:26:06.937855 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 435/869] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:26:06 2021] POST /identity/v3/roles => generated 144 bytes in 36 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:06.948875 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4df8c-6189-483f-a554-b053cfe760bd None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:06.962585 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4df8c-6189-483f-a554-b053cfe760bd None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:06.967215 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e222b-574e-4457-8d74-4d9dc84b4c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:06.967989 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e222b-574e-4457-8d74-4d9dc84b4c9e admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:06.968280 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e222b-574e-4457-8d74-4d9dc84b4c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:06.968570 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e222b-574e-4457-8d74-4d9dc84b4c9e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:06.981519 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e222b-574e-4457-8d74-4d9dc84b4c9e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:26:06.989300 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-d81e222b-574e-4457-8d74-4d9dc84b4c9e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 16 14:26:06.990493 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 435/870] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Dec 16 14:26:06 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:06.996492 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b116d06-0902-4ad4-b1d0-a278d20d4f21 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:07.006950 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b116d06-0902-4ad4-b1d0-a278d20d4f21 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:07.011469 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b716f7c-e2ed-4eb4-bf5a-da72b0c05855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:07.012070 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b716f7c-e2ed-4eb4-bf5a-da72b0c05855 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:07.012362 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b716f7c-e2ed-4eb4-bf5a-da72b0c05855 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:07.012650 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b716f7c-e2ed-4eb4-bf5a-da72b0c05855 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:07.013411 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b716f7c-e2ed-4eb4-bf5a-da72b0c05855 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:07.013719 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b716f7c-e2ed-4eb4-bf5a-da72b0c05855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:07.015320 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b716f7c-e2ed-4eb4-bf5a-da72b0c05855 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:07.024193 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 436/871] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:26:06 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:09.143626 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449eb25b-32c8-4caf-9a76-1d74141d8dcd None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:09.144146 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449eb25b-32c8-4caf-9a76-1d74141d8dcd None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:09.144146 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449eb25b-32c8-4caf-9a76-1d74141d8dcd None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:09.146349 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 436/872] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:26:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:09.151803 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd535fff-02f5-4e44-8c60-88aa2132d1f4 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:09.152231 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd535fff-02f5-4e44-8c60-88aa2132d1f4 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:09.152497 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd535fff-02f5-4e44-8c60-88aa2132d1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:09.175242 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-cd535fff-02f5-4e44-8c60-88aa2132d1f4 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:09.176476 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-cd535fff-02f5-4e44-8c60-88aa2132d1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:09.184253 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 437/873] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:09 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:26:09.208493 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449eb25b-32c8-4caf-9a76-1d74141d8dcd None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:09.220897 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449eb25b-32c8-4caf-9a76-1d74141d8dcd None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:09.225653 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49377c51-50ee-4635-860e-9bbacc3da363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:09.226347 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49377c51-50ee-4635-860e-9bbacc3da363 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:09.226636 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49377c51-50ee-4635-860e-9bbacc3da363 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:09.226909 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49377c51-50ee-4635-860e-9bbacc3da363 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:09.237862 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49377c51-50ee-4635-860e-9bbacc3da363 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:09.239698 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49377c51-50ee-4635-860e-9bbacc3da363 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:09.257832 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-49377c51-50ee-4635-860e-9bbacc3da363 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:26:09.258914 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 437/874] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:09.265176 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd535fff-02f5-4e44-8c60-88aa2132d1f4 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:09.274437 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd535fff-02f5-4e44-8c60-88aa2132d1f4 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:09.279291 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55a44a-0937-4013-8245-76d8fcc878b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:09.279880 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55a44a-0937-4013-8245-76d8fcc878b8 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:09.280168 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55a44a-0937-4013-8245-76d8fcc878b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:09.280450 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55a44a-0937-4013-8245-76d8fcc878b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:09.281172 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55a44a-0937-4013-8245-76d8fcc878b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:09.281471 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55a44a-0937-4013-8245-76d8fcc878b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:09.283042 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55a44a-0937-4013-8245-76d8fcc878b8 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:09.295514 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 438/875] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:26:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:09.301086 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49377c51-50ee-4635-860e-9bbacc3da363 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:09.310180 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49377c51-50ee-4635-860e-9bbacc3da363 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:09.314600 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963ea7d-03c4-47d8-912c-116dd4564a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:09.315172 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963ea7d-03c4-47d8-912c-116dd4564a16 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:09.315458 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963ea7d-03c4-47d8-912c-116dd4564a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:09.315734 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963ea7d-03c4-47d8-912c-116dd4564a16 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:09.316367 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963ea7d-03c4-47d8-912c-116dd4564a16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:09.318277 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963ea7d-03c4-47d8-912c-116dd4564a16 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:09.337812 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 438/876] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Dec 16 14:26:09 2021] POST /identity/v3/users => generated 247 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:26:11.431771 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1679fef-8b25-4e62-92ab-009c4c114e4a None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:11.432356 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1679fef-8b25-4e62-92ab-009c4c114e4a None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:11.432356 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1679fef-8b25-4e62-92ab-009c4c114e4a None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:11.434108 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 439/877] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:26:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:11.440910 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e7a2a-1f7f-490a-9ef0-5f1e154edd6b None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:11.441433 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e7a2a-1f7f-490a-9ef0-5f1e154edd6b None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:11.441560 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e7a2a-1f7f-490a-9ef0-5f1e154edd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:11.464298 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-c62e7a2a-1f7f-490a-9ef0-5f1e154edd6b None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:11.465493 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-c62e7a2a-1f7f-490a-9ef0-5f1e154edd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:11.472645 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 439/878] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:11 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:26:11.497645 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1679fef-8b25-4e62-92ab-009c4c114e4a None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:11.512202 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1679fef-8b25-4e62-92ab-009c4c114e4a None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:11.515306 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b797a-90e6-452b-8d19-5886e81b3734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:11.516040 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b797a-90e6-452b-8d19-5886e81b3734 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:11.516333 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b797a-90e6-452b-8d19-5886e81b3734 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:11.516619 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b797a-90e6-452b-8d19-5886e81b3734 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:11.529674 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b797a-90e6-452b-8d19-5886e81b3734 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:26:11.536872 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-3c3b797a-90e6-452b-8d19-5886e81b3734 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:26:11.538033 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 440/879] 10.222.0.64 () {56 vars in 1123 bytes} [Thu Dec 16 14:26:11 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:11.544170 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e7a2a-1f7f-490a-9ef0-5f1e154edd6b None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:11.553208 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e7a2a-1f7f-490a-9ef0-5f1e154edd6b None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:11.557618 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788faf4-e715-420c-82f1-e59e7ed01fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:11.558225 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788faf4-e715-420c-82f1-e59e7ed01fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:11.558518 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788faf4-e715-420c-82f1-e59e7ed01fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:11.558804 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788faf4-e715-420c-82f1-e59e7ed01fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:11.559531 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788faf4-e715-420c-82f1-e59e7ed01fa7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:11.559836 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788faf4-e715-420c-82f1-e59e7ed01fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:11.561462 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788faf4-e715-420c-82f1-e59e7ed01fa7 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:11.570802 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 440/880] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Dec 16 14:26:11 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:11.576697 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b797a-90e6-452b-8d19-5886e81b3734 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:11.590793 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b797a-90e6-452b-8d19-5886e81b3734 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:11.595709 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c429a-6511-4dc6-8419-835def0b2ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:11.596440 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c429a-6511-4dc6-8419-835def0b2ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:11.596728 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c429a-6511-4dc6-8419-835def0b2ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:11.597037 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c429a-6511-4dc6-8419-835def0b2ed6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:11.609113 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c429a-6511-4dc6-8419-835def0b2ed6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:11.610925 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c429a-6511-4dc6-8419-835def0b2ed6 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:11.627577 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-fc3c429a-6511-4dc6-8419-835def0b2ed6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:26:11.629397 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 441/881] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:26:11.640124 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788faf4-e715-420c-82f1-e59e7ed01fa7 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:11.650290 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788faf4-e715-420c-82f1-e59e7ed01fa7 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:11.654631 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ace61a-f846-42af-98c8-53b378163500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:11.655220 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ace61a-f846-42af-98c8-53b378163500 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:11.655510 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ace61a-f846-42af-98c8-53b378163500 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:11.655795 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ace61a-f846-42af-98c8-53b378163500 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:11.656482 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ace61a-f846-42af-98c8-53b378163500 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:11.656804 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ace61a-f846-42af-98c8-53b378163500 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:11.658381 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ace61a-f846-42af-98c8-53b378163500 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:11.670957 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 441/882] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:26:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:11.676748 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c429a-6511-4dc6-8419-835def0b2ed6 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:11.686333 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c429a-6511-4dc6-8419-835def0b2ed6 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:11.690941 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8727622-df75-44cb-9093-118e74a25a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:11.692175 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8727622-df75-44cb-9093-118e74a25a7a admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:11.692460 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8727622-df75-44cb-9093-118e74a25a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:11.692743 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8727622-df75-44cb-9093-118e74a25a7a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:11.705240 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8727622-df75-44cb-9093-118e74a25a7a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:11.707915 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8727622-df75-44cb-9093-118e74a25a7a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:11.725998 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-c8727622-df75-44cb-9093-118e74a25a7a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 16 14:26:11.727094 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 442/883] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:26:11 2021] GET /identity/v3/users/swift => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:11.732920 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ace61a-f846-42af-98c8-53b378163500 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:11.742197 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ace61a-f846-42af-98c8-53b378163500 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:11.746427 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d64087-c3e3-42b2-911e-7038ad32d9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:11.747023 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d64087-c3e3-42b2-911e-7038ad32d9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:11.747312 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d64087-c3e3-42b2-911e-7038ad32d9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:11.747593 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d64087-c3e3-42b2-911e-7038ad32d9a8 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:11.748374 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d64087-c3e3-42b2-911e-7038ad32d9a8 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:11.748676 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d64087-c3e3-42b2-911e-7038ad32d9a8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:11.750516 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d64087-c3e3-42b2-911e-7038ad32d9a8 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:11.779004 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 442/884] 10.222.0.64 () {56 vars in 1156 bytes} [Thu Dec 16 14:26:11 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:11.784632 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8727622-df75-44cb-9093-118e74a25a7a admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:11.793950 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8727622-df75-44cb-9093-118e74a25a7a admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:11.798293 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7630c8-4ae5-4a02-80ba-d5d8ad28f1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:11.798862 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7630c8-4ae5-4a02-80ba-d5d8ad28f1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:11.799153 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7630c8-4ae5-4a02-80ba-d5d8ad28f1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:11.799437 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7630c8-4ae5-4a02-80ba-d5d8ad28f1c1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:11.807405 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7630c8-4ae5-4a02-80ba-d5d8ad28f1c1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:11.809184 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7630c8-4ae5-4a02-80ba-d5d8ad28f1c1 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:11.819263 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 443/885] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:26:11 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:26:11.825051 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d64087-c3e3-42b2-911e-7038ad32d9a8 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:11.835159 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d64087-c3e3-42b2-911e-7038ad32d9a8 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:11.839431 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b168e18-5066-4a65-8887-1113a94b19d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:11.840145 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b168e18-5066-4a65-8887-1113a94b19d6 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:11.840431 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b168e18-5066-4a65-8887-1113a94b19d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:11.840712 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b168e18-5066-4a65-8887-1113a94b19d6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:11.852752 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b168e18-5066-4a65-8887-1113a94b19d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:11.854613 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b168e18-5066-4a65-8887-1113a94b19d6 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:11.871758 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-8b168e18-5066-4a65-8887-1113a94b19d6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:26:11.872887 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 443/886] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:11.879140 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7630c8-4ae5-4a02-80ba-d5d8ad28f1c1 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:11.889187 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7630c8-4ae5-4a02-80ba-d5d8ad28f1c1 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:11.893890 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b679d-1b2a-46e9-be3b-f7c94cc59d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:11.894475 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b679d-1b2a-46e9-be3b-f7c94cc59d9e admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:11.894768 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b679d-1b2a-46e9-be3b-f7c94cc59d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:11.895054 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b679d-1b2a-46e9-be3b-f7c94cc59d9e admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:11.895747 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b679d-1b2a-46e9-be3b-f7c94cc59d9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:11.896051 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b679d-1b2a-46e9-be3b-f7c94cc59d9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:11.897860 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b679d-1b2a-46e9-be3b-f7c94cc59d9e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:11.910470 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 444/887] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:26:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:11.916275 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b168e18-5066-4a65-8887-1113a94b19d6 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:11.926584 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b168e18-5066-4a65-8887-1113a94b19d6 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:11.931737 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121216e8-c3d1-4dce-b976-255e8efefa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:11.932729 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121216e8-c3d1-4dce-b976-255e8efefa6e admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:11.933058 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121216e8-c3d1-4dce-b976-255e8efefa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:11.933344 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121216e8-c3d1-4dce-b976-255e8efefa6e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:11.943251 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121216e8-c3d1-4dce-b976-255e8efefa6e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:11.945266 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121216e8-c3d1-4dce-b976-255e8efefa6e admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:11.959350 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-121216e8-c3d1-4dce-b976-255e8efefa6e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:26:11.960515 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 444/888] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:26:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:11.967182 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b679d-1b2a-46e9-be3b-f7c94cc59d9e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:11.981735 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b679d-1b2a-46e9-be3b-f7c94cc59d9e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:11.986348 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e32fae-f5c3-4bf4-8920-105559466a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:11.986947 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e32fae-f5c3-4bf4-8920-105559466a8f admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:11.987235 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e32fae-f5c3-4bf4-8920-105559466a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:11.987527 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e32fae-f5c3-4bf4-8920-105559466a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:11.988966 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e32fae-f5c3-4bf4-8920-105559466a8f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:11.989278 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e32fae-f5c3-4bf4-8920-105559466a8f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:11.991122 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e32fae-f5c3-4bf4-8920-105559466a8f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:12.007006 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 445/889] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:26:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:12.015772 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121216e8-c3d1-4dce-b976-255e8efefa6e admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:12.026571 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121216e8-c3d1-4dce-b976-255e8efefa6e admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:12.031369 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57069210-2df6-40f2-8765-3ea9eb413ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:12.031950 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57069210-2df6-40f2-8765-3ea9eb413ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:12.032243 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57069210-2df6-40f2-8765-3ea9eb413ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:12.032531 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57069210-2df6-40f2-8765-3ea9eb413ac8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:12.033353 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57069210-2df6-40f2-8765-3ea9eb413ac8 admin admin] RBAC: Adding query filter params (role.id=07f29be2087e43caaf6845ecf113b6e7, scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55, user.id=de4c90e44b96488aa47fbbc302e4f7cc) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:12.033665 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57069210-2df6-40f2-8765-3ea9eb413ac8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:12.036047 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57069210-2df6-40f2-8765-3ea9eb413ac8 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:12.041755 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 445/890] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:26:12 2021] GET /identity/v3/role_assignments?user.id=de4c90e44b96488aa47fbbc302e4f7cc&scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55&role.id=07f29be2087e43caaf6845ecf113b6e7 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:14.124669 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd201b1b-bf11-4c45-8298-d47f2f8c8861 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:14.125304 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd201b1b-bf11-4c45-8298-d47f2f8c8861 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:14.125304 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd201b1b-bf11-4c45-8298-d47f2f8c8861 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:14.126976 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 446/891] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:26:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:14.133557 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12cffe-fd71-4347-be25-ad5159b528e1 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:14.134052 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12cffe-fd71-4347-be25-ad5159b528e1 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:14.134160 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12cffe-fd71-4347-be25-ad5159b528e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:14.157084 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-5b12cffe-fd71-4347-be25-ad5159b528e1 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:14.158363 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-5b12cffe-fd71-4347-be25-ad5159b528e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:14.165962 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 446/892] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:14 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:26:14.190264 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd201b1b-bf11-4c45-8298-d47f2f8c8861 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:14.202662 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd201b1b-bf11-4c45-8298-d47f2f8c8861 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:14.207366 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f7ab3-7fea-4c8f-8819-ee4138f1484e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:14.208242 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f7ab3-7fea-4c8f-8819-ee4138f1484e admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:14.208633 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f7ab3-7fea-4c8f-8819-ee4138f1484e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:14.208965 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f7ab3-7fea-4c8f-8819-ee4138f1484e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:14.221743 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f7ab3-7fea-4c8f-8819-ee4138f1484e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:26:14.228430 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-189f7ab3-7fea-4c8f-8819-ee4138f1484e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:26:14.229647 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 447/893] 10.222.0.64 () {56 vars in 1123 bytes} [Thu Dec 16 14:26:14 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:14.236145 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12cffe-fd71-4347-be25-ad5159b528e1 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:14.251221 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12cffe-fd71-4347-be25-ad5159b528e1 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:14.256227 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27709cf-fff2-49f9-b114-8b3e492777a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:14.256864 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27709cf-fff2-49f9-b114-8b3e492777a9 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:14.257151 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27709cf-fff2-49f9-b114-8b3e492777a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:14.257429 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27709cf-fff2-49f9-b114-8b3e492777a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:14.258145 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27709cf-fff2-49f9-b114-8b3e492777a9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:14.258444 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27709cf-fff2-49f9-b114-8b3e492777a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:14.260018 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27709cf-fff2-49f9-b114-8b3e492777a9 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:14.269153 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 447/894] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Dec 16 14:26:14 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:14.275134 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f7ab3-7fea-4c8f-8819-ee4138f1484e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:14.285931 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f7ab3-7fea-4c8f-8819-ee4138f1484e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:14.290720 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebf0ae-b72c-4e9e-9d3e-b0dfac075096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:14.291882 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebf0ae-b72c-4e9e-9d3e-b0dfac075096 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:14.291882 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebf0ae-b72c-4e9e-9d3e-b0dfac075096 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:14.292161 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebf0ae-b72c-4e9e-9d3e-b0dfac075096 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:14.304304 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ebf0ae-b72c-4e9e-9d3e-b0dfac075096 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:14.306227 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ebf0ae-b72c-4e9e-9d3e-b0dfac075096 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:14.327176 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-40ebf0ae-b72c-4e9e-9d3e-b0dfac075096 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:26:14.328317 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 448/895] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:14.334529 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27709cf-fff2-49f9-b114-8b3e492777a9 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:14.344140 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27709cf-fff2-49f9-b114-8b3e492777a9 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:14.349039 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf082f2-60f3-449d-ae60-afe6f44660ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:14.349748 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf082f2-60f3-449d-ae60-afe6f44660ca admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:14.350091 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf082f2-60f3-449d-ae60-afe6f44660ca admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:14.350433 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf082f2-60f3-449d-ae60-afe6f44660ca admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:14.351179 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf082f2-60f3-449d-ae60-afe6f44660ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:14.351529 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf082f2-60f3-449d-ae60-afe6f44660ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:14.353196 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf082f2-60f3-449d-ae60-afe6f44660ca admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:14.366355 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 448/896] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:26:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:14.372191 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebf0ae-b72c-4e9e-9d3e-b0dfac075096 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:14.382490 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebf0ae-b72c-4e9e-9d3e-b0dfac075096 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:14.386791 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d2080-a3b1-44fb-9827-26362c4564a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:14.387511 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d2080-a3b1-44fb-9827-26362c4564a5 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:14.387797 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d2080-a3b1-44fb-9827-26362c4564a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:14.388077 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d2080-a3b1-44fb-9827-26362c4564a5 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:14.400736 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d2080-a3b1-44fb-9827-26362c4564a5 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:14.402789 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d2080-a3b1-44fb-9827-26362c4564a5 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:14.420321 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-ac2d2080-a3b1-44fb-9827-26362c4564a5 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 16 14:26:14.421497 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 449/897] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:26:14 2021] GET /identity/v3/users/swift => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:14.427932 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf082f2-60f3-449d-ae60-afe6f44660ca admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:14.438024 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf082f2-60f3-449d-ae60-afe6f44660ca admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:14.442865 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7538a-3cd9-4343-b920-61c509f2697b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:14.443455 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7538a-3cd9-4343-b920-61c509f2697b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:14.443745 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7538a-3cd9-4343-b920-61c509f2697b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:14.444027 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7538a-3cd9-4343-b920-61c509f2697b admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:14.444922 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa7538a-3cd9-4343-b920-61c509f2697b admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:14.445229 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa7538a-3cd9-4343-b920-61c509f2697b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:14.447046 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa7538a-3cd9-4343-b920-61c509f2697b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:14.475508 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 449/898] 10.222.0.64 () {56 vars in 1156 bytes} [Thu Dec 16 14:26:14 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:14.481367 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d2080-a3b1-44fb-9827-26362c4564a5 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:14.491393 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d2080-a3b1-44fb-9827-26362c4564a5 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:14.496231 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b052517-09dc-47f6-a614-c6bdf9599de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:14.496979 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b052517-09dc-47f6-a614-c6bdf9599de4 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:14.497274 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b052517-09dc-47f6-a614-c6bdf9599de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:14.497557 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b052517-09dc-47f6-a614-c6bdf9599de4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:14.510783 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b052517-09dc-47f6-a614-c6bdf9599de4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:14.513152 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b052517-09dc-47f6-a614-c6bdf9599de4 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:14.530272 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-1b052517-09dc-47f6-a614-c6bdf9599de4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:26:14.531640 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 450/899] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:14.537476 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7538a-3cd9-4343-b920-61c509f2697b admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:14.547119 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7538a-3cd9-4343-b920-61c509f2697b admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:14.551977 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca1856-e3ab-427d-bbb9-ac33112f415a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:14.552575 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca1856-e3ab-427d-bbb9-ac33112f415a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:14.552913 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca1856-e3ab-427d-bbb9-ac33112f415a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:14.553199 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca1856-e3ab-427d-bbb9-ac33112f415a admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:14.553898 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca1856-e3ab-427d-bbb9-ac33112f415a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:14.554196 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca1856-e3ab-427d-bbb9-ac33112f415a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:14.555810 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca1856-e3ab-427d-bbb9-ac33112f415a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:14.569953 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 450/900] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:26:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:26:14.575840 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b052517-09dc-47f6-a614-c6bdf9599de4 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:14.586794 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b052517-09dc-47f6-a614-c6bdf9599de4 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:14.591009 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266679c-1390-4a9c-be83-7208a53fc4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:14.591731 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266679c-1390-4a9c-be83-7208a53fc4cf admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:14.592014 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266679c-1390-4a9c-be83-7208a53fc4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:14.592292 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266679c-1390-4a9c-be83-7208a53fc4cf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:14.601878 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266679c-1390-4a9c-be83-7208a53fc4cf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:14.603833 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266679c-1390-4a9c-be83-7208a53fc4cf admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:14.618269 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-2266679c-1390-4a9c-be83-7208a53fc4cf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:26:14.619458 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 451/901] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:26:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:14.625523 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca1856-e3ab-427d-bbb9-ac33112f415a admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:14.635147 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca1856-e3ab-427d-bbb9-ac33112f415a admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:14.639448 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a83b12-a838-4596-a578-b186749d0ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:14.640037 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a83b12-a838-4596-a578-b186749d0ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:14.640323 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a83b12-a838-4596-a578-b186749d0ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:14.640607 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a83b12-a838-4596-a578-b186749d0ce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:14.641393 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a83b12-a838-4596-a578-b186749d0ce8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:14.641693 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a83b12-a838-4596-a578-b186749d0ce8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:14.643572 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a83b12-a838-4596-a578-b186749d0ce8 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:14.658269 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 451/902] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:26:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:14.664990 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266679c-1390-4a9c-be83-7208a53fc4cf admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:14.674559 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266679c-1390-4a9c-be83-7208a53fc4cf admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:14.679664 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b50d1d-9023-44cc-a7b8-f5b0c46f2e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:14.680486 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b50d1d-9023-44cc-a7b8-f5b0c46f2e71 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:14.680775 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b50d1d-9023-44cc-a7b8-f5b0c46f2e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:14.681084 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b50d1d-9023-44cc-a7b8-f5b0c46f2e71 admin admin] PATH_INFO: `/v3/projects/244c8ef98d0445c6a0279c46d5cb7e55/users/de4c90e44b96488aa47fbbc302e4f7cc/roles/07f29be2087e43caaf6845ecf113b6e7` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:14.702641 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b50d1d-9023-44cc-a7b8-f5b0c46f2e71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=244c8ef98d0445c6a0279c46d5cb7e55, user_id=de4c90e44b96488aa47fbbc302e4f7cc, role_id=07f29be2087e43caaf6845ecf113b6e7)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:14.705343 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b50d1d-9023-44cc-a7b8-f5b0c46f2e71 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:14.719411 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 452/903] 10.222.0.64 () {58 vars in 1460 bytes} [Thu Dec 16 14:26:14 2021] PUT /identity/v3/projects/244c8ef98d0445c6a0279c46d5cb7e55/users/de4c90e44b96488aa47fbbc302e4f7cc/roles/07f29be2087e43caaf6845ecf113b6e7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:26:16.805744 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff67b4d-a139-49bd-9c8d-5d38546296bc None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:16.806309 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff67b4d-a139-49bd-9c8d-5d38546296bc None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:16.806309 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff67b4d-a139-49bd-9c8d-5d38546296bc None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:16.807946 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 452/904] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:26:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:16.813917 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d747545-fa49-4ac3-8e10-221fc440fbcb None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:16.814402 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d747545-fa49-4ac3-8e10-221fc440fbcb None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:16.814485 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d747545-fa49-4ac3-8e10-221fc440fbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:16.836870 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-9d747545-fa49-4ac3-8e10-221fc440fbcb None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:16.838032 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-9d747545-fa49-4ac3-8e10-221fc440fbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:16.904408 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 453/905] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:16 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:26:16.928029 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff67b4d-a139-49bd-9c8d-5d38546296bc None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:16.940041 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff67b4d-a139-49bd-9c8d-5d38546296bc None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:16.944719 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9172eab-b60b-49ef-a16e-ef7ada6e5f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:16.945453 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9172eab-b60b-49ef-a16e-ef7ada6e5f49 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:16.945733 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9172eab-b60b-49ef-a16e-ef7ada6e5f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:16.946007 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9172eab-b60b-49ef-a16e-ef7ada6e5f49 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:16.958006 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9172eab-b60b-49ef-a16e-ef7ada6e5f49 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:26:16.964211 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-a9172eab-b60b-49ef-a16e-ef7ada6e5f49 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:26:16.965390 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 453/906] 10.222.0.64 () {56 vars in 1123 bytes} [Thu Dec 16 14:26:16 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:16.971872 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d747545-fa49-4ac3-8e10-221fc440fbcb None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:16.980759 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d747545-fa49-4ac3-8e10-221fc440fbcb None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:16.985466 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e5f7e-928f-4a4a-a9f1-69ddf6eb1218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:16.986159 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e5f7e-928f-4a4a-a9f1-69ddf6eb1218 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:16.986482 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e5f7e-928f-4a4a-a9f1-69ddf6eb1218 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:16.986811 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e5f7e-928f-4a4a-a9f1-69ddf6eb1218 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:16.987608 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e5f7e-928f-4a4a-a9f1-69ddf6eb1218 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:16.987913 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e5f7e-928f-4a4a-a9f1-69ddf6eb1218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:16.989570 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e5f7e-928f-4a4a-a9f1-69ddf6eb1218 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:16.998845 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 454/907] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Dec 16 14:26:16 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:17.005395 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9172eab-b60b-49ef-a16e-ef7ada6e5f49 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:17.015171 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9172eab-b60b-49ef-a16e-ef7ada6e5f49 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:17.020158 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb5210-1f22-4408-bf6c-2a4bf8255fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:17.020913 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb5210-1f22-4408-bf6c-2a4bf8255fde admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:17.021206 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb5210-1f22-4408-bf6c-2a4bf8255fde admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:17.021496 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb5210-1f22-4408-bf6c-2a4bf8255fde admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:17.032993 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb5210-1f22-4408-bf6c-2a4bf8255fde admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:17.034813 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb5210-1f22-4408-bf6c-2a4bf8255fde admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:17.052427 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-2fdb5210-1f22-4408-bf6c-2a4bf8255fde admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:26:17.053610 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 454/908] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:17.059534 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e5f7e-928f-4a4a-a9f1-69ddf6eb1218 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:17.069753 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e5f7e-928f-4a4a-a9f1-69ddf6eb1218 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:17.074005 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f2884-cf9b-4a99-8f7d-9b1da5037c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:17.074592 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f2884-cf9b-4a99-8f7d-9b1da5037c29 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:17.074879 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f2884-cf9b-4a99-8f7d-9b1da5037c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:17.075158 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f2884-cf9b-4a99-8f7d-9b1da5037c29 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:17.075880 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f2884-cf9b-4a99-8f7d-9b1da5037c29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:17.076177 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f2884-cf9b-4a99-8f7d-9b1da5037c29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:17.077815 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f2884-cf9b-4a99-8f7d-9b1da5037c29 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:17.091225 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 455/909] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:26:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:17.097902 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb5210-1f22-4408-bf6c-2a4bf8255fde admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:17.111066 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb5210-1f22-4408-bf6c-2a4bf8255fde admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:17.115939 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc3428-61e3-4796-a579-f7b45063fc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:17.116669 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc3428-61e3-4796-a579-f7b45063fc35 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:17.116993 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc3428-61e3-4796-a579-f7b45063fc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:17.117275 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc3428-61e3-4796-a579-f7b45063fc35 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:17.131494 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc3428-61e3-4796-a579-f7b45063fc35 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:17.133544 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc3428-61e3-4796-a579-f7b45063fc35 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:17.152358 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-13bc3428-61e3-4796-a579-f7b45063fc35 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 16 14:26:17.153532 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 455/910] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:26:17 2021] GET /identity/v3/users/swift => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:17.159474 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f2884-cf9b-4a99-8f7d-9b1da5037c29 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:17.169112 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f2884-cf9b-4a99-8f7d-9b1da5037c29 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:17.173599 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e7bbc-dd2a-4954-9532-3af9c3ebe997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:17.174198 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e7bbc-dd2a-4954-9532-3af9c3ebe997 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:17.174490 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e7bbc-dd2a-4954-9532-3af9c3ebe997 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:17.174776 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e7bbc-dd2a-4954-9532-3af9c3ebe997 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:17.175886 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e7bbc-dd2a-4954-9532-3af9c3ebe997 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:17.176193 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e7bbc-dd2a-4954-9532-3af9c3ebe997 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:17.178088 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e7bbc-dd2a-4954-9532-3af9c3ebe997 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:17.210949 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 456/911] 10.222.0.64 () {56 vars in 1156 bytes} [Thu Dec 16 14:26:17 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:17.216790 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc3428-61e3-4796-a579-f7b45063fc35 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:17.226405 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc3428-61e3-4796-a579-f7b45063fc35 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:17.230857 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd06b6-9674-4692-9cb8-0b12acab6793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:17.231429 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd06b6-9674-4692-9cb8-0b12acab6793 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:17.231715 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd06b6-9674-4692-9cb8-0b12acab6793 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:17.231994 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd06b6-9674-4692-9cb8-0b12acab6793 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:17.241267 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd06b6-9674-4692-9cb8-0b12acab6793 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:17.243028 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd06b6-9674-4692-9cb8-0b12acab6793 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:17.252719 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 456/912] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:26:17 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:26:17.259353 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e7bbc-dd2a-4954-9532-3af9c3ebe997 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:17.269013 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e7bbc-dd2a-4954-9532-3af9c3ebe997 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:17.273490 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bc10a-fe05-436d-9a0d-ec1bfdace9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:17.274232 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bc10a-fe05-436d-9a0d-ec1bfdace9fb admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:17.274623 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bc10a-fe05-436d-9a0d-ec1bfdace9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:17.275018 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bc10a-fe05-436d-9a0d-ec1bfdace9fb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:17.287650 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13bc10a-fe05-436d-9a0d-ec1bfdace9fb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:17.289667 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13bc10a-fe05-436d-9a0d-ec1bfdace9fb admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:17.307423 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-d13bc10a-fe05-436d-9a0d-ec1bfdace9fb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:26:17.308559 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 457/913] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:17.314643 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd06b6-9674-4692-9cb8-0b12acab6793 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:17.323799 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd06b6-9674-4692-9cb8-0b12acab6793 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:17.328141 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e2fb2-dc45-4d98-bf68-63acc400d0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:17.328722 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e2fb2-dc45-4d98-bf68-63acc400d0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:17.329045 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e2fb2-dc45-4d98-bf68-63acc400d0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:17.329329 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e2fb2-dc45-4d98-bf68-63acc400d0f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:17.330015 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e2fb2-dc45-4d98-bf68-63acc400d0f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:17.330314 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e2fb2-dc45-4d98-bf68-63acc400d0f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:17.331928 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e2fb2-dc45-4d98-bf68-63acc400d0f8 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:17.344477 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 457/914] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:26:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:17.350230 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bc10a-fe05-436d-9a0d-ec1bfdace9fb admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:17.359804 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bc10a-fe05-436d-9a0d-ec1bfdace9fb admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:17.364707 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60d3c8-a8b9-41bb-b92f-6d247bbf4a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:17.365551 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60d3c8-a8b9-41bb-b92f-6d247bbf4a2f admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:17.365850 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60d3c8-a8b9-41bb-b92f-6d247bbf4a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:17.366134 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60d3c8-a8b9-41bb-b92f-6d247bbf4a2f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:17.375271 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60d3c8-a8b9-41bb-b92f-6d247bbf4a2f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:17.377436 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60d3c8-a8b9-41bb-b92f-6d247bbf4a2f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:17.392803 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-0c60d3c8-a8b9-41bb-b92f-6d247bbf4a2f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:26:17.394002 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 458/915] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:26:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:17.400063 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e2fb2-dc45-4d98-bf68-63acc400d0f8 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:17.409394 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e2fb2-dc45-4d98-bf68-63acc400d0f8 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:17.413647 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa1ce1-9c0b-41e4-ad1b-c60971192d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:17.414223 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa1ce1-9c0b-41e4-ad1b-c60971192d4f admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:17.414509 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa1ce1-9c0b-41e4-ad1b-c60971192d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:17.414790 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa1ce1-9c0b-41e4-ad1b-c60971192d4f admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:17.415521 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa1ce1-9c0b-41e4-ad1b-c60971192d4f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:17.415819 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa1ce1-9c0b-41e4-ad1b-c60971192d4f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:17.417857 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa1ce1-9c0b-41e4-ad1b-c60971192d4f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:17.430907 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 458/916] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:26:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:17.437644 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60d3c8-a8b9-41bb-b92f-6d247bbf4a2f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:17.447767 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60d3c8-a8b9-41bb-b92f-6d247bbf4a2f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:17.452111 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac242ec-62d8-4809-b298-bb81525e4c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:17.452689 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac242ec-62d8-4809-b298-bb81525e4c9b admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:17.453017 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac242ec-62d8-4809-b298-bb81525e4c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:17.453307 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac242ec-62d8-4809-b298-bb81525e4c9b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:17.454094 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac242ec-62d8-4809-b298-bb81525e4c9b admin admin] RBAC: Adding query filter params (role.id=07f29be2087e43caaf6845ecf113b6e7, scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55, user.id=de4c90e44b96488aa47fbbc302e4f7cc) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:17.454406 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac242ec-62d8-4809-b298-bb81525e4c9b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:17.456241 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac242ec-62d8-4809-b298-bb81525e4c9b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:17.462825 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 459/917] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:26:17 2021] GET /identity/v3/role_assignments?user.id=de4c90e44b96488aa47fbbc302e4f7cc&scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55&role.id=07f29be2087e43caaf6845ecf113b6e7 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:19.578676 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998fe3f-f7f2-4931-bcfa-e8e585e5a2e3 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:19.579218 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998fe3f-f7f2-4931-bcfa-e8e585e5a2e3 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:19.579218 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998fe3f-f7f2-4931-bcfa-e8e585e5a2e3 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:19.580904 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 459/918] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:26:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:19.586511 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86757cb7-354a-4015-8afd-1d60400741f0 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:19.586911 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86757cb7-354a-4015-8afd-1d60400741f0 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:19.587083 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86757cb7-354a-4015-8afd-1d60400741f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:19.609643 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-86757cb7-354a-4015-8afd-1d60400741f0 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:19.610775 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-86757cb7-354a-4015-8afd-1d60400741f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:19.617742 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 460/919] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:19 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:26:19.640182 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998fe3f-f7f2-4931-bcfa-e8e585e5a2e3 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:19.652388 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998fe3f-f7f2-4931-bcfa-e8e585e5a2e3 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:19.656498 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b455364-b36c-4588-9b26-09271651b836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:19.657249 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b455364-b36c-4588-9b26-09271651b836 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:19.657536 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b455364-b36c-4588-9b26-09271651b836 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:19.657820 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b455364-b36c-4588-9b26-09271651b836 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:19.669526 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b455364-b36c-4588-9b26-09271651b836 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:26:19.675769 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-0b455364-b36c-4588-9b26-09271651b836 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:26:19.676871 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 460/920] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:26:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:19.682819 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86757cb7-354a-4015-8afd-1d60400741f0 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:19.691592 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86757cb7-354a-4015-8afd-1d60400741f0 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:19.695956 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd66a0-e55d-43d8-8e64-ca168bf9604d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:19.696559 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd66a0-e55d-43d8-8e64-ca168bf9604d admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:19.696890 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd66a0-e55d-43d8-8e64-ca168bf9604d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:19.697172 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd66a0-e55d-43d8-8e64-ca168bf9604d admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:19.697894 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd66a0-e55d-43d8-8e64-ca168bf9604d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:19.698191 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd66a0-e55d-43d8-8e64-ca168bf9604d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:19.699794 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd66a0-e55d-43d8-8e64-ca168bf9604d admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:19.709309 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 461/921] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:26:19 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:19.715789 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b455364-b36c-4588-9b26-09271651b836 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:19.726341 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b455364-b36c-4588-9b26-09271651b836 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:19.730591 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970bb80-1dc8-4362-a154-bde281502613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:19.731298 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970bb80-1dc8-4362-a154-bde281502613 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:19.731587 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970bb80-1dc8-4362-a154-bde281502613 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:19.731870 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970bb80-1dc8-4362-a154-bde281502613 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:19.742927 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970bb80-1dc8-4362-a154-bde281502613 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:19.744727 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970bb80-1dc8-4362-a154-bde281502613 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:19.761365 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-a970bb80-1dc8-4362-a154-bde281502613 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:26:19.762421 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 461/922] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:19.768062 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd66a0-e55d-43d8-8e64-ca168bf9604d admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:19.777817 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd66a0-e55d-43d8-8e64-ca168bf9604d admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:19.782058 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c4135-3068-493a-9420-f675fe612e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:19.782639 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c4135-3068-493a-9420-f675fe612e5d admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:19.782928 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c4135-3068-493a-9420-f675fe612e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:19.783212 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c4135-3068-493a-9420-f675fe612e5d admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:19.783903 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c4135-3068-493a-9420-f675fe612e5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:19.784204 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c4135-3068-493a-9420-f675fe612e5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:19.786446 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c4135-3068-493a-9420-f675fe612e5d admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:19.798501 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 462/923] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:26:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:19.804504 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970bb80-1dc8-4362-a154-bde281502613 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:19.813999 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970bb80-1dc8-4362-a154-bde281502613 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:19.818885 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6e632-1674-4978-bf8b-9c3dc3e73dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:19.819584 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6e632-1674-4978-bf8b-9c3dc3e73dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:19.819876 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6e632-1674-4978-bf8b-9c3dc3e73dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:19.820153 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6e632-1674-4978-bf8b-9c3dc3e73dd3 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:19.833358 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6e632-1674-4978-bf8b-9c3dc3e73dd3 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:19.835307 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6e632-1674-4978-bf8b-9c3dc3e73dd3 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:19.852892 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-56b6e632-1674-4978-bf8b-9c3dc3e73dd3 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 16 14:26:19.853964 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 462/924] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:26:19 2021] GET /identity/v3/users/swift => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:19.859612 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c4135-3068-493a-9420-f675fe612e5d admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:19.869547 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c4135-3068-493a-9420-f675fe612e5d admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:19.873712 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090dae7-ba72-4f52-8948-d72b9e94d86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:19.874301 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090dae7-ba72-4f52-8948-d72b9e94d86d admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:19.874589 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090dae7-ba72-4f52-8948-d72b9e94d86d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:19.874870 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090dae7-ba72-4f52-8948-d72b9e94d86d admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:19.875650 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090dae7-ba72-4f52-8948-d72b9e94d86d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:19.875957 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090dae7-ba72-4f52-8948-d72b9e94d86d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:19.877810 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090dae7-ba72-4f52-8948-d72b9e94d86d admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:19.906842 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 463/925] 10.222.0.64 () {56 vars in 1156 bytes} [Thu Dec 16 14:26:19 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:19.913205 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6e632-1674-4978-bf8b-9c3dc3e73dd3 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:19.922866 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6e632-1674-4978-bf8b-9c3dc3e73dd3 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:19.927864 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f985b39-b579-422e-aef6-5323b663abac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:19.928441 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f985b39-b579-422e-aef6-5323b663abac admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:19.928732 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f985b39-b579-422e-aef6-5323b663abac admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:19.929044 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f985b39-b579-422e-aef6-5323b663abac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:19.937411 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f985b39-b579-422e-aef6-5323b663abac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:19.939177 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f985b39-b579-422e-aef6-5323b663abac admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:19.948600 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 463/926] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:26:19 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:26:19.954774 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090dae7-ba72-4f52-8948-d72b9e94d86d admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:19.964297 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090dae7-ba72-4f52-8948-d72b9e94d86d admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:19.968626 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efc395-a836-45e7-930b-377757ee28cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:19.969402 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efc395-a836-45e7-930b-377757ee28cf admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:19.969696 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efc395-a836-45e7-930b-377757ee28cf admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:19.969986 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efc395-a836-45e7-930b-377757ee28cf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:19.982782 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efc395-a836-45e7-930b-377757ee28cf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:19.984619 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efc395-a836-45e7-930b-377757ee28cf admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:20.002312 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-40efc395-a836-45e7-930b-377757ee28cf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:26:20.003499 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 464/927] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:20.009495 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f985b39-b579-422e-aef6-5323b663abac admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:20.018092 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f985b39-b579-422e-aef6-5323b663abac admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:20.022374 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21d144-77c0-4347-ac8e-7a9cab1304e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:20.022953 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21d144-77c0-4347-ac8e-7a9cab1304e7 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:20.023241 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21d144-77c0-4347-ac8e-7a9cab1304e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:20.023520 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21d144-77c0-4347-ac8e-7a9cab1304e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:20.024201 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21d144-77c0-4347-ac8e-7a9cab1304e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:20.024500 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21d144-77c0-4347-ac8e-7a9cab1304e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:20.026096 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21d144-77c0-4347-ac8e-7a9cab1304e7 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:20.039244 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 464/928] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:26:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:20.045170 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efc395-a836-45e7-930b-377757ee28cf admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:20.055140 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efc395-a836-45e7-930b-377757ee28cf admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:20.059381 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ebd70-f8eb-4c10-9f09-cc19bdd5a2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:20.060091 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ebd70-f8eb-4c10-9f09-cc19bdd5a2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:20.060376 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ebd70-f8eb-4c10-9f09-cc19bdd5a2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:20.060660 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ebd70-f8eb-4c10-9f09-cc19bdd5a2d1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:20.069280 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ebd70-f8eb-4c10-9f09-cc19bdd5a2d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:20.071221 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ebd70-f8eb-4c10-9f09-cc19bdd5a2d1 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:20.084469 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-8f9ebd70-f8eb-4c10-9f09-cc19bdd5a2d1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:26:20.085503 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 465/929] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:26:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:20.091195 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21d144-77c0-4347-ac8e-7a9cab1304e7 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:20.101012 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21d144-77c0-4347-ac8e-7a9cab1304e7 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:20.105226 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f48007-017f-4a29-b39b-cc9385e3074b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:20.105795 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f48007-017f-4a29-b39b-cc9385e3074b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:20.106081 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f48007-017f-4a29-b39b-cc9385e3074b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:20.106360 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f48007-017f-4a29-b39b-cc9385e3074b admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:20.107085 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f48007-017f-4a29-b39b-cc9385e3074b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:20.107384 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f48007-017f-4a29-b39b-cc9385e3074b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:20.109206 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f48007-017f-4a29-b39b-cc9385e3074b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:20.122048 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 465/930] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:26:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:20.127921 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ebd70-f8eb-4c10-9f09-cc19bdd5a2d1 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:20.137165 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ebd70-f8eb-4c10-9f09-cc19bdd5a2d1 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:20.141492 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf7c39-b31a-4b0a-b77d-e00581d8e6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:20.142064 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf7c39-b31a-4b0a-b77d-e00581d8e6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:20.142357 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf7c39-b31a-4b0a-b77d-e00581d8e6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:20.142643 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf7c39-b31a-4b0a-b77d-e00581d8e6d0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:20.143415 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf7c39-b31a-4b0a-b77d-e00581d8e6d0 admin admin] RBAC: Adding query filter params (role.id=90166eb3dcfa41e58450e140b8b0fea3, scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55, user.id=de4c90e44b96488aa47fbbc302e4f7cc) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:20.143739 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf7c39-b31a-4b0a-b77d-e00581d8e6d0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:20.145603 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf7c39-b31a-4b0a-b77d-e00581d8e6d0 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:20.150794 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 466/931] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:26:20 2021] GET /identity/v3/role_assignments?user.id=de4c90e44b96488aa47fbbc302e4f7cc&scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55&role.id=90166eb3dcfa41e58450e140b8b0fea3 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:26:22.179174 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f300e-85c1-48ee-94be-a8f45cc3f396 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:22.179831 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f300e-85c1-48ee-94be-a8f45cc3f396 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:22.179831 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f300e-85c1-48ee-94be-a8f45cc3f396 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:22.181341 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 466/932] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:26:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:22.186489 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bd22a-94ea-47a2-ab3b-3817bd4c79ea None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:22.187122 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bd22a-94ea-47a2-ab3b-3817bd4c79ea None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:22.187302 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bd22a-94ea-47a2-ab3b-3817bd4c79ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:22.209526 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-944bd22a-94ea-47a2-ab3b-3817bd4c79ea None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:22.210674 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-944bd22a-94ea-47a2-ab3b-3817bd4c79ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:22.217819 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 467/933] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:22 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:26:22.241887 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f300e-85c1-48ee-94be-a8f45cc3f396 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:22.253855 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f300e-85c1-48ee-94be-a8f45cc3f396 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:22.257961 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44784943-836a-4ba9-9c98-f2e2da4e669d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:22.258677 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44784943-836a-4ba9-9c98-f2e2da4e669d admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:22.258968 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44784943-836a-4ba9-9c98-f2e2da4e669d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:22.259254 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44784943-836a-4ba9-9c98-f2e2da4e669d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:22.271458 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44784943-836a-4ba9-9c98-f2e2da4e669d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:26:22.277784 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-44784943-836a-4ba9-9c98-f2e2da4e669d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:26:22.278927 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 467/934] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:26:22 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:22.285631 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bd22a-94ea-47a2-ab3b-3817bd4c79ea None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:22.294652 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bd22a-94ea-47a2-ab3b-3817bd4c79ea None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:22.298948 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be30314-d2ab-4bc0-8ce9-f84ffefdbd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:22.299552 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be30314-d2ab-4bc0-8ce9-f84ffefdbd3b admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:22.299932 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be30314-d2ab-4bc0-8ce9-f84ffefdbd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:22.300752 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be30314-d2ab-4bc0-8ce9-f84ffefdbd3b admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:22.301513 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be30314-d2ab-4bc0-8ce9-f84ffefdbd3b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:22.301819 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be30314-d2ab-4bc0-8ce9-f84ffefdbd3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:22.303425 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be30314-d2ab-4bc0-8ce9-f84ffefdbd3b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:22.312532 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 468/935] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:26:22 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:22.318516 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44784943-836a-4ba9-9c98-f2e2da4e669d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:22.328844 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44784943-836a-4ba9-9c98-f2e2da4e669d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:22.333109 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9ba0b-5c52-4e4d-9daf-0a3d3b9cc7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:22.333828 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9ba0b-5c52-4e4d-9daf-0a3d3b9cc7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:22.334118 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9ba0b-5c52-4e4d-9daf-0a3d3b9cc7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:22.334401 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9ba0b-5c52-4e4d-9daf-0a3d3b9cc7d4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:22.345935 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9ba0b-5c52-4e4d-9daf-0a3d3b9cc7d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:22.348427 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9ba0b-5c52-4e4d-9daf-0a3d3b9cc7d4 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:22.368386 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-88e9ba0b-5c52-4e4d-9daf-0a3d3b9cc7d4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:26:22.369565 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 468/936] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:22.375528 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be30314-d2ab-4bc0-8ce9-f84ffefdbd3b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:22.386614 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be30314-d2ab-4bc0-8ce9-f84ffefdbd3b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:22.390968 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b584ec-d91c-4b7e-ab3d-f12e29dbafbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:22.391559 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b584ec-d91c-4b7e-ab3d-f12e29dbafbd admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:22.391851 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b584ec-d91c-4b7e-ab3d-f12e29dbafbd admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:22.392137 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b584ec-d91c-4b7e-ab3d-f12e29dbafbd admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:22.392876 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b584ec-d91c-4b7e-ab3d-f12e29dbafbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:22.393184 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b584ec-d91c-4b7e-ab3d-f12e29dbafbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:22.395415 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b584ec-d91c-4b7e-ab3d-f12e29dbafbd admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:22.407470 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 469/937] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:26:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:22.413082 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9ba0b-5c52-4e4d-9daf-0a3d3b9cc7d4 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:22.422298 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9ba0b-5c52-4e4d-9daf-0a3d3b9cc7d4 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:22.426587 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9d603-edbe-466e-a244-0d6a5cf42210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:22.427294 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9d603-edbe-466e-a244-0d6a5cf42210 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:22.427585 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9d603-edbe-466e-a244-0d6a5cf42210 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:22.427873 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9d603-edbe-466e-a244-0d6a5cf42210 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:22.441195 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9d603-edbe-466e-a244-0d6a5cf42210 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:22.443182 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9d603-edbe-466e-a244-0d6a5cf42210 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:22.460909 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-09f9d603-edbe-466e-a244-0d6a5cf42210 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 16 14:26:22.461960 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 469/938] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:26:22 2021] GET /identity/v3/users/swift => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:22.467562 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b584ec-d91c-4b7e-ab3d-f12e29dbafbd admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:22.476879 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b584ec-d91c-4b7e-ab3d-f12e29dbafbd admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:22.481018 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f445d-be3c-49d7-9b12-007d7049410c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:22.481603 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f445d-be3c-49d7-9b12-007d7049410c admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:22.481890 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f445d-be3c-49d7-9b12-007d7049410c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:22.482166 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f445d-be3c-49d7-9b12-007d7049410c admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:22.482943 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f445d-be3c-49d7-9b12-007d7049410c admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:22.483240 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f445d-be3c-49d7-9b12-007d7049410c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:22.485070 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f445d-be3c-49d7-9b12-007d7049410c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:22.514763 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 470/939] 10.222.0.64 () {56 vars in 1156 bytes} [Thu Dec 16 14:26:22 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:22.520367 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9d603-edbe-466e-a244-0d6a5cf42210 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:22.529527 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9d603-edbe-466e-a244-0d6a5cf42210 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:22.533728 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabed89-faeb-499f-b647-5d886a56185d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:22.534462 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabed89-faeb-499f-b647-5d886a56185d admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:22.534754 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabed89-faeb-499f-b647-5d886a56185d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:22.535036 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabed89-faeb-499f-b647-5d886a56185d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:22.546428 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabed89-faeb-499f-b647-5d886a56185d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:22.548229 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabed89-faeb-499f-b647-5d886a56185d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:22.565249 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-1cabed89-faeb-499f-b647-5d886a56185d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:26:22.566888 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 470/940] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:22.572659 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f445d-be3c-49d7-9b12-007d7049410c admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:22.582115 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f445d-be3c-49d7-9b12-007d7049410c admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:22.586330 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67aa6d-266f-40a2-8a76-cc3e886ad2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:22.586917 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67aa6d-266f-40a2-8a76-cc3e886ad2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:22.587234 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67aa6d-266f-40a2-8a76-cc3e886ad2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:22.587517 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67aa6d-266f-40a2-8a76-cc3e886ad2c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:22.588208 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67aa6d-266f-40a2-8a76-cc3e886ad2c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:22.588510 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67aa6d-266f-40a2-8a76-cc3e886ad2c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:22.590136 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67aa6d-266f-40a2-8a76-cc3e886ad2c2 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:22.602064 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 471/941] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:26:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:22.607395 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabed89-faeb-499f-b647-5d886a56185d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:22.617071 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabed89-faeb-499f-b647-5d886a56185d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:22.621252 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b37422-136c-437c-afcb-6af0fbbf40af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:22.621953 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b37422-136c-437c-afcb-6af0fbbf40af admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:22.622242 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b37422-136c-437c-afcb-6af0fbbf40af admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:22.622527 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b37422-136c-437c-afcb-6af0fbbf40af admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:22.631536 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b37422-136c-437c-afcb-6af0fbbf40af admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:22.633490 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b37422-136c-437c-afcb-6af0fbbf40af admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:22.646714 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-22b37422-136c-437c-afcb-6af0fbbf40af admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:26:22.647753 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 471/942] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:26:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:22.653479 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67aa6d-266f-40a2-8a76-cc3e886ad2c2 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:22.662699 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67aa6d-266f-40a2-8a76-cc3e886ad2c2 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:22.666924 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913656bb-6a3c-4104-a5c6-9d463803618d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:22.667505 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913656bb-6a3c-4104-a5c6-9d463803618d admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:22.667794 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913656bb-6a3c-4104-a5c6-9d463803618d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:22.668076 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913656bb-6a3c-4104-a5c6-9d463803618d admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:22.668848 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913656bb-6a3c-4104-a5c6-9d463803618d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:22.669155 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913656bb-6a3c-4104-a5c6-9d463803618d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:22.670965 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913656bb-6a3c-4104-a5c6-9d463803618d admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:22.683688 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 472/943] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:26:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:22.689719 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b37422-136c-437c-afcb-6af0fbbf40af admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:22.699546 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b37422-136c-437c-afcb-6af0fbbf40af admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:22.703692 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ede863-987e-4aa2-a99d-dc1b67bded20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:22.704494 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ede863-987e-4aa2-a99d-dc1b67bded20 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:22.704801 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ede863-987e-4aa2-a99d-dc1b67bded20 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:22.705085 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ede863-987e-4aa2-a99d-dc1b67bded20 admin admin] PATH_INFO: `/v3/projects/244c8ef98d0445c6a0279c46d5cb7e55/users/de4c90e44b96488aa47fbbc302e4f7cc/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:22.706897 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ede863-987e-4aa2-a99d-dc1b67bded20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=244c8ef98d0445c6a0279c46d5cb7e55, user_id=de4c90e44b96488aa47fbbc302e4f7cc, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:22.709521 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ede863-987e-4aa2-a99d-dc1b67bded20 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:22.723318 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 472/944] 10.222.0.64 () {58 vars in 1460 bytes} [Thu Dec 16 14:26:22 2021] PUT /identity/v3/projects/244c8ef98d0445c6a0279c46d5cb7e55/users/de4c90e44b96488aa47fbbc302e4f7cc/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:26:24.778275 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512cae1-1ad4-4fb1-ab6f-5df6a34aa94d None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:24.778827 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512cae1-1ad4-4fb1-ab6f-5df6a34aa94d None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:24.778827 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512cae1-1ad4-4fb1-ab6f-5df6a34aa94d None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:24.780496 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 473/945] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:26:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:24.786243 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe943a2-6331-46f2-86f7-8a6255a35088 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:24.786618 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe943a2-6331-46f2-86f7-8a6255a35088 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:24.786821 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe943a2-6331-46f2-86f7-8a6255a35088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:24.808499 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-7fe943a2-6331-46f2-86f7-8a6255a35088 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:24.809683 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-7fe943a2-6331-46f2-86f7-8a6255a35088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:24.872924 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 473/946] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:24 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:26:24.896803 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512cae1-1ad4-4fb1-ab6f-5df6a34aa94d None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:24.908527 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512cae1-1ad4-4fb1-ab6f-5df6a34aa94d None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:24.913353 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329c7d8-28c4-4479-844e-3240e5d7d1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:24.914060 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329c7d8-28c4-4479-844e-3240e5d7d1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:24.914352 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329c7d8-28c4-4479-844e-3240e5d7d1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:24.914637 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329c7d8-28c4-4479-844e-3240e5d7d1b5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:24.925520 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9329c7d8-28c4-4479-844e-3240e5d7d1b5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:26:24.931776 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-9329c7d8-28c4-4479-844e-3240e5d7d1b5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:26:24.932883 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 474/947] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:26:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:24.939268 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe943a2-6331-46f2-86f7-8a6255a35088 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:24.947855 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe943a2-6331-46f2-86f7-8a6255a35088 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:24.952202 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c75653-8838-40c6-99eb-45559b8ebe7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:24.952809 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c75653-8838-40c6-99eb-45559b8ebe7c admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:24.953114 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c75653-8838-40c6-99eb-45559b8ebe7c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:24.953394 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c75653-8838-40c6-99eb-45559b8ebe7c admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:24.954102 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c75653-8838-40c6-99eb-45559b8ebe7c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:24.954402 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c75653-8838-40c6-99eb-45559b8ebe7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:24.956493 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c75653-8838-40c6-99eb-45559b8ebe7c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:24.964917 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 474/948] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:26:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:24.970344 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329c7d8-28c4-4479-844e-3240e5d7d1b5 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:24.980648 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329c7d8-28c4-4479-844e-3240e5d7d1b5 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:24.984921 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71f74f-a024-455d-b9f6-8cb1c0e6f4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:24.985621 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71f74f-a024-455d-b9f6-8cb1c0e6f4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:24.985909 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71f74f-a024-455d-b9f6-8cb1c0e6f4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:24.986191 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71f74f-a024-455d-b9f6-8cb1c0e6f4d2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:24.997255 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71f74f-a024-455d-b9f6-8cb1c0e6f4d2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:24.999072 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71f74f-a024-455d-b9f6-8cb1c0e6f4d2 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:25.015758 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-4d71f74f-a024-455d-b9f6-8cb1c0e6f4d2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:26:25.016842 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 475/949] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:25.022977 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c75653-8838-40c6-99eb-45559b8ebe7c admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:25.032199 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c75653-8838-40c6-99eb-45559b8ebe7c admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:25.037088 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d470d8-8f37-4169-a53e-673f1c212b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:25.037669 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d470d8-8f37-4169-a53e-673f1c212b90 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:25.037963 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d470d8-8f37-4169-a53e-673f1c212b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:25.038245 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d470d8-8f37-4169-a53e-673f1c212b90 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:25.038937 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d470d8-8f37-4169-a53e-673f1c212b90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:25.039238 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d470d8-8f37-4169-a53e-673f1c212b90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:25.040810 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d470d8-8f37-4169-a53e-673f1c212b90 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:25.053203 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 475/950] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:26:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:25.058715 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71f74f-a024-455d-b9f6-8cb1c0e6f4d2 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:25.068215 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71f74f-a024-455d-b9f6-8cb1c0e6f4d2 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:25.072376 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62101b79-2076-44ea-b2bb-09b1a650ddf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:25.073109 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62101b79-2076-44ea-b2bb-09b1a650ddf5 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:25.073396 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62101b79-2076-44ea-b2bb-09b1a650ddf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:25.073675 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62101b79-2076-44ea-b2bb-09b1a650ddf5 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:25.086427 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62101b79-2076-44ea-b2bb-09b1a650ddf5 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:25.088420 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62101b79-2076-44ea-b2bb-09b1a650ddf5 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:25.105862 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-62101b79-2076-44ea-b2bb-09b1a650ddf5 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 16 14:26:25.106906 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 476/951] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:26:25 2021] GET /identity/v3/users/swift => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:25.112482 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d470d8-8f37-4169-a53e-673f1c212b90 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:25.121573 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d470d8-8f37-4169-a53e-673f1c212b90 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:25.125977 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9eb0d4-d1cc-49c8-acfe-da25b6e7646b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:25.126558 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9eb0d4-d1cc-49c8-acfe-da25b6e7646b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:25.126846 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9eb0d4-d1cc-49c8-acfe-da25b6e7646b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:25.127128 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9eb0d4-d1cc-49c8-acfe-da25b6e7646b admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:25.128460 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9eb0d4-d1cc-49c8-acfe-da25b6e7646b admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:25.128800 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9eb0d4-d1cc-49c8-acfe-da25b6e7646b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:25.130600 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9eb0d4-d1cc-49c8-acfe-da25b6e7646b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:25.158735 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 476/952] 10.222.0.64 () {56 vars in 1156 bytes} [Thu Dec 16 14:26:25 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:25.164322 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62101b79-2076-44ea-b2bb-09b1a650ddf5 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:25.173723 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62101b79-2076-44ea-b2bb-09b1a650ddf5 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:25.178002 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4b309-31d9-4a3b-8247-ff9bfc6912d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:25.178576 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4b309-31d9-4a3b-8247-ff9bfc6912d8 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:25.178866 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4b309-31d9-4a3b-8247-ff9bfc6912d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:25.179149 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4b309-31d9-4a3b-8247-ff9bfc6912d8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:25.187378 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4b309-31d9-4a3b-8247-ff9bfc6912d8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:25.189166 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4b309-31d9-4a3b-8247-ff9bfc6912d8 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:25.198722 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 477/953] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:26:25 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:26:25.204623 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9eb0d4-d1cc-49c8-acfe-da25b6e7646b admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:25.214707 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9eb0d4-d1cc-49c8-acfe-da25b6e7646b admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:25.219724 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e50319-8f85-4946-9ca5-d2a04fbbcb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:25.220463 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e50319-8f85-4946-9ca5-d2a04fbbcb42 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:25.220751 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e50319-8f85-4946-9ca5-d2a04fbbcb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:25.221067 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e50319-8f85-4946-9ca5-d2a04fbbcb42 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:25.233225 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e50319-8f85-4946-9ca5-d2a04fbbcb42 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:25.235056 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e50319-8f85-4946-9ca5-d2a04fbbcb42 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:25.252549 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-10e50319-8f85-4946-9ca5-d2a04fbbcb42 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:26:25.254218 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 477/954] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:25.259995 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4b309-31d9-4a3b-8247-ff9bfc6912d8 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:25.269529 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4b309-31d9-4a3b-8247-ff9bfc6912d8 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:25.273854 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fd0b4-05c7-4653-bf8e-1f817f8b8fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:25.274443 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fd0b4-05c7-4653-bf8e-1f817f8b8fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:25.274730 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fd0b4-05c7-4653-bf8e-1f817f8b8fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:25.275007 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fd0b4-05c7-4653-bf8e-1f817f8b8fd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:25.275694 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49fd0b4-05c7-4653-bf8e-1f817f8b8fd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:25.275991 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49fd0b4-05c7-4653-bf8e-1f817f8b8fd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:25.277622 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49fd0b4-05c7-4653-bf8e-1f817f8b8fd6 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:25.290193 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 478/955] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:26:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:25.295911 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e50319-8f85-4946-9ca5-d2a04fbbcb42 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:25.305666 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e50319-8f85-4946-9ca5-d2a04fbbcb42 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:25.310195 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce10e9-dfec-4736-8ffd-bcca4ef76edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:25.310917 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce10e9-dfec-4736-8ffd-bcca4ef76edc admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:25.311209 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce10e9-dfec-4736-8ffd-bcca4ef76edc admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:25.311492 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce10e9-dfec-4736-8ffd-bcca4ef76edc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:25.322275 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce10e9-dfec-4736-8ffd-bcca4ef76edc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:25.324236 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce10e9-dfec-4736-8ffd-bcca4ef76edc admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:25.338964 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-c9ce10e9-dfec-4736-8ffd-bcca4ef76edc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:26:25.340108 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 478/956] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:26:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:25.346179 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fd0b4-05c7-4653-bf8e-1f817f8b8fd6 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:25.356554 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fd0b4-05c7-4653-bf8e-1f817f8b8fd6 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:25.361027 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f4a0e-ab64-4601-81cd-c6da443b9c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:25.361636 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f4a0e-ab64-4601-81cd-c6da443b9c2f admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:25.361929 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f4a0e-ab64-4601-81cd-c6da443b9c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:25.362219 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f4a0e-ab64-4601-81cd-c6da443b9c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:25.362986 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f4a0e-ab64-4601-81cd-c6da443b9c2f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:25.363291 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f4a0e-ab64-4601-81cd-c6da443b9c2f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:25.365186 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f4a0e-ab64-4601-81cd-c6da443b9c2f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:25.379030 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 479/957] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:26:25 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:25.385891 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce10e9-dfec-4736-8ffd-bcca4ef76edc admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:25.396832 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce10e9-dfec-4736-8ffd-bcca4ef76edc admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:25.401402 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723f773-4dda-4adb-b90d-38f3f6d71291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:25.401995 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723f773-4dda-4adb-b90d-38f3f6d71291 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:25.402287 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723f773-4dda-4adb-b90d-38f3f6d71291 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:25.402571 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723f773-4dda-4adb-b90d-38f3f6d71291 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:25.403351 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723f773-4dda-4adb-b90d-38f3f6d71291 admin admin] RBAC: Adding query filter params (role.id=90166eb3dcfa41e58450e140b8b0fea3, scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55, user.id=de4c90e44b96488aa47fbbc302e4f7cc) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:25.403658 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723f773-4dda-4adb-b90d-38f3f6d71291 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:25.405545 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723f773-4dda-4adb-b90d-38f3f6d71291 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:25.411846 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 479/958] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:26:25 2021] GET /identity/v3/role_assignments?user.id=de4c90e44b96488aa47fbbc302e4f7cc&scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55&role.id=90166eb3dcfa41e58450e140b8b0fea3 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:26:27.503656 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71db78-a06b-447b-bd0f-6c833d5a7d01 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:27.504176 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71db78-a06b-447b-bd0f-6c833d5a7d01 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:27.504368 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71db78-a06b-447b-bd0f-6c833d5a7d01 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:27.505927 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 480/959] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:26:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:27.511325 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5c668-3ebc-4e19-9ede-f4330aec71bf None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:27.511742 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5c668-3ebc-4e19-9ede-f4330aec71bf None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:27.511903 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5c668-3ebc-4e19-9ede-f4330aec71bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:27.536423 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-0ce5c668-3ebc-4e19-9ede-f4330aec71bf None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:27.537602 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-0ce5c668-3ebc-4e19-9ede-f4330aec71bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:27.544612 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 480/960] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:27 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:26:27.567589 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71db78-a06b-447b-bd0f-6c833d5a7d01 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:27.579434 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71db78-a06b-447b-bd0f-6c833d5a7d01 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:27.583480 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad7ba0-7d57-44f0-9438-ecbc861f54f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:27.584284 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad7ba0-7d57-44f0-9438-ecbc861f54f3 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:27.584478 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad7ba0-7d57-44f0-9438-ecbc861f54f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:27.584758 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad7ba0-7d57-44f0-9438-ecbc861f54f3 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:27.585403 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad7ba0-7d57-44f0-9438-ecbc861f54f3 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:27.586964 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad7ba0-7d57-44f0-9438-ecbc861f54f3 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:27.597662 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-faad7ba0-7d57-44f0-9438-ecbc861f54f3 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 16 14:26:27.598703 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 481/961] 10.222.0.64 () {56 vars in 1147 bytes} [Thu Dec 16 14:26:27 2021] GET /identity/v3/services/object-store => generated 93 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:27.604593 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5c668-3ebc-4e19-9ede-f4330aec71bf None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:27.613840 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5c668-3ebc-4e19-9ede-f4330aec71bf None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:27.618185 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed35a0a-0436-4fea-96a5-5814c103e569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:27.618772 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed35a0a-0436-4fea-96a5-5814c103e569 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:27.619061 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed35a0a-0436-4fea-96a5-5814c103e569 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:27.619343 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed35a0a-0436-4fea-96a5-5814c103e569 admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:27.620014 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed35a0a-0436-4fea-96a5-5814c103e569 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:27.620316 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed35a0a-0436-4fea-96a5-5814c103e569 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:27.621910 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed35a0a-0436-4fea-96a5-5814c103e569 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:27.626589 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 481/962] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Dec 16 14:26:27 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:27.631971 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad7ba0-7d57-44f0-9438-ecbc861f54f3 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:27.641087 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad7ba0-7d57-44f0-9438-ecbc861f54f3 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:27.645252 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5fe286-fb3f-4731-b9fa-bb59726848e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:27.645827 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fe286-fb3f-4731-b9fa-bb59726848e0 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:27.646147 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fe286-fb3f-4731-b9fa-bb59726848e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:27.646433 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fe286-fb3f-4731-b9fa-bb59726848e0 admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:27.647096 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5fe286-fb3f-4731-b9fa-bb59726848e0 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:27.647418 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5fe286-fb3f-4731-b9fa-bb59726848e0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:27.649007 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5fe286-fb3f-4731-b9fa-bb59726848e0 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:27.653161 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 482/963] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Dec 16 14:26:27 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:29.742307 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9ca96-5504-4c72-81d4-ac168f283335 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:29.742842 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9ca96-5504-4c72-81d4-ac168f283335 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:29.742842 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9ca96-5504-4c72-81d4-ac168f283335 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:29.744549 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 482/964] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:26:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:29.750088 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cee0d-64f3-4b57-9aae-f103a86a8825 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:29.750572 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cee0d-64f3-4b57-9aae-f103a86a8825 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:29.750665 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cee0d-64f3-4b57-9aae-f103a86a8825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:29.773975 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-6d8cee0d-64f3-4b57-9aae-f103a86a8825 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:29.775152 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-6d8cee0d-64f3-4b57-9aae-f103a86a8825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:29.782168 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 483/965] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:29 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:26:29.806608 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9ca96-5504-4c72-81d4-ac168f283335 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:29.818657 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9ca96-5504-4c72-81d4-ac168f283335 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:29.822783 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9331ce-e2b6-4f14-87e9-030a9db837d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:29.823368 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9331ce-e2b6-4f14-87e9-030a9db837d8 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:29.823658 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9331ce-e2b6-4f14-87e9-030a9db837d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:29.823945 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9331ce-e2b6-4f14-87e9-030a9db837d8 admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:29.824617 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9331ce-e2b6-4f14-87e9-030a9db837d8 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:29.826214 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9331ce-e2b6-4f14-87e9-030a9db837d8 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:29.840015 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 483/966] 10.222.0.64 () {60 vars in 1162 bytes} [Thu Dec 16 14:26:29 2021] POST /identity/v3/services => generated 241 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:26:31.943780 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf2115-0ac5-4e3a-9f70-cceaa2b30e5e None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:31.944295 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf2115-0ac5-4e3a-9f70-cceaa2b30e5e None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:31.944381 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf2115-0ac5-4e3a-9f70-cceaa2b30e5e None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:31.946047 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 484/967] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:26:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:31.951289 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020fac7-2666-4fc0-b09c-ca8ac45aa0c3 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:31.951717 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020fac7-2666-4fc0-b09c-ca8ac45aa0c3 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:31.951857 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020fac7-2666-4fc0-b09c-ca8ac45aa0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:31.973675 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-6020fac7-2666-4fc0-b09c-ca8ac45aa0c3 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:31.974817 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-6020fac7-2666-4fc0-b09c-ca8ac45aa0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:31.992248 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 484/968] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:31 2021] POST /identity/v3/auth/tokens => generated 3075 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:26:32.015226 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf2115-0ac5-4e3a-9f70-cceaa2b30e5e None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:32.027723 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf2115-0ac5-4e3a-9f70-cceaa2b30e5e None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:32.031776 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56539546-6e4e-4af6-9f5a-2fd46b43c0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:32.032502 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56539546-6e4e-4af6-9f5a-2fd46b43c0ed admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:32.032803 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56539546-6e4e-4af6-9f5a-2fd46b43c0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:32.033127 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56539546-6e4e-4af6-9f5a-2fd46b43c0ed admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:32.034366 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56539546-6e4e-4af6-9f5a-2fd46b43c0ed admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:32.035942 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56539546-6e4e-4af6-9f5a-2fd46b43c0ed admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:32.046332 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-56539546-6e4e-4af6-9f5a-2fd46b43c0ed admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 16 14:26:32.047371 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 485/969] 10.222.0.64 () {56 vars in 1147 bytes} [Thu Dec 16 14:26:32 2021] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:32.053282 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020fac7-2666-4fc0-b09c-ca8ac45aa0c3 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:32.062016 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020fac7-2666-4fc0-b09c-ca8ac45aa0c3 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:32.067062 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f833d5-7c8c-449e-a6cc-753baa70fd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:32.067649 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f833d5-7c8c-449e-a6cc-753baa70fd1a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:32.067936 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f833d5-7c8c-449e-a6cc-753baa70fd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:32.068217 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f833d5-7c8c-449e-a6cc-753baa70fd1a admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:32.068935 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f833d5-7c8c-449e-a6cc-753baa70fd1a admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:32.069239 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f833d5-7c8c-449e-a6cc-753baa70fd1a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:32.070811 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f833d5-7c8c-449e-a6cc-753baa70fd1a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:32.075607 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 485/970] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Dec 16 14:26:32 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:26:32.081623 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56539546-6e4e-4af6-9f5a-2fd46b43c0ed admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:32.090757 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56539546-6e4e-4af6-9f5a-2fd46b43c0ed admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:32.094970 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f3054-d8a7-4a98-aa65-6ab477e83510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:32.095546 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f3054-d8a7-4a98-aa65-6ab477e83510 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:32.095837 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f3054-d8a7-4a98-aa65-6ab477e83510 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:32.096759 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f3054-d8a7-4a98-aa65-6ab477e83510 admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:32.097456 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f3054-d8a7-4a98-aa65-6ab477e83510 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:32.097760 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f3054-d8a7-4a98-aa65-6ab477e83510 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:32.099311 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f3054-d8a7-4a98-aa65-6ab477e83510 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:32.103811 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 486/971] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Dec 16 14:26:32 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:32.109364 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f833d5-7c8c-449e-a6cc-753baa70fd1a admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:32.118178 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f833d5-7c8c-449e-a6cc-753baa70fd1a admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:32.122416 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a460955-303a-412f-b726-7299401f6942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:32.122971 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a460955-303a-412f-b726-7299401f6942 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:32.123256 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a460955-303a-412f-b726-7299401f6942 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:32.123535 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a460955-303a-412f-b726-7299401f6942 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:32.124259 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a460955-303a-412f-b726-7299401f6942 admin admin] RBAC: Adding query filter params (interface=public, service_id=6af8e90c3bf84d50afb1820c5afdad2f, region_id=RegionOne) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:32.124558 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a460955-303a-412f-b726-7299401f6942 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:32.126116 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a460955-303a-412f-b726-7299401f6942 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:32.131235 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 486/972] 10.222.0.64 () {56 vars in 1272 bytes} [Thu Dec 16 14:26:32 2021] GET /identity/v3/endpoints?service_id=6af8e90c3bf84d50afb1820c5afdad2f&interface=public®ion_id=RegionOne => generated 194 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:32.136504 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f3054-d8a7-4a98-aa65-6ab477e83510 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:32.146158 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f3054-d8a7-4a98-aa65-6ab477e83510 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:32.150693 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863d39c-3b99-4af7-a12c-f1503c936ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:32.151001 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863d39c-3b99-4af7-a12c-f1503c936ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:32.151297 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863d39c-3b99-4af7-a12c-f1503c936ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:32.151585 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863d39c-3b99-4af7-a12c-f1503c936ce2 admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:32.152235 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863d39c-3b99-4af7-a12c-f1503c936ce2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:32.153838 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863d39c-3b99-4af7-a12c-f1503c936ce2 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:32.161186 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 487/973] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Dec 16 14:26:32 2021] GET /identity/v3/services => generated 2196 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:26:34.219011 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48b7e1-48d4-4ab7-9edc-f3661b962c36 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:34.219536 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48b7e1-48d4-4ab7-9edc-f3661b962c36 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:34.219657 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48b7e1-48d4-4ab7-9edc-f3661b962c36 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:34.221873 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 487/974] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:26:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:34.227125 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a4f7e-13f4-4b84-9e18-c9c4a99e6c0d None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:34.227522 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a4f7e-13f4-4b84-9e18-c9c4a99e6c0d None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:34.227698 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a4f7e-13f4-4b84-9e18-c9c4a99e6c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:34.249501 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-545a4f7e-13f4-4b84-9e18-c9c4a99e6c0d None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:34.250659 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-545a4f7e-13f4-4b84-9e18-c9c4a99e6c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:34.257786 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 488/975] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:34 2021] POST /identity/v3/auth/tokens => generated 3075 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:26:34.280699 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48b7e1-48d4-4ab7-9edc-f3661b962c36 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:34.293273 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48b7e1-48d4-4ab7-9edc-f3661b962c36 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:34.297295 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc805609-3030-43ee-a936-88d5552ebd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:34.298011 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc805609-3030-43ee-a936-88d5552ebd9a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:34.298300 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc805609-3030-43ee-a936-88d5552ebd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:34.298584 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc805609-3030-43ee-a936-88d5552ebd9a admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:34.299203 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc805609-3030-43ee-a936-88d5552ebd9a admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:34.300759 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc805609-3030-43ee-a936-88d5552ebd9a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:34.311044 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-fc805609-3030-43ee-a936-88d5552ebd9a admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 16 14:26:34.312338 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 488/976] 10.222.0.64 () {56 vars in 1147 bytes} [Thu Dec 16 14:26:34 2021] GET /identity/v3/services/object-store => generated 93 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:34.318140 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a4f7e-13f4-4b84-9e18-c9c4a99e6c0d None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:34.326719 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a4f7e-13f4-4b84-9e18-c9c4a99e6c0d None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:34.331430 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849461cb-8cc3-4693-b8ac-e075a4765e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:34.332015 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849461cb-8cc3-4693-b8ac-e075a4765e1e admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:34.332305 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849461cb-8cc3-4693-b8ac-e075a4765e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:34.332590 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849461cb-8cc3-4693-b8ac-e075a4765e1e admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:34.333304 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849461cb-8cc3-4693-b8ac-e075a4765e1e admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:34.333609 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849461cb-8cc3-4693-b8ac-e075a4765e1e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:34.335228 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849461cb-8cc3-4693-b8ac-e075a4765e1e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:34.339952 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 489/977] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Dec 16 14:26:34 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:34.345313 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc805609-3030-43ee-a936-88d5552ebd9a admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:34.355100 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc805609-3030-43ee-a936-88d5552ebd9a admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:34.359271 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbf901-d414-4ee1-8c7b-333d763de79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:34.359957 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbf901-d414-4ee1-8c7b-333d763de79a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:34.360243 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbf901-d414-4ee1-8c7b-333d763de79a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:34.360523 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbf901-d414-4ee1-8c7b-333d763de79a admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:34.361222 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbf901-d414-4ee1-8c7b-333d763de79a admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:34.361533 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbf901-d414-4ee1-8c7b-333d763de79a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:34.363052 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbf901-d414-4ee1-8c7b-333d763de79a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:34.367598 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 489/978] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Dec 16 14:26:34 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:34.372977 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849461cb-8cc3-4693-b8ac-e075a4765e1e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:34.382471 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849461cb-8cc3-4693-b8ac-e075a4765e1e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:34.386681 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c0f9d-4fe0-4400-8acd-0f31d119813b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:34.387248 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c0f9d-4fe0-4400-8acd-0f31d119813b admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:34.387538 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c0f9d-4fe0-4400-8acd-0f31d119813b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:34.387821 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c0f9d-4fe0-4400-8acd-0f31d119813b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:34.388503 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c0f9d-4fe0-4400-8acd-0f31d119813b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:34.390100 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c0f9d-4fe0-4400-8acd-0f31d119813b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:34.409463 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 490/979] 10.222.0.64 () {60 vars in 1165 bytes} [Thu Dec 16 14:26:34 2021] POST /identity/v3/endpoints => generated 349 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:26:36.454301 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ca990-ba2b-4ade-8ca7-5dfbf33f2970 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:36.454932 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ca990-ba2b-4ade-8ca7-5dfbf33f2970 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:36.454932 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ca990-ba2b-4ade-8ca7-5dfbf33f2970 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:36.457038 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 490/980] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:26:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:36.462162 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcee24c-5e33-4347-b99d-871dde6e2094 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:36.462603 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcee24c-5e33-4347-b99d-871dde6e2094 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:36.462826 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcee24c-5e33-4347-b99d-871dde6e2094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:36.485119 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-bbcee24c-5e33-4347-b99d-871dde6e2094 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:36.486257 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-bbcee24c-5e33-4347-b99d-871dde6e2094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:36.503198 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 491/981] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:36 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:26:36.525588 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ca990-ba2b-4ade-8ca7-5dfbf33f2970 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:36.537915 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ca990-ba2b-4ade-8ca7-5dfbf33f2970 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:36.541979 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368aa0d-39ba-44bc-b34d-ca8fe7fc7240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:36.542682 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368aa0d-39ba-44bc-b34d-ca8fe7fc7240 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:36.542966 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368aa0d-39ba-44bc-b34d-ca8fe7fc7240 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:36.543242 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368aa0d-39ba-44bc-b34d-ca8fe7fc7240 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:36.543847 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368aa0d-39ba-44bc-b34d-ca8fe7fc7240 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:36.545430 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368aa0d-39ba-44bc-b34d-ca8fe7fc7240 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:36.555841 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-9368aa0d-39ba-44bc-b34d-ca8fe7fc7240 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 16 14:26:36.556924 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 491/982] 10.222.0.64 () {56 vars in 1147 bytes} [Thu Dec 16 14:26:36 2021] GET /identity/v3/services/object-store => generated 93 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:36.562985 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcee24c-5e33-4347-b99d-871dde6e2094 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:36.571591 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcee24c-5e33-4347-b99d-871dde6e2094 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:36.575826 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28f6d3-a8b2-45af-ac8e-fe7dbbe8bc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:36.576416 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28f6d3-a8b2-45af-ac8e-fe7dbbe8bc6c admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:36.576704 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28f6d3-a8b2-45af-ac8e-fe7dbbe8bc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:36.577020 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28f6d3-a8b2-45af-ac8e-fe7dbbe8bc6c admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:36.577690 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28f6d3-a8b2-45af-ac8e-fe7dbbe8bc6c admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:36.577990 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28f6d3-a8b2-45af-ac8e-fe7dbbe8bc6c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:36.579554 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28f6d3-a8b2-45af-ac8e-fe7dbbe8bc6c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:36.584743 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 492/983] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Dec 16 14:26:36 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:36.590126 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368aa0d-39ba-44bc-b34d-ca8fe7fc7240 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:36.600285 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368aa0d-39ba-44bc-b34d-ca8fe7fc7240 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:36.604547 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0306080-d19e-4426-ac17-798f1f62706c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:36.605149 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0306080-d19e-4426-ac17-798f1f62706c admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:36.605441 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0306080-d19e-4426-ac17-798f1f62706c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:36.605725 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0306080-d19e-4426-ac17-798f1f62706c admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:36.606388 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0306080-d19e-4426-ac17-798f1f62706c admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:36.606698 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0306080-d19e-4426-ac17-798f1f62706c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:36.608250 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0306080-d19e-4426-ac17-798f1f62706c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:36.612929 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 492/984] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Dec 16 14:26:36 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:36.618459 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28f6d3-a8b2-45af-ac8e-fe7dbbe8bc6c admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:36.627536 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28f6d3-a8b2-45af-ac8e-fe7dbbe8bc6c admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:36.631749 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d8da6-5971-4cd4-b713-5e17f346ae19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:36.632323 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d8da6-5971-4cd4-b713-5e17f346ae19 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:36.632611 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d8da6-5971-4cd4-b713-5e17f346ae19 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:36.632919 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d8da6-5971-4cd4-b713-5e17f346ae19 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:36.633661 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d8da6-5971-4cd4-b713-5e17f346ae19 admin admin] RBAC: Adding query filter params (interface=admin, service_id=6af8e90c3bf84d50afb1820c5afdad2f, region_id=RegionOne) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:36.633970 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d8da6-5971-4cd4-b713-5e17f346ae19 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:36.635532 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d8da6-5971-4cd4-b713-5e17f346ae19 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:36.640612 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 493/985] 10.222.0.64 () {56 vars in 1270 bytes} [Thu Dec 16 14:26:36 2021] GET /identity/v3/endpoints?service_id=6af8e90c3bf84d50afb1820c5afdad2f&interface=admin®ion_id=RegionOne => generated 193 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:36.646609 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0306080-d19e-4426-ac17-798f1f62706c admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:36.655653 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0306080-d19e-4426-ac17-798f1f62706c admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:36.660525 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c0ea2-9fc2-4443-8635-96e4b5cae118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:36.661137 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c0ea2-9fc2-4443-8635-96e4b5cae118 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:36.661432 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c0ea2-9fc2-4443-8635-96e4b5cae118 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:36.661720 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c0ea2-9fc2-4443-8635-96e4b5cae118 admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:36.662369 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c0ea2-9fc2-4443-8635-96e4b5cae118 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:36.663917 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c0ea2-9fc2-4443-8635-96e4b5cae118 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:36.670535 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 493/986] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Dec 16 14:26:36 2021] GET /identity/v3/services => generated 2196 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:26:38.720331 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b7f9a-1480-4361-94a7-e9529b799ce2 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:38.721465 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b7f9a-1480-4361-94a7-e9529b799ce2 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:38.721565 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b7f9a-1480-4361-94a7-e9529b799ce2 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:38.723253 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 494/987] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:26:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:38.728649 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfda2cc-d5c0-45fd-b756-8458927e419e None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:38.729077 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfda2cc-d5c0-45fd-b756-8458927e419e None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:38.729266 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfda2cc-d5c0-45fd-b756-8458927e419e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:38.750749 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-ecfda2cc-d5c0-45fd-b756-8458927e419e None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:38.751879 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-ecfda2cc-d5c0-45fd-b756-8458927e419e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:38.758823 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 494/988] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:38 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:26:38.781559 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b7f9a-1480-4361-94a7-e9529b799ce2 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:38.793884 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b7f9a-1480-4361-94a7-e9529b799ce2 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:38.797976 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b30a7fc-01cf-4098-b659-a8824bbd99e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:38.798690 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30a7fc-01cf-4098-b659-a8824bbd99e7 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:38.798980 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30a7fc-01cf-4098-b659-a8824bbd99e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:38.799264 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30a7fc-01cf-4098-b659-a8824bbd99e7 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:38.799900 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b30a7fc-01cf-4098-b659-a8824bbd99e7 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:38.801509 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b30a7fc-01cf-4098-b659-a8824bbd99e7 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:38.812006 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-2b30a7fc-01cf-4098-b659-a8824bbd99e7 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 16 14:26:38.813082 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 495/989] 10.222.0.64 () {56 vars in 1147 bytes} [Thu Dec 16 14:26:38 2021] GET /identity/v3/services/object-store => generated 93 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:38.818881 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfda2cc-d5c0-45fd-b756-8458927e419e None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:38.827347 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfda2cc-d5c0-45fd-b756-8458927e419e None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:38.832061 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c24ac-ff57-45ba-9422-73846738f8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:38.832641 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c24ac-ff57-45ba-9422-73846738f8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:38.832960 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c24ac-ff57-45ba-9422-73846738f8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:38.833248 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c24ac-ff57-45ba-9422-73846738f8e4 admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:38.833916 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c24ac-ff57-45ba-9422-73846738f8e4 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:38.834217 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c24ac-ff57-45ba-9422-73846738f8e4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:38.835768 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c24ac-ff57-45ba-9422-73846738f8e4 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:38.840627 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 495/990] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Dec 16 14:26:38 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:38.846557 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b30a7fc-01cf-4098-b659-a8824bbd99e7 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:38.855820 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b30a7fc-01cf-4098-b659-a8824bbd99e7 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:38.860053 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb62e0-2dcd-4d1a-a2d0-55097a95231e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:38.860634 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb62e0-2dcd-4d1a-a2d0-55097a95231e admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:38.860967 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb62e0-2dcd-4d1a-a2d0-55097a95231e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:38.861660 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb62e0-2dcd-4d1a-a2d0-55097a95231e admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:38.862322 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb62e0-2dcd-4d1a-a2d0-55097a95231e admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:38.862627 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb62e0-2dcd-4d1a-a2d0-55097a95231e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:38.864244 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb62e0-2dcd-4d1a-a2d0-55097a95231e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:38.868944 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 496/991] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Dec 16 14:26:38 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:38.874454 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c24ac-ff57-45ba-9422-73846738f8e4 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:38.883627 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c24ac-ff57-45ba-9422-73846738f8e4 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:38.887970 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f624f-6734-47d6-9e29-d1710b5e9eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:38.888543 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f624f-6734-47d6-9e29-d1710b5e9eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:38.888871 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f624f-6734-47d6-9e29-d1710b5e9eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:38.889160 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f624f-6734-47d6-9e29-d1710b5e9eb5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:38.889855 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f624f-6734-47d6-9e29-d1710b5e9eb5 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:38.891401 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f624f-6734-47d6-9e29-d1710b5e9eb5 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:38.906633 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 496/992] 10.222.0.64 () {60 vars in 1165 bytes} [Thu Dec 16 14:26:38 2021] POST /identity/v3/endpoints => generated 325 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:26:40.987413 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5beea-1f6d-4de2-afbb-8a6b91403dfa None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:40.987955 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5beea-1f6d-4de2-afbb-8a6b91403dfa None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:40.987955 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5beea-1f6d-4de2-afbb-8a6b91403dfa None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:40.989684 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 497/993] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:26:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:40.994841 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8078a74-ecf1-45a0-b106-42c892b488e8 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:40.995229 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8078a74-ecf1-45a0-b106-42c892b488e8 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:40.995402 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8078a74-ecf1-45a0-b106-42c892b488e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:41.017287 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-f8078a74-ecf1-45a0-b106-42c892b488e8 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:41.018598 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-f8078a74-ecf1-45a0-b106-42c892b488e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:41.035298 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 497/994] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:40 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:26:41.058204 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5beea-1f6d-4de2-afbb-8a6b91403dfa None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:41.070898 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5beea-1f6d-4de2-afbb-8a6b91403dfa None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:41.075008 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c93b35-4963-404f-9159-48a55d5e4b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:41.075712 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c93b35-4963-404f-9159-48a55d5e4b7b admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:41.076004 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c93b35-4963-404f-9159-48a55d5e4b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:41.076290 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c93b35-4963-404f-9159-48a55d5e4b7b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:41.077474 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c93b35-4963-404f-9159-48a55d5e4b7b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:41.079163 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c93b35-4963-404f-9159-48a55d5e4b7b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:41.080638 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 498/995] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:41 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:41.086240 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8078a74-ecf1-45a0-b106-42c892b488e8 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:41.094686 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8078a74-ecf1-45a0-b106-42c892b488e8 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:41.098886 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81a875-da93-4e10-a967-4d986255af4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:41.099452 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81a875-da93-4e10-a967-4d986255af4f admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:41.099738 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81a875-da93-4e10-a967-4d986255af4f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:41.100324 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81a875-da93-4e10-a967-4d986255af4f admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:41.101000 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81a875-da93-4e10-a967-4d986255af4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:41.102843 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81a875-da93-4e10-a967-4d986255af4f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:41.129229 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 498/996] 10.222.0.64 () {60 vars in 1162 bytes} [Thu Dec 16 14:26:41 2021] POST /identity/v3/projects => generated 311 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:26:43.247414 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5410e2-9bfe-4913-a1f9-b85f83aaff96 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:43.247985 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5410e2-9bfe-4913-a1f9-b85f83aaff96 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:43.247985 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5410e2-9bfe-4913-a1f9-b85f83aaff96 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:43.249703 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 499/997] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:26:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:43.255668 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2721965-be2c-4ce4-a4da-5c05f0975b7b None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:43.256097 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2721965-be2c-4ce4-a4da-5c05f0975b7b None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:43.256253 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2721965-be2c-4ce4-a4da-5c05f0975b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:43.278006 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-e2721965-be2c-4ce4-a4da-5c05f0975b7b None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:43.279146 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e2721965-be2c-4ce4-a4da-5c05f0975b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:43.341554 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 499/998] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:43 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:26:43.365790 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5410e2-9bfe-4913-a1f9-b85f83aaff96 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:43.378165 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5410e2-9bfe-4913-a1f9-b85f83aaff96 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:43.383697 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083767af-b3cb-4cdd-803e-5b52078d50bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:43.384405 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083767af-b3cb-4cdd-803e-5b52078d50bf admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:43.384694 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083767af-b3cb-4cdd-803e-5b52078d50bf admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:43.385009 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083767af-b3cb-4cdd-803e-5b52078d50bf admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:43.386115 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083767af-b3cb-4cdd-803e-5b52078d50bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:43.387789 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083767af-b3cb-4cdd-803e-5b52078d50bf admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:43.389289 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 500/999] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:43 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:26:43.394817 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2721965-be2c-4ce4-a4da-5c05f0975b7b None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:43.403399 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2721965-be2c-4ce4-a4da-5c05f0975b7b None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:43.407682 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc91d0e-f007-428f-a51d-77820e14d84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:43.408298 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc91d0e-f007-428f-a51d-77820e14d84c admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:43.408595 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc91d0e-f007-428f-a51d-77820e14d84c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:43.408911 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc91d0e-f007-428f-a51d-77820e14d84c admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:43.409574 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc91d0e-f007-428f-a51d-77820e14d84c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:43.411450 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc91d0e-f007-428f-a51d-77820e14d84c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:43.431578 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 500/1000] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Dec 16 14:26:43 2021] POST /identity/v3/users => generated 285 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:26:45.546023 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522e333-b430-4233-ae6e-7e6a5542c799 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:45.546556 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522e333-b430-4233-ae6e-7e6a5542c799 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:45.546671 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522e333-b430-4233-ae6e-7e6a5542c799 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:45.548256 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 501/1001] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:26:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:45.554110 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf03d3-4797-4677-ad05-c04018608c5b None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:45.554526 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf03d3-4797-4677-ad05-c04018608c5b None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:45.554678 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf03d3-4797-4677-ad05-c04018608c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:45.577080 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-32bf03d3-4797-4677-ad05-c04018608c5b None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:45.578219 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-32bf03d3-4797-4677-ad05-c04018608c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:45.585835 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 501/1002] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:45 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:26:45.609107 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522e333-b430-4233-ae6e-7e6a5542c799 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:45.620725 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522e333-b430-4233-ae6e-7e6a5542c799 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:45.624795 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10af03-e57e-4854-a34c-87ed1a989e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:45.625506 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10af03-e57e-4854-a34c-87ed1a989e8a admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:45.625793 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10af03-e57e-4854-a34c-87ed1a989e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:45.626105 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10af03-e57e-4854-a34c-87ed1a989e8a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:45.638493 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10af03-e57e-4854-a34c-87ed1a989e8a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:26:45.645181 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-8c10af03-e57e-4854-a34c-87ed1a989e8a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:26:45.646254 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 502/1003] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:26:45 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:45.652050 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf03d3-4797-4677-ad05-c04018608c5b None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:45.661306 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf03d3-4797-4677-ad05-c04018608c5b None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:45.665709 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8192bf-af37-4862-bbae-50787c7b60b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:45.666296 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8192bf-af37-4862-bbae-50787c7b60b4 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:45.666587 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8192bf-af37-4862-bbae-50787c7b60b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:45.666870 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8192bf-af37-4862-bbae-50787c7b60b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:45.667577 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8192bf-af37-4862-bbae-50787c7b60b4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:45.667878 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8192bf-af37-4862-bbae-50787c7b60b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:45.669500 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8192bf-af37-4862-bbae-50787c7b60b4 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:45.677879 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 502/1004] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:26:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:45.683533 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10af03-e57e-4854-a34c-87ed1a989e8a admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:45.692958 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10af03-e57e-4854-a34c-87ed1a989e8a admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:45.697140 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610b963-c08a-4f26-8c37-5970da8449aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:45.697914 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610b963-c08a-4f26-8c37-5970da8449aa admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:45.698203 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610b963-c08a-4f26-8c37-5970da8449aa admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:45.698487 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610b963-c08a-4f26-8c37-5970da8449aa admin admin] PATH_INFO: `/v3/users/b10f6a57c78940768b18d0349fee6de2` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:45.716775 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610b963-c08a-4f26-8c37-5970da8449aa admin admin] RBAC: Authorizing `identity:get_user(user_id=b10f6a57c78940768b18d0349fee6de2)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:45.719310 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610b963-c08a-4f26-8c37-5970da8449aa admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:45.721467 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 503/1005] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:26:45 2021] GET /identity/v3/users/b10f6a57c78940768b18d0349fee6de2 => generated 285 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:45.727092 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8192bf-af37-4862-bbae-50787c7b60b4 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:45.736409 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8192bf-af37-4862-bbae-50787c7b60b4 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:45.740675 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ddb1a-af0c-4209-9bd2-bc6521eee2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:45.741277 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ddb1a-af0c-4209-9bd2-bc6521eee2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:45.741570 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ddb1a-af0c-4209-9bd2-bc6521eee2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:45.741858 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ddb1a-af0c-4209-9bd2-bc6521eee2d1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:45.749446 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ddb1a-af0c-4209-9bd2-bc6521eee2d1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:45.751162 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ddb1a-af0c-4209-9bd2-bc6521eee2d1 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:45.759492 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 503/1006] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:26:45 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:26:45.765213 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610b963-c08a-4f26-8c37-5970da8449aa admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:45.774879 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610b963-c08a-4f26-8c37-5970da8449aa admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:45.779117 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7ccef-33ee-4447-93d2-9ef341c8fa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:45.779883 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7ccef-33ee-4447-93d2-9ef341c8fa77 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:45.780173 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7ccef-33ee-4447-93d2-9ef341c8fa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:45.780459 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7ccef-33ee-4447-93d2-9ef341c8fa77 admin admin] PATH_INFO: `/v3/projects/7a7037aca4f5455ebc03d2d45a2cbae8` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:45.781572 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7ccef-33ee-4447-93d2-9ef341c8fa77 admin admin] RBAC: Authorizing `identity:get_project(project_id=7a7037aca4f5455ebc03d2d45a2cbae8)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:45.784226 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7ccef-33ee-4447-93d2-9ef341c8fa77 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:45.785764 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 504/1007] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:26:45 2021] GET /identity/v3/projects/7a7037aca4f5455ebc03d2d45a2cbae8 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:45.791640 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ddb1a-af0c-4209-9bd2-bc6521eee2d1 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:45.800121 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ddb1a-af0c-4209-9bd2-bc6521eee2d1 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:45.804337 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc242c-6455-432f-b9f7-0b537f6f2b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:45.804934 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc242c-6455-432f-b9f7-0b537f6f2b3a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:45.805229 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc242c-6455-432f-b9f7-0b537f6f2b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:45.805514 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc242c-6455-432f-b9f7-0b537f6f2b3a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:45.806281 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc242c-6455-432f-b9f7-0b537f6f2b3a admin admin] RBAC: Adding query filter params (role.id=90166eb3dcfa41e58450e140b8b0fea3, scope.project.id=7a7037aca4f5455ebc03d2d45a2cbae8, user.id=b10f6a57c78940768b18d0349fee6de2) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:45.806585 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc242c-6455-432f-b9f7-0b537f6f2b3a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:45.808361 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc242c-6455-432f-b9f7-0b537f6f2b3a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:45.813831 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 504/1008] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:26:45 2021] GET /identity/v3/role_assignments?user.id=b10f6a57c78940768b18d0349fee6de2&scope.project.id=7a7037aca4f5455ebc03d2d45a2cbae8&role.id=90166eb3dcfa41e58450e140b8b0fea3 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:47.853998 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46722ba-cc08-4f6e-8a31-aeb079805864 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:47.853998 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46722ba-cc08-4f6e-8a31-aeb079805864 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:47.853998 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46722ba-cc08-4f6e-8a31-aeb079805864 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:47.855566 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 505/1009] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:26:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:47.861301 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18816e-df94-4cae-9571-0b3ab565505a None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:47.861699 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18816e-df94-4cae-9571-0b3ab565505a None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:47.861882 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18816e-df94-4cae-9571-0b3ab565505a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:47.883891 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-cd18816e-df94-4cae-9571-0b3ab565505a None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:47.885052 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-cd18816e-df94-4cae-9571-0b3ab565505a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:47.892034 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 505/1010] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:47 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:26:47.913755 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46722ba-cc08-4f6e-8a31-aeb079805864 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:47.925882 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46722ba-cc08-4f6e-8a31-aeb079805864 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:47.930243 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15235f2a-8d11-4482-918c-b4a690d5a54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:47.930948 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15235f2a-8d11-4482-918c-b4a690d5a54e admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:47.931238 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15235f2a-8d11-4482-918c-b4a690d5a54e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:47.931519 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15235f2a-8d11-4482-918c-b4a690d5a54e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:47.943462 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15235f2a-8d11-4482-918c-b4a690d5a54e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:26:47.949673 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-15235f2a-8d11-4482-918c-b4a690d5a54e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:26:47.950765 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 506/1011] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:26:47 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:47.956649 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18816e-df94-4cae-9571-0b3ab565505a None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:47.965432 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18816e-df94-4cae-9571-0b3ab565505a None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:47.969659 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ccce7-2f5d-4784-a0de-3dd0f5aee5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:47.970249 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ccce7-2f5d-4784-a0de-3dd0f5aee5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:47.970542 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ccce7-2f5d-4784-a0de-3dd0f5aee5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:47.970827 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ccce7-2f5d-4784-a0de-3dd0f5aee5b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:47.971536 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ccce7-2f5d-4784-a0de-3dd0f5aee5b0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:47.971832 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ccce7-2f5d-4784-a0de-3dd0f5aee5b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:47.973444 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ccce7-2f5d-4784-a0de-3dd0f5aee5b0 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:47.981845 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 506/1012] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:26:47 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:47.988062 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15235f2a-8d11-4482-918c-b4a690d5a54e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:47.997875 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15235f2a-8d11-4482-918c-b4a690d5a54e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:48.002929 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a2102-c22a-4aaf-bdf0-1c1830a4685f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:48.003705 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a2102-c22a-4aaf-bdf0-1c1830a4685f admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:48.003993 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a2102-c22a-4aaf-bdf0-1c1830a4685f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:48.004277 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a2102-c22a-4aaf-bdf0-1c1830a4685f admin admin] PATH_INFO: `/v3/users/b10f6a57c78940768b18d0349fee6de2` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:48.005416 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a2102-c22a-4aaf-bdf0-1c1830a4685f admin admin] RBAC: Authorizing `identity:get_user(user_id=b10f6a57c78940768b18d0349fee6de2)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:48.007521 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a2102-c22a-4aaf-bdf0-1c1830a4685f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:48.008998 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 507/1013] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:26:47 2021] GET /identity/v3/users/b10f6a57c78940768b18d0349fee6de2 => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:48.014364 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ccce7-2f5d-4784-a0de-3dd0f5aee5b0 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:48.023544 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ccce7-2f5d-4784-a0de-3dd0f5aee5b0 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:48.027741 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adadc69-ebe4-4c7b-a6f9-b25c641d2310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:48.028510 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adadc69-ebe4-4c7b-a6f9-b25c641d2310 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:48.028815 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adadc69-ebe4-4c7b-a6f9-b25c641d2310 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:48.029102 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adadc69-ebe4-4c7b-a6f9-b25c641d2310 admin admin] PATH_INFO: `/v3/projects/7a7037aca4f5455ebc03d2d45a2cbae8` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:48.030169 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adadc69-ebe4-4c7b-a6f9-b25c641d2310 admin admin] RBAC: Authorizing `identity:get_project(project_id=7a7037aca4f5455ebc03d2d45a2cbae8)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:48.032167 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adadc69-ebe4-4c7b-a6f9-b25c641d2310 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:48.034177 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 507/1014] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:26:48 2021] GET /identity/v3/projects/7a7037aca4f5455ebc03d2d45a2cbae8 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:48.039726 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a2102-c22a-4aaf-bdf0-1c1830a4685f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:48.049496 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a2102-c22a-4aaf-bdf0-1c1830a4685f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:48.053842 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02a7e9-db28-47c1-8218-d9b8f7250df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:48.054629 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02a7e9-db28-47c1-8218-d9b8f7250df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:48.054920 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02a7e9-db28-47c1-8218-d9b8f7250df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:48.055206 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02a7e9-db28-47c1-8218-d9b8f7250df9 admin admin] PATH_INFO: `/v3/projects/7a7037aca4f5455ebc03d2d45a2cbae8/users/b10f6a57c78940768b18d0349fee6de2/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:48.057004 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02a7e9-db28-47c1-8218-d9b8f7250df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a7037aca4f5455ebc03d2d45a2cbae8, user_id=b10f6a57c78940768b18d0349fee6de2, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:48.059583 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02a7e9-db28-47c1-8218-d9b8f7250df9 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:48.074367 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 508/1015] 10.222.0.64 () {58 vars in 1460 bytes} [Thu Dec 16 14:26:48 2021] PUT /identity/v3/projects/7a7037aca4f5455ebc03d2d45a2cbae8/users/b10f6a57c78940768b18d0349fee6de2/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:26:50.134353 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95629750-f2e7-459f-936e-46c3fc2ec33b None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:50.134887 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95629750-f2e7-459f-936e-46c3fc2ec33b None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:50.134887 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95629750-f2e7-459f-936e-46c3fc2ec33b None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:50.136519 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 508/1016] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:26:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:50.141821 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c1cd7-9481-439f-b072-be361e0f6df8 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:50.142216 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c1cd7-9481-439f-b072-be361e0f6df8 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:50.142398 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c1cd7-9481-439f-b072-be361e0f6df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:50.163974 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-d54c1cd7-9481-439f-b072-be361e0f6df8 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:50.165154 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-d54c1cd7-9481-439f-b072-be361e0f6df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:50.228076 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 509/1017] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:50 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:26:50.252688 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95629750-f2e7-459f-936e-46c3fc2ec33b None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:50.264676 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95629750-f2e7-459f-936e-46c3fc2ec33b None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:50.268810 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a69f3-66ac-4625-a5b0-185df9644696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:50.269526 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a69f3-66ac-4625-a5b0-185df9644696 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:50.269813 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a69f3-66ac-4625-a5b0-185df9644696 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:50.270095 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a69f3-66ac-4625-a5b0-185df9644696 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:50.281547 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a69f3-66ac-4625-a5b0-185df9644696 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:26:50.288294 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-aa1a69f3-66ac-4625-a5b0-185df9644696 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:26:50.289429 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 509/1018] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:26:50 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:50.295493 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c1cd7-9481-439f-b072-be361e0f6df8 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:50.304877 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c1cd7-9481-439f-b072-be361e0f6df8 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:50.309170 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90976c34-459f-4e07-ae19-06ebea6a6b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:50.309768 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90976c34-459f-4e07-ae19-06ebea6a6b9e admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:50.310059 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90976c34-459f-4e07-ae19-06ebea6a6b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:50.310345 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90976c34-459f-4e07-ae19-06ebea6a6b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:50.311309 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90976c34-459f-4e07-ae19-06ebea6a6b9e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:50.311613 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90976c34-459f-4e07-ae19-06ebea6a6b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:50.313443 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90976c34-459f-4e07-ae19-06ebea6a6b9e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:50.321512 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 510/1019] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:26:50 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:50.327005 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a69f3-66ac-4625-a5b0-185df9644696 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:50.336405 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a69f3-66ac-4625-a5b0-185df9644696 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:50.340814 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0373ece-bfeb-4bf1-9439-22bff070d6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:50.341599 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0373ece-bfeb-4bf1-9439-22bff070d6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:50.341890 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0373ece-bfeb-4bf1-9439-22bff070d6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:50.342176 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0373ece-bfeb-4bf1-9439-22bff070d6a9 admin admin] PATH_INFO: `/v3/users/b10f6a57c78940768b18d0349fee6de2` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:50.343343 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0373ece-bfeb-4bf1-9439-22bff070d6a9 admin admin] RBAC: Authorizing `identity:get_user(user_id=b10f6a57c78940768b18d0349fee6de2)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:50.346214 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0373ece-bfeb-4bf1-9439-22bff070d6a9 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:50.347674 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 510/1020] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:26:50 2021] GET /identity/v3/users/b10f6a57c78940768b18d0349fee6de2 => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:26:50.353090 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90976c34-459f-4e07-ae19-06ebea6a6b9e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:50.362918 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90976c34-459f-4e07-ae19-06ebea6a6b9e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:50.367246 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6ba49-ec28-4a06-8723-0ec9c7fc0913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:50.367818 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6ba49-ec28-4a06-8723-0ec9c7fc0913 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:50.368112 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6ba49-ec28-4a06-8723-0ec9c7fc0913 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:50.368397 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6ba49-ec28-4a06-8723-0ec9c7fc0913 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:50.375954 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6ba49-ec28-4a06-8723-0ec9c7fc0913 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:50.377787 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6ba49-ec28-4a06-8723-0ec9c7fc0913 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:50.387109 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 511/1021] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:26:50 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:26:50.393202 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0373ece-bfeb-4bf1-9439-22bff070d6a9 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:50.402414 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0373ece-bfeb-4bf1-9439-22bff070d6a9 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:50.406704 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297942a-09a9-46ed-9864-582a34634b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:50.407979 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297942a-09a9-46ed-9864-582a34634b7c admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:50.408271 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297942a-09a9-46ed-9864-582a34634b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:50.408555 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297942a-09a9-46ed-9864-582a34634b7c admin admin] PATH_INFO: `/v3/projects/7a7037aca4f5455ebc03d2d45a2cbae8` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:50.409681 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297942a-09a9-46ed-9864-582a34634b7c admin admin] RBAC: Authorizing `identity:get_project(project_id=7a7037aca4f5455ebc03d2d45a2cbae8)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:50.411689 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297942a-09a9-46ed-9864-582a34634b7c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:50.413252 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 511/1022] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:26:50 2021] GET /identity/v3/projects/7a7037aca4f5455ebc03d2d45a2cbae8 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:50.418973 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6ba49-ec28-4a06-8723-0ec9c7fc0913 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:50.427968 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6ba49-ec28-4a06-8723-0ec9c7fc0913 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:50.432288 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7f2bb-d5e8-4dd1-aa0f-2305f4861a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:50.432895 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7f2bb-d5e8-4dd1-aa0f-2305f4861a3b admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:50.433192 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7f2bb-d5e8-4dd1-aa0f-2305f4861a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:50.433479 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7f2bb-d5e8-4dd1-aa0f-2305f4861a3b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:50.434253 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7f2bb-d5e8-4dd1-aa0f-2305f4861a3b admin admin] RBAC: Adding query filter params (role.id=90166eb3dcfa41e58450e140b8b0fea3, scope.project.id=7a7037aca4f5455ebc03d2d45a2cbae8, user.id=b10f6a57c78940768b18d0349fee6de2) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:50.434564 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7f2bb-d5e8-4dd1-aa0f-2305f4861a3b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:50.436643 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7f2bb-d5e8-4dd1-aa0f-2305f4861a3b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:50.442158 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 512/1023] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:26:50 2021] GET /identity/v3/role_assignments?user.id=b10f6a57c78940768b18d0349fee6de2&scope.project.id=7a7037aca4f5455ebc03d2d45a2cbae8&role.id=90166eb3dcfa41e58450e140b8b0fea3 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:52.506595 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb56d4-c86a-4d15-9fc7-f54a64eddd39 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:52.507164 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb56d4-c86a-4d15-9fc7-f54a64eddd39 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:52.507164 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb56d4-c86a-4d15-9fc7-f54a64eddd39 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:52.508874 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 512/1024] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:26:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:52.514198 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e9718-23c5-48b9-831d-4dc961a7b7c3 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:52.514595 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e9718-23c5-48b9-831d-4dc961a7b7c3 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:52.514768 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e9718-23c5-48b9-831d-4dc961a7b7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:52.537633 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-831e9718-23c5-48b9-831d-4dc961a7b7c3 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:52.538766 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-831e9718-23c5-48b9-831d-4dc961a7b7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:52.545720 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 513/1025] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:52 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:26:52.570336 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb56d4-c86a-4d15-9fc7-f54a64eddd39 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:52.583104 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb56d4-c86a-4d15-9fc7-f54a64eddd39 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:52.587487 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955ed0d-f37a-42df-9568-efd629ba81e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:52.588223 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955ed0d-f37a-42df-9568-efd629ba81e1 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:52.588536 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955ed0d-f37a-42df-9568-efd629ba81e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:52.588843 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955ed0d-f37a-42df-9568-efd629ba81e1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:52.590010 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955ed0d-f37a-42df-9568-efd629ba81e1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:52.591764 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955ed0d-f37a-42df-9568-efd629ba81e1 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:52.593321 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 513/1026] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:52 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:52.598840 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e9718-23c5-48b9-831d-4dc961a7b7c3 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:52.607592 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e9718-23c5-48b9-831d-4dc961a7b7c3 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:52.611902 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59352ad-e99f-40c0-b42c-7e8b89aa3438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:52.612499 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59352ad-e99f-40c0-b42c-7e8b89aa3438 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:52.612798 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59352ad-e99f-40c0-b42c-7e8b89aa3438 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:52.613111 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59352ad-e99f-40c0-b42c-7e8b89aa3438 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:52.613778 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59352ad-e99f-40c0-b42c-7e8b89aa3438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:52.615677 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59352ad-e99f-40c0-b42c-7e8b89aa3438 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:52.635141 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 514/1027] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Dec 16 14:26:52 2021] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:26:54.725681 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b11a39-9aee-47a6-84fc-0a34ce9520b4 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:54.726240 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b11a39-9aee-47a6-84fc-0a34ce9520b4 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:54.726240 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b11a39-9aee-47a6-84fc-0a34ce9520b4 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:54.727911 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 514/1028] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:26:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:54.733018 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9ae7c-abff-4b4d-8cca-1f41870740de None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:54.733443 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9ae7c-abff-4b4d-8cca-1f41870740de None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:54.733584 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9ae7c-abff-4b4d-8cca-1f41870740de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:54.756273 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-84f9ae7c-abff-4b4d-8cca-1f41870740de None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:54.757423 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-84f9ae7c-abff-4b4d-8cca-1f41870740de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:54.764312 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 515/1029] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:54 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:26:54.787217 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b11a39-9aee-47a6-84fc-0a34ce9520b4 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:54.799532 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b11a39-9aee-47a6-84fc-0a34ce9520b4 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:54.803622 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658eba1-3867-4f35-a177-8966ac789338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:54.804379 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658eba1-3867-4f35-a177-8966ac789338 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:54.804668 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658eba1-3867-4f35-a177-8966ac789338 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:54.804980 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658eba1-3867-4f35-a177-8966ac789338 admin admin] PATH_INFO: `/v3/roles/54d74c28321f47c3a3b68ea9f95925d8` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:54.806322 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658eba1-3867-4f35-a177-8966ac789338 admin admin] RBAC: Authorizing `identity:get_role(role_id=54d74c28321f47c3a3b68ea9f95925d8)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:54.807312 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING py.warnings [None req-0658eba1-3867-4f35-a177-8966ac789338 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:26:54.807312 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: warnings.warn(msg) Dec 16 14:26:54.807312 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: Dec 16 14:26:54.808172 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658eba1-3867-4f35-a177-8966ac789338 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:54.809430 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 515/1030] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:26:54 2021] GET /identity/v3/roles/54d74c28321f47c3a3b68ea9f95925d8 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:54.815197 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9ae7c-abff-4b4d-8cca-1f41870740de None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:54.823704 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9ae7c-abff-4b4d-8cca-1f41870740de None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:54.827899 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991302d-7648-4981-9638-b777a7db510b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:54.828674 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991302d-7648-4981-9638-b777a7db510b admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:54.828997 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991302d-7648-4981-9638-b777a7db510b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:54.829278 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991302d-7648-4981-9638-b777a7db510b admin admin] PATH_INFO: `/v3/users/ae07f8a9f9784a29b26f93862f7ace6b` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:54.847378 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991302d-7648-4981-9638-b777a7db510b admin admin] RBAC: Authorizing `identity:get_user(user_id=ae07f8a9f9784a29b26f93862f7ace6b)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:54.849515 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991302d-7648-4981-9638-b777a7db510b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:54.851127 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 516/1031] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:26:54 2021] GET /identity/v3/users/ae07f8a9f9784a29b26f93862f7ace6b => generated 286 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:54.856788 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658eba1-3867-4f35-a177-8966ac789338 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:54.866631 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658eba1-3867-4f35-a177-8966ac789338 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:54.870924 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c69ac-9eea-44fc-9a25-e185b5b67d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:54.871485 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c69ac-9eea-44fc-9a25-e185b5b67d42 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:54.871774 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c69ac-9eea-44fc-9a25-e185b5b67d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:54.872062 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c69ac-9eea-44fc-9a25-e185b5b67d42 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:54.879711 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c69ac-9eea-44fc-9a25-e185b5b67d42 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:54.881471 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c69ac-9eea-44fc-9a25-e185b5b67d42 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:54.889773 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 516/1032] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:26:54 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:26:54.895569 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991302d-7648-4981-9638-b777a7db510b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:54.904894 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991302d-7648-4981-9638-b777a7db510b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:54.909694 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f56e11-606c-4c3c-85fe-95b8b5376fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:54.910528 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f56e11-606c-4c3c-85fe-95b8b5376fcd admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:54.910815 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f56e11-606c-4c3c-85fe-95b8b5376fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:54.911101 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f56e11-606c-4c3c-85fe-95b8b5376fcd admin admin] PATH_INFO: `/v3/projects/7a7037aca4f5455ebc03d2d45a2cbae8` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:54.912198 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f56e11-606c-4c3c-85fe-95b8b5376fcd admin admin] RBAC: Authorizing `identity:get_project(project_id=7a7037aca4f5455ebc03d2d45a2cbae8)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:54.914263 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f56e11-606c-4c3c-85fe-95b8b5376fcd admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:54.915770 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 517/1033] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:26:54 2021] GET /identity/v3/projects/7a7037aca4f5455ebc03d2d45a2cbae8 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:54.921467 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c69ac-9eea-44fc-9a25-e185b5b67d42 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:54.930488 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c69ac-9eea-44fc-9a25-e185b5b67d42 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:54.934775 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29262c92-e7ea-461c-bf2f-b691ff348b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:54.935587 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29262c92-e7ea-461c-bf2f-b691ff348b75 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:54.935871 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29262c92-e7ea-461c-bf2f-b691ff348b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:54.936148 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29262c92-e7ea-461c-bf2f-b691ff348b75 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:54.936966 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29262c92-e7ea-461c-bf2f-b691ff348b75 admin admin] RBAC: Adding query filter params (role.id=54d74c28321f47c3a3b68ea9f95925d8, scope.project.id=7a7037aca4f5455ebc03d2d45a2cbae8, user.id=ae07f8a9f9784a29b26f93862f7ace6b) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:54.937270 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29262c92-e7ea-461c-bf2f-b691ff348b75 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:54.939075 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29262c92-e7ea-461c-bf2f-b691ff348b75 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:54.944248 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 517/1034] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:26:54 2021] GET /identity/v3/role_assignments?user.id=ae07f8a9f9784a29b26f93862f7ace6b&scope.project.id=7a7037aca4f5455ebc03d2d45a2cbae8&role.id=54d74c28321f47c3a3b68ea9f95925d8 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:56.961351 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea2675-55ef-42ff-a567-4f54eb01366b None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:56.961903 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea2675-55ef-42ff-a567-4f54eb01366b None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:56.961903 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea2675-55ef-42ff-a567-4f54eb01366b None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:56.963578 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 518/1035] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:26:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:56.968929 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d8d91-1680-4742-8c0d-9b4f81b22df0 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:56.969415 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d8d91-1680-4742-8c0d-9b4f81b22df0 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:56.969509 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d8d91-1680-4742-8c0d-9b4f81b22df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:56.993373 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-fd9d8d91-1680-4742-8c0d-9b4f81b22df0 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:56.994547 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-fd9d8d91-1680-4742-8c0d-9b4f81b22df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:57.001803 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 518/1036] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:56 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:26:57.025377 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea2675-55ef-42ff-a567-4f54eb01366b None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:57.038163 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea2675-55ef-42ff-a567-4f54eb01366b None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:57.042246 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b4244-dba8-4d89-9f21-a4cc5e690b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:57.043014 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b4244-dba8-4d89-9f21-a4cc5e690b8b admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:57.043306 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b4244-dba8-4d89-9f21-a4cc5e690b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:57.043598 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b4244-dba8-4d89-9f21-a4cc5e690b8b admin admin] PATH_INFO: `/v3/roles/54d74c28321f47c3a3b68ea9f95925d8` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:57.044988 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b4244-dba8-4d89-9f21-a4cc5e690b8b admin admin] RBAC: Authorizing `identity:get_role(role_id=54d74c28321f47c3a3b68ea9f95925d8)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:57.045991 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING py.warnings [None req-ab8b4244-dba8-4d89-9f21-a4cc5e690b8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:26:57.045991 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: warnings.warn(msg) Dec 16 14:26:57.045991 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: Dec 16 14:26:57.046870 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b4244-dba8-4d89-9f21-a4cc5e690b8b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:57.048125 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 519/1037] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:26:57 2021] GET /identity/v3/roles/54d74c28321f47c3a3b68ea9f95925d8 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:57.054012 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d8d91-1680-4742-8c0d-9b4f81b22df0 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:57.062799 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d8d91-1680-4742-8c0d-9b4f81b22df0 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:57.067685 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5a067-d3e3-4723-a1f4-9a4d1ac65f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:57.068467 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5a067-d3e3-4723-a1f4-9a4d1ac65f96 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:57.068757 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5a067-d3e3-4723-a1f4-9a4d1ac65f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:57.069069 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5a067-d3e3-4723-a1f4-9a4d1ac65f96 admin admin] PATH_INFO: `/v3/users/ae07f8a9f9784a29b26f93862f7ace6b` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:57.070187 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5a067-d3e3-4723-a1f4-9a4d1ac65f96 admin admin] RBAC: Authorizing `identity:get_user(user_id=ae07f8a9f9784a29b26f93862f7ace6b)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:57.072283 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5a067-d3e3-4723-a1f4-9a4d1ac65f96 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:57.073759 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 519/1038] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:26:57 2021] GET /identity/v3/users/ae07f8a9f9784a29b26f93862f7ace6b => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:57.079816 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b4244-dba8-4d89-9f21-a4cc5e690b8b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:57.088930 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b4244-dba8-4d89-9f21-a4cc5e690b8b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:57.093217 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96296769-2144-4dd5-b4b6-ae7daaeb74e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:57.093980 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96296769-2144-4dd5-b4b6-ae7daaeb74e0 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:57.094271 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96296769-2144-4dd5-b4b6-ae7daaeb74e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:57.094553 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96296769-2144-4dd5-b4b6-ae7daaeb74e0 admin admin] PATH_INFO: `/v3/projects/7a7037aca4f5455ebc03d2d45a2cbae8` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:57.095639 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96296769-2144-4dd5-b4b6-ae7daaeb74e0 admin admin] RBAC: Authorizing `identity:get_project(project_id=7a7037aca4f5455ebc03d2d45a2cbae8)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:57.097692 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96296769-2144-4dd5-b4b6-ae7daaeb74e0 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:57.099199 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 520/1039] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:26:57 2021] GET /identity/v3/projects/7a7037aca4f5455ebc03d2d45a2cbae8 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:57.104941 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5a067-d3e3-4723-a1f4-9a4d1ac65f96 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:57.113982 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5a067-d3e3-4723-a1f4-9a4d1ac65f96 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:57.118243 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f712b53-56db-4ea8-91d8-d85cad22e2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:57.119020 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f712b53-56db-4ea8-91d8-d85cad22e2ca admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:57.119304 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f712b53-56db-4ea8-91d8-d85cad22e2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:57.119583 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f712b53-56db-4ea8-91d8-d85cad22e2ca admin admin] PATH_INFO: `/v3/projects/7a7037aca4f5455ebc03d2d45a2cbae8/users/ae07f8a9f9784a29b26f93862f7ace6b/roles/54d74c28321f47c3a3b68ea9f95925d8` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:57.121684 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f712b53-56db-4ea8-91d8-d85cad22e2ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a7037aca4f5455ebc03d2d45a2cbae8, user_id=ae07f8a9f9784a29b26f93862f7ace6b, role_id=54d74c28321f47c3a3b68ea9f95925d8)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:57.124232 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f712b53-56db-4ea8-91d8-d85cad22e2ca admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:57.136929 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 520/1040] 10.222.0.64 () {58 vars in 1460 bytes} [Thu Dec 16 14:26:57 2021] PUT /identity/v3/projects/7a7037aca4f5455ebc03d2d45a2cbae8/users/ae07f8a9f9784a29b26f93862f7ace6b/roles/54d74c28321f47c3a3b68ea9f95925d8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:26:59.220400 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3cbdd-0b5a-469f-bae6-972eba5c7799 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:59.220963 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3cbdd-0b5a-469f-bae6-972eba5c7799 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:59.221050 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3cbdd-0b5a-469f-bae6-972eba5c7799 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:59.222709 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 521/1041] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:26:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:59.228624 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb01ad-c197-4593-9189-f50b5bc13dd4 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:59.229053 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb01ad-c197-4593-9189-f50b5bc13dd4 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:59.229230 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb01ad-c197-4593-9189-f50b5bc13dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:59.251361 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-e1eb01ad-c197-4593-9189-f50b5bc13dd4 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:59.252517 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e1eb01ad-c197-4593-9189-f50b5bc13dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:59.318310 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 521/1042] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:59 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:26:59.342092 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3cbdd-0b5a-469f-bae6-972eba5c7799 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:59.355441 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3cbdd-0b5a-469f-bae6-972eba5c7799 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:59.360233 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8f9e9-5313-4673-bc5b-4da594d743f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:59.361059 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8f9e9-5313-4673-bc5b-4da594d743f1 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:59.361351 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8f9e9-5313-4673-bc5b-4da594d743f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:59.361634 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8f9e9-5313-4673-bc5b-4da594d743f1 admin admin] PATH_INFO: `/v3/roles/54d74c28321f47c3a3b68ea9f95925d8` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:59.362989 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8f9e9-5313-4673-bc5b-4da594d743f1 admin admin] RBAC: Authorizing `identity:get_role(role_id=54d74c28321f47c3a3b68ea9f95925d8)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:59.364578 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8f9e9-5313-4673-bc5b-4da594d743f1 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:59.365900 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 522/1043] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:26:59 2021] GET /identity/v3/roles/54d74c28321f47c3a3b68ea9f95925d8 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:59.371943 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb01ad-c197-4593-9189-f50b5bc13dd4 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:59.381238 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb01ad-c197-4593-9189-f50b5bc13dd4 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:59.385505 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a71ab-fc3d-438c-ab2a-fa5eb148e24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:59.386287 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a71ab-fc3d-438c-ab2a-fa5eb148e24f admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:59.386574 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a71ab-fc3d-438c-ab2a-fa5eb148e24f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:59.386855 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a71ab-fc3d-438c-ab2a-fa5eb148e24f admin admin] PATH_INFO: `/v3/users/ae07f8a9f9784a29b26f93862f7ace6b` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:59.387959 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a71ab-fc3d-438c-ab2a-fa5eb148e24f admin admin] RBAC: Authorizing `identity:get_user(user_id=ae07f8a9f9784a29b26f93862f7ace6b)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:59.390094 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a71ab-fc3d-438c-ab2a-fa5eb148e24f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:59.392155 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 522/1044] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:26:59 2021] GET /identity/v3/users/ae07f8a9f9784a29b26f93862f7ace6b => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:59.397719 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8f9e9-5313-4673-bc5b-4da594d743f1 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:59.406936 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8f9e9-5313-4673-bc5b-4da594d743f1 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:59.411225 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1e838-8cda-4d97-95e4-7fc3425fdf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:59.411788 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1e838-8cda-4d97-95e4-7fc3425fdf91 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:59.412078 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1e838-8cda-4d97-95e4-7fc3425fdf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:59.412363 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1e838-8cda-4d97-95e4-7fc3425fdf91 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:59.419778 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1e838-8cda-4d97-95e4-7fc3425fdf91 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:59.421547 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1e838-8cda-4d97-95e4-7fc3425fdf91 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:59.429783 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 523/1045] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:26:59 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:26:59.435632 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a71ab-fc3d-438c-ab2a-fa5eb148e24f admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:59.445337 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a71ab-fc3d-438c-ab2a-fa5eb148e24f admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:59.449628 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd962aa-3f82-4b4d-b74f-6dd92244b069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:59.450388 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd962aa-3f82-4b4d-b74f-6dd92244b069 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:59.450682 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd962aa-3f82-4b4d-b74f-6dd92244b069 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:59.450970 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd962aa-3f82-4b4d-b74f-6dd92244b069 admin admin] PATH_INFO: `/v3/projects/7a7037aca4f5455ebc03d2d45a2cbae8` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:59.452045 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd962aa-3f82-4b4d-b74f-6dd92244b069 admin admin] RBAC: Authorizing `identity:get_project(project_id=7a7037aca4f5455ebc03d2d45a2cbae8)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:59.454756 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd962aa-3f82-4b4d-b74f-6dd92244b069 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:59.456266 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 523/1046] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:26:59 2021] GET /identity/v3/projects/7a7037aca4f5455ebc03d2d45a2cbae8 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:59.461930 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1e838-8cda-4d97-95e4-7fc3425fdf91 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:59.470356 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1e838-8cda-4d97-95e4-7fc3425fdf91 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:59.474678 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6c56c-53f0-4d67-82ab-74ed9ea5855d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:59.475193 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6c56c-53f0-4d67-82ab-74ed9ea5855d admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:59.475483 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6c56c-53f0-4d67-82ab-74ed9ea5855d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:59.475764 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6c56c-53f0-4d67-82ab-74ed9ea5855d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:59.476535 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6c56c-53f0-4d67-82ab-74ed9ea5855d admin admin] RBAC: Adding query filter params (role.id=54d74c28321f47c3a3b68ea9f95925d8, scope.project.id=7a7037aca4f5455ebc03d2d45a2cbae8, user.id=ae07f8a9f9784a29b26f93862f7ace6b) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:26:59.476893 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6c56c-53f0-4d67-82ab-74ed9ea5855d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:59.478688 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6c56c-53f0-4d67-82ab-74ed9ea5855d admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:26:59.484239 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 524/1047] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:26:59 2021] GET /identity/v3/role_assignments?user.id=ae07f8a9f9784a29b26f93862f7ace6b&scope.project.id=7a7037aca4f5455ebc03d2d45a2cbae8&role.id=54d74c28321f47c3a3b68ea9f95925d8 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:01.550160 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714aa812-5776-41a2-bc0c-d398b45aedc1 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:01.550726 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714aa812-5776-41a2-bc0c-d398b45aedc1 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:01.550813 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714aa812-5776-41a2-bc0c-d398b45aedc1 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:01.552601 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 524/1048] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:27:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:27:01.558269 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213dfb1-0ae9-41c3-b03d-cd6fe76b747c None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:01.558817 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213dfb1-0ae9-41c3-b03d-cd6fe76b747c None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:01.558817 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213dfb1-0ae9-41c3-b03d-cd6fe76b747c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:01.581412 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-e213dfb1-0ae9-41c3-b03d-cd6fe76b747c None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:27:01.582575 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e213dfb1-0ae9-41c3-b03d-cd6fe76b747c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:27:01.589698 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 525/1049] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:27:01 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:27:01.614221 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714aa812-5776-41a2-bc0c-d398b45aedc1 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:01.626451 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714aa812-5776-41a2-bc0c-d398b45aedc1 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:01.630788 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d024b6-f39b-4809-8bdf-81b246d3b6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:01.631514 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d024b6-f39b-4809-8bdf-81b246d3b6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:01.631806 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d024b6-f39b-4809-8bdf-81b246d3b6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:01.632085 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d024b6-f39b-4809-8bdf-81b246d3b6d6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:01.633243 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d024b6-f39b-4809-8bdf-81b246d3b6d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:01.634934 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d024b6-f39b-4809-8bdf-81b246d3b6d6 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:01.636471 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 525/1050] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:27:01 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:01.642818 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213dfb1-0ae9-41c3-b03d-cd6fe76b747c None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:01.651754 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213dfb1-0ae9-41c3-b03d-cd6fe76b747c None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:01.656131 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb49d45-e729-4b4d-aff1-d391c67485de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:01.657267 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb49d45-e729-4b4d-aff1-d391c67485de admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:01.657559 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb49d45-e729-4b4d-aff1-d391c67485de admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:01.657842 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb49d45-e729-4b4d-aff1-d391c67485de admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:01.658503 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb49d45-e729-4b4d-aff1-d391c67485de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:01.660442 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb49d45-e729-4b4d-aff1-d391c67485de admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:01.689563 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 526/1051] 10.222.0.64 () {60 vars in 1162 bytes} [Thu Dec 16 14:27:01 2021] POST /identity/v3/projects => generated 311 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:27:03.833450 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb0363-1a3c-4525-b163-4fa32717616a None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:03.833985 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb0363-1a3c-4525-b163-4fa32717616a None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:03.833985 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb0363-1a3c-4525-b163-4fa32717616a None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:03.835691 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 526/1052] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:27:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:27:03.841139 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c05c8b-f402-4721-a139-d91c60c5b8af None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:03.841613 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c05c8b-f402-4721-a139-d91c60c5b8af None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:03.841723 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c05c8b-f402-4721-a139-d91c60c5b8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:03.865682 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-e5c05c8b-f402-4721-a139-d91c60c5b8af None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:27:03.866865 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e5c05c8b-f402-4721-a139-d91c60c5b8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:27:03.932678 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 527/1053] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:27:03 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:27:03.956946 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb0363-1a3c-4525-b163-4fa32717616a None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:03.969790 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb0363-1a3c-4525-b163-4fa32717616a None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:03.974104 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e447182-92b2-4631-9691-096c421f5ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:03.974820 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e447182-92b2-4631-9691-096c421f5ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:03.975110 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e447182-92b2-4631-9691-096c421f5ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:03.975395 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e447182-92b2-4631-9691-096c421f5ee6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:03.976495 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e447182-92b2-4631-9691-096c421f5ee6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:03.978213 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e447182-92b2-4631-9691-096c421f5ee6 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:03.979702 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 527/1054] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:27:03 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:03.986145 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c05c8b-f402-4721-a139-d91c60c5b8af None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:03.994847 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c05c8b-f402-4721-a139-d91c60c5b8af None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:03.999307 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d2a16-fd78-46a3-b1b2-9c38e10ffdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:03.999911 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d2a16-fd78-46a3-b1b2-9c38e10ffdae admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:04.000203 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d2a16-fd78-46a3-b1b2-9c38e10ffdae admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:04.000527 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d2a16-fd78-46a3-b1b2-9c38e10ffdae admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:04.001236 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d2a16-fd78-46a3-b1b2-9c38e10ffdae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:04.003191 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d2a16-fd78-46a3-b1b2-9c38e10ffdae admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:04.022847 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 528/1055] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Dec 16 14:27:03 2021] POST /identity/v3/users => generated 286 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:27:06.175085 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b7e69-a818-40c0-900f-e04bdca403a4 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:06.175613 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b7e69-a818-40c0-900f-e04bdca403a4 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:06.175613 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b7e69-a818-40c0-900f-e04bdca403a4 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:06.177283 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 528/1056] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:27:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:27:06.183042 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d6204-4db2-4320-8548-8892a30be3b0 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:06.183575 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d6204-4db2-4320-8548-8892a30be3b0 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:06.183663 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d6204-4db2-4320-8548-8892a30be3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:06.207111 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-3b5d6204-4db2-4320-8548-8892a30be3b0 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:27:06.208282 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-3b5d6204-4db2-4320-8548-8892a30be3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:27:06.215416 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 529/1057] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:27:06 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:27:06.238618 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b7e69-a818-40c0-900f-e04bdca403a4 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:06.251318 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b7e69-a818-40c0-900f-e04bdca403a4 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:06.255480 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8786a2-f7c7-4659-b2b0-bc4c374acc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:06.256188 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8786a2-f7c7-4659-b2b0-bc4c374acc69 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:06.256476 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8786a2-f7c7-4659-b2b0-bc4c374acc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:06.256757 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8786a2-f7c7-4659-b2b0-bc4c374acc69 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:06.269966 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8786a2-f7c7-4659-b2b0-bc4c374acc69 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:27:06.276316 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-7e8786a2-f7c7-4659-b2b0-bc4c374acc69 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:27:06.277489 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 529/1058] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:27:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:27:06.284000 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d6204-4db2-4320-8548-8892a30be3b0 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:06.293138 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d6204-4db2-4320-8548-8892a30be3b0 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:06.297535 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1a7bb-ccab-494a-b403-7040afc55cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:06.298160 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1a7bb-ccab-494a-b403-7040afc55cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:06.298451 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1a7bb-ccab-494a-b403-7040afc55cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:06.298735 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1a7bb-ccab-494a-b403-7040afc55cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:06.299473 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1a7bb-ccab-494a-b403-7040afc55cb1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:27:06.299774 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1a7bb-ccab-494a-b403-7040afc55cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:06.301450 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1a7bb-ccab-494a-b403-7040afc55cb1 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:06.311179 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 530/1059] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:27:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:06.317886 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8786a2-f7c7-4659-b2b0-bc4c374acc69 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:06.327841 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8786a2-f7c7-4659-b2b0-bc4c374acc69 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:06.332997 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c7524-8a1a-4964-8298-56432ae748c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:06.333814 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c7524-8a1a-4964-8298-56432ae748c9 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:06.334105 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c7524-8a1a-4964-8298-56432ae748c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:06.334388 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c7524-8a1a-4964-8298-56432ae748c9 admin admin] PATH_INFO: `/v3/users/245b657d6ed940609c3837f4ba5782d7` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:06.354874 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c7524-8a1a-4964-8298-56432ae748c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=245b657d6ed940609c3837f4ba5782d7)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:06.357045 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c7524-8a1a-4964-8298-56432ae748c9 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:06.358677 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 530/1060] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:27:06 2021] GET /identity/v3/users/245b657d6ed940609c3837f4ba5782d7 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:06.364857 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1a7bb-ccab-494a-b403-7040afc55cb1 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:06.374779 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1a7bb-ccab-494a-b403-7040afc55cb1 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:06.380098 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedee5d8-d9d1-41b3-852f-35dab7b16ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:06.380764 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedee5d8-d9d1-41b3-852f-35dab7b16ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:06.381093 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedee5d8-d9d1-41b3-852f-35dab7b16ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:06.381439 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedee5d8-d9d1-41b3-852f-35dab7b16ed9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:06.391649 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedee5d8-d9d1-41b3-852f-35dab7b16ed9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:06.393552 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedee5d8-d9d1-41b3-852f-35dab7b16ed9 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:06.403629 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 531/1061] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:27:06 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:27:06.410076 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c7524-8a1a-4964-8298-56432ae748c9 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:06.420055 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c7524-8a1a-4964-8298-56432ae748c9 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:06.425256 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d9236-8f2a-44d9-ae09-691f5d007691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:06.426038 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d9236-8f2a-44d9-ae09-691f5d007691 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:06.426366 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d9236-8f2a-44d9-ae09-691f5d007691 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:06.426698 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d9236-8f2a-44d9-ae09-691f5d007691 admin admin] PATH_INFO: `/v3/projects/6bf86bc7a5ce44648e90c18c73f6d76c` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:06.427885 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d9236-8f2a-44d9-ae09-691f5d007691 admin admin] RBAC: Authorizing `identity:get_project(project_id=6bf86bc7a5ce44648e90c18c73f6d76c)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:06.429997 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d9236-8f2a-44d9-ae09-691f5d007691 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:06.431609 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 531/1062] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:27:06 2021] GET /identity/v3/projects/6bf86bc7a5ce44648e90c18c73f6d76c => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:06.439011 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedee5d8-d9d1-41b3-852f-35dab7b16ed9 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:06.451235 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedee5d8-d9d1-41b3-852f-35dab7b16ed9 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:06.455619 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edb945-8df4-43a7-9a64-5e9ff54efd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:06.456212 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edb945-8df4-43a7-9a64-5e9ff54efd21 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:06.456494 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edb945-8df4-43a7-9a64-5e9ff54efd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:06.456774 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edb945-8df4-43a7-9a64-5e9ff54efd21 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:06.457587 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59edb945-8df4-43a7-9a64-5e9ff54efd21 admin admin] RBAC: Adding query filter params (role.id=90166eb3dcfa41e58450e140b8b0fea3, scope.project.id=6bf86bc7a5ce44648e90c18c73f6d76c, user.id=245b657d6ed940609c3837f4ba5782d7) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:27:06.457887 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59edb945-8df4-43a7-9a64-5e9ff54efd21 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:06.459736 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59edb945-8df4-43a7-9a64-5e9ff54efd21 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:06.465734 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 532/1063] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:27:06 2021] GET /identity/v3/role_assignments?user.id=245b657d6ed940609c3837f4ba5782d7&scope.project.id=6bf86bc7a5ce44648e90c18c73f6d76c&role.id=90166eb3dcfa41e58450e140b8b0fea3 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:08.558125 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241fbbd-adf9-419c-8306-acfff83b034e None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:08.558717 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241fbbd-adf9-419c-8306-acfff83b034e None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:08.558717 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241fbbd-adf9-419c-8306-acfff83b034e None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:08.560621 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 532/1064] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:27:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:27:08.565945 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e118e9-23f1-45f5-ba7d-386e75daa61c None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:08.566337 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e118e9-23f1-45f5-ba7d-386e75daa61c None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:08.566509 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e118e9-23f1-45f5-ba7d-386e75daa61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:08.587700 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-16e118e9-23f1-45f5-ba7d-386e75daa61c None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:27:08.588848 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-16e118e9-23f1-45f5-ba7d-386e75daa61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:27:08.596187 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 533/1065] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:27:08 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:27:08.618742 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241fbbd-adf9-419c-8306-acfff83b034e None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:08.630556 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241fbbd-adf9-419c-8306-acfff83b034e None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:08.634662 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd450ef-c986-4c18-930e-aca48c1a3c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:08.635354 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd450ef-c986-4c18-930e-aca48c1a3c06 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:08.635648 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd450ef-c986-4c18-930e-aca48c1a3c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:08.635931 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd450ef-c986-4c18-930e-aca48c1a3c06 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:08.647770 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd450ef-c986-4c18-930e-aca48c1a3c06 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:27:08.653964 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-bfd450ef-c986-4c18-930e-aca48c1a3c06 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:27:08.655052 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 533/1066] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:27:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:27:08.661764 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e118e9-23f1-45f5-ba7d-386e75daa61c None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:08.670269 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e118e9-23f1-45f5-ba7d-386e75daa61c None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:08.674584 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384234ac-50ee-4472-b376-e4e41a818a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:08.675191 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384234ac-50ee-4472-b376-e4e41a818a38 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:08.675450 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384234ac-50ee-4472-b376-e4e41a818a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:08.675728 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384234ac-50ee-4472-b376-e4e41a818a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:08.676432 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384234ac-50ee-4472-b376-e4e41a818a38 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:27:08.676729 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384234ac-50ee-4472-b376-e4e41a818a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:08.678329 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384234ac-50ee-4472-b376-e4e41a818a38 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:08.686790 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 534/1067] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:27:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:08.692466 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd450ef-c986-4c18-930e-aca48c1a3c06 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:08.702352 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd450ef-c986-4c18-930e-aca48c1a3c06 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:08.707211 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52689c8-bdfc-4b7e-97bb-1b98c65c7b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:08.708006 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52689c8-bdfc-4b7e-97bb-1b98c65c7b47 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:08.708298 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52689c8-bdfc-4b7e-97bb-1b98c65c7b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:08.708677 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52689c8-bdfc-4b7e-97bb-1b98c65c7b47 admin admin] PATH_INFO: `/v3/users/245b657d6ed940609c3837f4ba5782d7` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:08.709841 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52689c8-bdfc-4b7e-97bb-1b98c65c7b47 admin admin] RBAC: Authorizing `identity:get_user(user_id=245b657d6ed940609c3837f4ba5782d7)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:08.711964 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52689c8-bdfc-4b7e-97bb-1b98c65c7b47 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:08.713511 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 534/1068] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:27:08 2021] GET /identity/v3/users/245b657d6ed940609c3837f4ba5782d7 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:08.720028 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384234ac-50ee-4472-b376-e4e41a818a38 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:08.729542 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384234ac-50ee-4472-b376-e4e41a818a38 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:08.733892 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fab50-13d3-4a96-a8e0-389c25ea864c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:08.734724 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fab50-13d3-4a96-a8e0-389c25ea864c admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:08.735011 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fab50-13d3-4a96-a8e0-389c25ea864c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:08.735294 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fab50-13d3-4a96-a8e0-389c25ea864c admin admin] PATH_INFO: `/v3/projects/6bf86bc7a5ce44648e90c18c73f6d76c` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:08.736397 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5fab50-13d3-4a96-a8e0-389c25ea864c admin admin] RBAC: Authorizing `identity:get_project(project_id=6bf86bc7a5ce44648e90c18c73f6d76c)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:08.738507 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5fab50-13d3-4a96-a8e0-389c25ea864c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:08.740107 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 535/1069] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:27:08 2021] GET /identity/v3/projects/6bf86bc7a5ce44648e90c18c73f6d76c => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:08.746615 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52689c8-bdfc-4b7e-97bb-1b98c65c7b47 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:08.756268 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52689c8-bdfc-4b7e-97bb-1b98c65c7b47 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:08.760544 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70a222-f350-4d01-862a-c6d49a6982ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:08.761410 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70a222-f350-4d01-862a-c6d49a6982ee admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:08.761709 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70a222-f350-4d01-862a-c6d49a6982ee admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:08.762000 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70a222-f350-4d01-862a-c6d49a6982ee admin admin] PATH_INFO: `/v3/projects/6bf86bc7a5ce44648e90c18c73f6d76c/users/245b657d6ed940609c3837f4ba5782d7/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:08.763860 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70a222-f350-4d01-862a-c6d49a6982ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf86bc7a5ce44648e90c18c73f6d76c, user_id=245b657d6ed940609c3837f4ba5782d7, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:08.767066 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70a222-f350-4d01-862a-c6d49a6982ee admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:08.781100 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 535/1070] 10.222.0.64 () {58 vars in 1460 bytes} [Thu Dec 16 14:27:08 2021] PUT /identity/v3/projects/6bf86bc7a5ce44648e90c18c73f6d76c/users/245b657d6ed940609c3837f4ba5782d7/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:27:10.847492 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b729352-c9f6-4d3a-8479-878af2fd94c0 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:10.848016 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b729352-c9f6-4d3a-8479-878af2fd94c0 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:10.848211 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b729352-c9f6-4d3a-8479-878af2fd94c0 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:10.849772 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 536/1071] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:27:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:27:10.855174 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e26e3-c899-4100-9a44-ad49f387466f None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:10.855532 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e26e3-c899-4100-9a44-ad49f387466f None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:10.855532 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e26e3-c899-4100-9a44-ad49f387466f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:10.877409 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-e40e26e3-c899-4100-9a44-ad49f387466f None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:27:10.878541 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e40e26e3-c899-4100-9a44-ad49f387466f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:27:10.941719 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 536/1072] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:27:10 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:27:10.965107 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b729352-c9f6-4d3a-8479-878af2fd94c0 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:10.976913 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b729352-c9f6-4d3a-8479-878af2fd94c0 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:10.981035 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2036c-fe7c-452e-833a-4c933650a17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:10.981742 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2036c-fe7c-452e-833a-4c933650a17f admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:10.982038 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2036c-fe7c-452e-833a-4c933650a17f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:10.982327 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2036c-fe7c-452e-833a-4c933650a17f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:10.994274 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2036c-fe7c-452e-833a-4c933650a17f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:27:11.001163 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-12c2036c-fe7c-452e-833a-4c933650a17f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:27:11.002282 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 537/1073] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:27:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:27:11.008260 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e26e3-c899-4100-9a44-ad49f387466f None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:11.016813 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e26e3-c899-4100-9a44-ad49f387466f None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:11.021058 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b1373-38f5-4728-af7e-c698b37750b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:11.021646 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b1373-38f5-4728-af7e-c698b37750b7 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:11.021932 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b1373-38f5-4728-af7e-c698b37750b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:11.022213 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b1373-38f5-4728-af7e-c698b37750b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:11.022920 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b1373-38f5-4728-af7e-c698b37750b7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:27:11.023222 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b1373-38f5-4728-af7e-c698b37750b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:11.024801 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b1373-38f5-4728-af7e-c698b37750b7 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:11.033187 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 537/1074] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:27:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:11.038767 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2036c-fe7c-452e-833a-4c933650a17f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:11.048459 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2036c-fe7c-452e-833a-4c933650a17f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:11.052727 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1c5ba-c919-49c3-842d-5323e27172f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:11.053527 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1c5ba-c919-49c3-842d-5323e27172f5 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:11.053819 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1c5ba-c919-49c3-842d-5323e27172f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:11.054110 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1c5ba-c919-49c3-842d-5323e27172f5 admin admin] PATH_INFO: `/v3/users/245b657d6ed940609c3837f4ba5782d7` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:11.055228 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1c5ba-c919-49c3-842d-5323e27172f5 admin admin] RBAC: Authorizing `identity:get_user(user_id=245b657d6ed940609c3837f4ba5782d7)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:11.057384 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1c5ba-c919-49c3-842d-5323e27172f5 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:11.058834 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 538/1075] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:27:11 2021] GET /identity/v3/users/245b657d6ed940609c3837f4ba5782d7 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:11.065154 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b1373-38f5-4728-af7e-c698b37750b7 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:11.074299 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b1373-38f5-4728-af7e-c698b37750b7 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:11.078658 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f29d5-d9be-4995-8108-a1b6988582f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:11.079127 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f29d5-d9be-4995-8108-a1b6988582f8 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:11.079420 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f29d5-d9be-4995-8108-a1b6988582f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:11.079705 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f29d5-d9be-4995-8108-a1b6988582f8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:11.087534 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f29d5-d9be-4995-8108-a1b6988582f8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:11.089321 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f29d5-d9be-4995-8108-a1b6988582f8 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:11.098067 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 538/1076] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:27:11 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:27:11.104011 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1c5ba-c919-49c3-842d-5323e27172f5 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:11.114036 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1c5ba-c919-49c3-842d-5323e27172f5 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:11.118598 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc0d95-e09f-46eb-86c6-d542c14441ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:11.119379 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc0d95-e09f-46eb-86c6-d542c14441ae admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:11.119669 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc0d95-e09f-46eb-86c6-d542c14441ae admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:11.119951 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc0d95-e09f-46eb-86c6-d542c14441ae admin admin] PATH_INFO: `/v3/projects/6bf86bc7a5ce44648e90c18c73f6d76c` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:11.121100 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc0d95-e09f-46eb-86c6-d542c14441ae admin admin] RBAC: Authorizing `identity:get_project(project_id=6bf86bc7a5ce44648e90c18c73f6d76c)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:11.123158 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc0d95-e09f-46eb-86c6-d542c14441ae admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:11.124718 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 539/1077] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:27:11 2021] GET /identity/v3/projects/6bf86bc7a5ce44648e90c18c73f6d76c => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:11.131656 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f29d5-d9be-4995-8108-a1b6988582f8 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:11.140467 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f29d5-d9be-4995-8108-a1b6988582f8 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:11.144839 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5b425-944d-455d-95e5-12307d6c0b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:11.145420 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5b425-944d-455d-95e5-12307d6c0b16 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:11.145713 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5b425-944d-455d-95e5-12307d6c0b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:11.145998 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5b425-944d-455d-95e5-12307d6c0b16 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:11.146775 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5b425-944d-455d-95e5-12307d6c0b16 admin admin] RBAC: Adding query filter params (role.id=90166eb3dcfa41e58450e140b8b0fea3, scope.project.id=6bf86bc7a5ce44648e90c18c73f6d76c, user.id=245b657d6ed940609c3837f4ba5782d7) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:27:11.147081 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5b425-944d-455d-95e5-12307d6c0b16 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:11.148989 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5b425-944d-455d-95e5-12307d6c0b16 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:11.155093 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 539/1078] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:27:11 2021] GET /identity/v3/role_assignments?user.id=245b657d6ed940609c3837f4ba5782d7&scope.project.id=6bf86bc7a5ce44648e90c18c73f6d76c&role.id=90166eb3dcfa41e58450e140b8b0fea3 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:13.285381 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cac74b-d6cf-4cf2-ad48-0a131116e0fa None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:13.285951 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cac74b-d6cf-4cf2-ad48-0a131116e0fa None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:13.285951 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cac74b-d6cf-4cf2-ad48-0a131116e0fa None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:13.287593 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 540/1079] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:27:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:27:13.292776 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b07d71-014f-4781-b5c8-c0b47433cff3 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:13.293244 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b07d71-014f-4781-b5c8-c0b47433cff3 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:13.293374 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b07d71-014f-4781-b5c8-c0b47433cff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:13.316497 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-47b07d71-014f-4781-b5c8-c0b47433cff3 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:27:13.317707 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-47b07d71-014f-4781-b5c8-c0b47433cff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:27:13.325061 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 540/1080] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:27:13 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:27:13.347625 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cac74b-d6cf-4cf2-ad48-0a131116e0fa None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:13.359953 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cac74b-d6cf-4cf2-ad48-0a131116e0fa None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:13.364045 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3fb9e-9f54-40f1-b345-074280374918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:13.364616 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3fb9e-9f54-40f1-b345-074280374918 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:13.364940 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3fb9e-9f54-40f1-b345-074280374918 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:13.365220 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3fb9e-9f54-40f1-b345-074280374918 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:13.372640 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3fb9e-9f54-40f1-b345-074280374918 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:13.374402 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3fb9e-9f54-40f1-b345-074280374918 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:13.383465 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 541/1081] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:27:13 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:27:13.389563 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b07d71-014f-4781-b5c8-c0b47433cff3 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:13.398037 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b07d71-014f-4781-b5c8-c0b47433cff3 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:13.402287 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f805b-708d-4446-a064-88d277494f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:13.403005 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f805b-708d-4446-a064-88d277494f55 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:13.403294 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f805b-708d-4446-a064-88d277494f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:13.403579 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f805b-708d-4446-a064-88d277494f55 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:13.411545 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f805b-708d-4446-a064-88d277494f55 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:13.413400 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f805b-708d-4446-a064-88d277494f55 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:13.427776 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-db5f805b-708d-4446-a064-88d277494f55 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Dec 16 14:27:13.428830 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 541/1082] 10.222.0.64 () {56 vars in 1138 bytes} [Thu Dec 16 14:27:13 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:27:13.434791 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3fb9e-9f54-40f1-b345-074280374918 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:13.443718 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3fb9e-9f54-40f1-b345-074280374918 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:13.448040 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57477ddc-0f72-4ad5-a611-f0bbf5e54162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:13.448625 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57477ddc-0f72-4ad5-a611-f0bbf5e54162 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:13.448951 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57477ddc-0f72-4ad5-a611-f0bbf5e54162 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:13.449233 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57477ddc-0f72-4ad5-a611-f0bbf5e54162 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:13.449931 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57477ddc-0f72-4ad5-a611-f0bbf5e54162 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:27:13.450231 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57477ddc-0f72-4ad5-a611-f0bbf5e54162 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:13.451814 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57477ddc-0f72-4ad5-a611-f0bbf5e54162 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:13.460433 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 542/1083] 10.222.0.64 () {56 vars in 1136 bytes} [Thu Dec 16 14:27:13 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:15.531026 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82207783-268d-4070-9c5c-f33aa86b1794 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:15.531561 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82207783-268d-4070-9c5c-f33aa86b1794 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:15.531683 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82207783-268d-4070-9c5c-f33aa86b1794 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:15.533298 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 542/1084] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:27:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:27:15.538526 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ef6d8-3a66-4a91-af5f-258aad64557d None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:15.538974 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ef6d8-3a66-4a91-af5f-258aad64557d None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:15.539097 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ef6d8-3a66-4a91-af5f-258aad64557d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:15.561590 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-367ef6d8-3a66-4a91-af5f-258aad64557d None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:27:15.563326 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-367ef6d8-3a66-4a91-af5f-258aad64557d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:27:15.570342 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 543/1085] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:27:15 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:27:15.592641 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82207783-268d-4070-9c5c-f33aa86b1794 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:15.604433 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82207783-268d-4070-9c5c-f33aa86b1794 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:15.608666 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95cd85-766b-4ac2-b657-353a02bbed5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:15.609764 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95cd85-766b-4ac2-b657-353a02bbed5a admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:15.610055 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95cd85-766b-4ac2-b657-353a02bbed5a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:15.610341 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95cd85-766b-4ac2-b657-353a02bbed5a admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:15.611036 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95cd85-766b-4ac2-b657-353a02bbed5a admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:15.612023 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING py.warnings [None req-1e95cd85-766b-4ac2-b657-353a02bbed5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:27:15.612023 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: warnings.warn(msg) Dec 16 14:27:15.612023 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: Dec 16 14:27:15.612939 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95cd85-766b-4ac2-b657-353a02bbed5a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:15.627583 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 543/1086] 10.222.0.64 () {60 vars in 1159 bytes} [Thu Dec 16 14:27:15 2021] POST /identity/v3/domains => generated 267 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:27:17.763350 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09735b6f-a470-4b29-b5d8-88c3f82f2556 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:17.763903 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09735b6f-a470-4b29-b5d8-88c3f82f2556 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:17.763903 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09735b6f-a470-4b29-b5d8-88c3f82f2556 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:17.766158 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 544/1087] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:27:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:27:17.772802 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124fcd2-d85e-4bdd-9633-341b1f34a202 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:17.773322 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124fcd2-d85e-4bdd-9633-341b1f34a202 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:17.773594 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124fcd2-d85e-4bdd-9633-341b1f34a202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:17.801803 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-b124fcd2-d85e-4bdd-9633-341b1f34a202 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:27:17.802972 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-b124fcd2-d85e-4bdd-9633-341b1f34a202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:27:17.873308 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 544/1088] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:27:17 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:27:17.897635 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09735b6f-a470-4b29-b5d8-88c3f82f2556 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:17.917323 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09735b6f-a470-4b29-b5d8-88c3f82f2556 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:17.921622 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c76448-2c88-4024-bac0-0f779cee7f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:17.922413 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c76448-2c88-4024-bac0-0f779cee7f94 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:17.922702 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c76448-2c88-4024-bac0-0f779cee7f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:17.923012 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c76448-2c88-4024-bac0-0f779cee7f94 admin admin] PATH_INFO: `/v3/domains/4ea1b7edda0043d197ef9ecdcaef4595` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:17.936130 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c76448-2c88-4024-bac0-0f779cee7f94 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=4ea1b7edda0043d197ef9ecdcaef4595)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:17.938139 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c76448-2c88-4024-bac0-0f779cee7f94 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:17.939744 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 545/1089] 10.222.0.64 () {56 vars in 1204 bytes} [Thu Dec 16 14:27:17 2021] GET /identity/v3/domains/4ea1b7edda0043d197ef9ecdcaef4595 => generated 267 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:17.945842 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124fcd2-d85e-4bdd-9633-341b1f34a202 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:17.955321 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124fcd2-d85e-4bdd-9633-341b1f34a202 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:17.959759 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9c748-9b64-4f0e-96c5-021e373027c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:17.960366 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9c748-9b64-4f0e-96c5-021e373027c3 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:17.960655 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9c748-9b64-4f0e-96c5-021e373027c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:17.960976 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9c748-9b64-4f0e-96c5-021e373027c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:17.961647 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9c748-9b64-4f0e-96c5-021e373027c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:17.963575 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9c748-9b64-4f0e-96c5-021e373027c3 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:17.992679 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 545/1090] 10.222.0.64 () {60 vars in 1162 bytes} [Thu Dec 16 14:27:17 2021] POST /identity/v3/projects => generated 361 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:27:20.101673 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627cdac-1680-431c-bfa1-4f3c2787b348 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:20.102221 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627cdac-1680-431c-bfa1-4f3c2787b348 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:20.102221 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627cdac-1680-431c-bfa1-4f3c2787b348 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:20.104170 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 546/1091] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:27:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:27:20.109983 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdb6b1-ecdd-484b-ac11-89d18a20b857 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:20.110457 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdb6b1-ecdd-484b-ac11-89d18a20b857 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:20.110582 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdb6b1-ecdd-484b-ac11-89d18a20b857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:20.132979 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-4bcdb6b1-ecdd-484b-ac11-89d18a20b857 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:27:20.134119 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-4bcdb6b1-ecdd-484b-ac11-89d18a20b857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:27:20.197230 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 546/1092] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:27:20 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:27:20.220955 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627cdac-1680-431c-bfa1-4f3c2787b348 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:20.232766 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627cdac-1680-431c-bfa1-4f3c2787b348 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:20.237365 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0f085-d7c4-4312-857c-06c29f21f146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:20.238141 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0f085-d7c4-4312-857c-06c29f21f146 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:20.238428 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0f085-d7c4-4312-857c-06c29f21f146 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:20.238708 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0f085-d7c4-4312-857c-06c29f21f146 admin admin] PATH_INFO: `/v3/domains/4ea1b7edda0043d197ef9ecdcaef4595` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:20.239818 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0f085-d7c4-4312-857c-06c29f21f146 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=4ea1b7edda0043d197ef9ecdcaef4595)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:20.241808 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0f085-d7c4-4312-857c-06c29f21f146 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:20.243282 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 547/1093] 10.222.0.64 () {56 vars in 1204 bytes} [Thu Dec 16 14:27:20 2021] GET /identity/v3/domains/4ea1b7edda0043d197ef9ecdcaef4595 => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:20.249047 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdb6b1-ecdd-484b-ac11-89d18a20b857 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:20.258226 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdb6b1-ecdd-484b-ac11-89d18a20b857 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:20.262584 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82f944-05b6-4e9a-9b14-d79cf782aa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:20.263172 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82f944-05b6-4e9a-9b14-d79cf782aa37 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:20.263459 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82f944-05b6-4e9a-9b14-d79cf782aa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:20.263738 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82f944-05b6-4e9a-9b14-d79cf782aa37 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:20.264389 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82f944-05b6-4e9a-9b14-d79cf782aa37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:20.266335 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82f944-05b6-4e9a-9b14-d79cf782aa37 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:20.286499 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 547/1094] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Dec 16 14:27:20 2021] POST /identity/v3/users => generated 311 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:27:22.398844 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1c199-dc1f-4a27-9261-01a33c532cfc None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:22.399397 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1c199-dc1f-4a27-9261-01a33c532cfc None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:22.399397 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1c199-dc1f-4a27-9261-01a33c532cfc None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:22.401235 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 548/1095] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:27:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:27:22.406651 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a1ee1-6f0b-4cb9-9f03-ec4aa67aafee None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:22.407264 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a1ee1-6f0b-4cb9-9f03-ec4aa67aafee None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:22.407264 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a1ee1-6f0b-4cb9-9f03-ec4aa67aafee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:22.429405 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-231a1ee1-6f0b-4cb9-9f03-ec4aa67aafee None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:27:22.430556 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-231a1ee1-6f0b-4cb9-9f03-ec4aa67aafee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:27:22.438641 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 548/1096] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:27:22 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:27:22.461439 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1c199-dc1f-4a27-9261-01a33c532cfc None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:22.473673 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1c199-dc1f-4a27-9261-01a33c532cfc None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:22.477824 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f508c-9e9e-43d2-8680-b2c284c1b086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:22.478542 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f508c-9e9e-43d2-8680-b2c284c1b086 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:22.478834 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f508c-9e9e-43d2-8680-b2c284c1b086 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:22.479118 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f508c-9e9e-43d2-8680-b2c284c1b086 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:22.491315 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f508c-9e9e-43d2-8680-b2c284c1b086 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:27:22.497627 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-941f508c-9e9e-43d2-8680-b2c284c1b086 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:27:22.498781 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 549/1097] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:27:22 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:27:22.505605 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a1ee1-6f0b-4cb9-9f03-ec4aa67aafee None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:22.514253 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a1ee1-6f0b-4cb9-9f03-ec4aa67aafee None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:22.518517 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5891d-b004-45e9-8029-413f711f394f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:22.519103 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5891d-b004-45e9-8029-413f711f394f admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:22.519391 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5891d-b004-45e9-8029-413f711f394f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:22.519672 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5891d-b004-45e9-8029-413f711f394f admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:22.520378 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5891d-b004-45e9-8029-413f711f394f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:27:22.520676 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5891d-b004-45e9-8029-413f711f394f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:22.522270 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5891d-b004-45e9-8029-413f711f394f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:22.531080 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 549/1098] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:27:22 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:22.536896 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f508c-9e9e-43d2-8680-b2c284c1b086 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:22.547335 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f508c-9e9e-43d2-8680-b2c284c1b086 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:22.551709 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75951416-31c7-464f-bf5d-685f055b2ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:22.552495 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75951416-31c7-464f-bf5d-685f055b2ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:22.552801 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75951416-31c7-464f-bf5d-685f055b2ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:22.553104 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75951416-31c7-464f-bf5d-685f055b2ca7 admin admin] PATH_INFO: `/v3/users/239000e6ed9c40b0a9286844cf26dc87` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:22.571130 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75951416-31c7-464f-bf5d-685f055b2ca7 admin admin] RBAC: Authorizing `identity:get_user(user_id=239000e6ed9c40b0a9286844cf26dc87)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:22.573304 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75951416-31c7-464f-bf5d-685f055b2ca7 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:22.574789 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 550/1099] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:27:22 2021] GET /identity/v3/users/239000e6ed9c40b0a9286844cf26dc87 => generated 311 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:22.580383 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5891d-b004-45e9-8029-413f711f394f admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:22.589674 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5891d-b004-45e9-8029-413f711f394f admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:22.594466 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e132e60-0534-4652-8938-bb6cccab0c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:22.595035 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e132e60-0534-4652-8938-bb6cccab0c88 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:22.595329 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e132e60-0534-4652-8938-bb6cccab0c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:22.595617 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e132e60-0534-4652-8938-bb6cccab0c88 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:22.603300 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e132e60-0534-4652-8938-bb6cccab0c88 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:22.605046 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e132e60-0534-4652-8938-bb6cccab0c88 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:22.614022 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 550/1100] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:27:22 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:27:22.619684 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75951416-31c7-464f-bf5d-685f055b2ca7 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:22.628913 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75951416-31c7-464f-bf5d-685f055b2ca7 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:22.633450 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00896ed6-cf52-4f1a-9f00-168bb39264cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:22.634269 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00896ed6-cf52-4f1a-9f00-168bb39264cc admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:22.634561 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00896ed6-cf52-4f1a-9f00-168bb39264cc admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:22.634848 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00896ed6-cf52-4f1a-9f00-168bb39264cc admin admin] PATH_INFO: `/v3/projects/af621d04dda4452a90902aabb22b2a68` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:22.635942 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00896ed6-cf52-4f1a-9f00-168bb39264cc admin admin] RBAC: Authorizing `identity:get_project(project_id=af621d04dda4452a90902aabb22b2a68)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:22.638014 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00896ed6-cf52-4f1a-9f00-168bb39264cc admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:22.639533 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 551/1101] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:27:22 2021] GET /identity/v3/projects/af621d04dda4452a90902aabb22b2a68 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:22.645210 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e132e60-0534-4652-8938-bb6cccab0c88 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:22.653579 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e132e60-0534-4652-8938-bb6cccab0c88 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:22.658455 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436ea6d-7167-408b-ac2c-8baeb030dacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:22.659032 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436ea6d-7167-408b-ac2c-8baeb030dacd admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:22.659325 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436ea6d-7167-408b-ac2c-8baeb030dacd admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:22.659609 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436ea6d-7167-408b-ac2c-8baeb030dacd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:22.660392 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436ea6d-7167-408b-ac2c-8baeb030dacd admin admin] RBAC: Adding query filter params (role.id=90166eb3dcfa41e58450e140b8b0fea3, scope.project.id=af621d04dda4452a90902aabb22b2a68, user.id=239000e6ed9c40b0a9286844cf26dc87) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:27:22.660693 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436ea6d-7167-408b-ac2c-8baeb030dacd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:22.662530 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436ea6d-7167-408b-ac2c-8baeb030dacd admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:22.668147 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 551/1102] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:27:22 2021] GET /identity/v3/role_assignments?user.id=239000e6ed9c40b0a9286844cf26dc87&scope.project.id=af621d04dda4452a90902aabb22b2a68&role.id=90166eb3dcfa41e58450e140b8b0fea3 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:24.716098 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9676976-1f0d-4548-b4d1-dd62f2ad7385 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:24.716656 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9676976-1f0d-4548-b4d1-dd62f2ad7385 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:24.716656 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9676976-1f0d-4548-b4d1-dd62f2ad7385 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:24.719093 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 552/1103] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:27:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:27:24.724582 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce033b-8379-4b56-b016-484143d00f97 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:24.725041 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce033b-8379-4b56-b016-484143d00f97 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:24.725182 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce033b-8379-4b56-b016-484143d00f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:24.747190 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-ddce033b-8379-4b56-b016-484143d00f97 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:27:24.748349 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-ddce033b-8379-4b56-b016-484143d00f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:27:24.755579 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 552/1104] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:27:24 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:27:24.778848 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9676976-1f0d-4548-b4d1-dd62f2ad7385 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:24.791505 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9676976-1f0d-4548-b4d1-dd62f2ad7385 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:24.795638 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cea2e-068a-441d-9400-8e708d7c7fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:24.796359 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cea2e-068a-441d-9400-8e708d7c7fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:24.796649 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cea2e-068a-441d-9400-8e708d7c7fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:24.796975 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cea2e-068a-441d-9400-8e708d7c7fa2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:24.808493 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743cea2e-068a-441d-9400-8e708d7c7fa2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:27:24.815568 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-743cea2e-068a-441d-9400-8e708d7c7fa2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:27:24.816722 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 553/1105] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:27:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:27:24.822840 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce033b-8379-4b56-b016-484143d00f97 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:24.832142 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce033b-8379-4b56-b016-484143d00f97 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:24.836400 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fe073-88c7-41b3-92f5-51baadf964f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:24.837036 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fe073-88c7-41b3-92f5-51baadf964f4 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:24.837321 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fe073-88c7-41b3-92f5-51baadf964f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:24.837604 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fe073-88c7-41b3-92f5-51baadf964f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:24.838317 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940fe073-88c7-41b3-92f5-51baadf964f4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:27:24.838628 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940fe073-88c7-41b3-92f5-51baadf964f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:24.840184 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940fe073-88c7-41b3-92f5-51baadf964f4 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:24.849668 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 553/1106] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:27:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:24.855605 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cea2e-068a-441d-9400-8e708d7c7fa2 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:24.865536 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cea2e-068a-441d-9400-8e708d7c7fa2 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:24.869781 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd837a-f76e-4507-bd2c-81cec77e6264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:24.870572 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd837a-f76e-4507-bd2c-81cec77e6264 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:24.870865 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd837a-f76e-4507-bd2c-81cec77e6264 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:24.871150 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd837a-f76e-4507-bd2c-81cec77e6264 admin admin] PATH_INFO: `/v3/users/239000e6ed9c40b0a9286844cf26dc87` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:24.872248 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd837a-f76e-4507-bd2c-81cec77e6264 admin admin] RBAC: Authorizing `identity:get_user(user_id=239000e6ed9c40b0a9286844cf26dc87)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:24.874909 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd837a-f76e-4507-bd2c-81cec77e6264 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:24.876350 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 554/1107] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:27:24 2021] GET /identity/v3/users/239000e6ed9c40b0a9286844cf26dc87 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:24.882056 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fe073-88c7-41b3-92f5-51baadf964f4 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:24.891773 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fe073-88c7-41b3-92f5-51baadf964f4 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:24.895994 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebb34a-423c-4255-aac9-79d17572f178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:24.896762 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebb34a-423c-4255-aac9-79d17572f178 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:24.897086 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebb34a-423c-4255-aac9-79d17572f178 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:24.897368 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebb34a-423c-4255-aac9-79d17572f178 admin admin] PATH_INFO: `/v3/projects/af621d04dda4452a90902aabb22b2a68` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:24.898454 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebb34a-423c-4255-aac9-79d17572f178 admin admin] RBAC: Authorizing `identity:get_project(project_id=af621d04dda4452a90902aabb22b2a68)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:24.900464 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebb34a-423c-4255-aac9-79d17572f178 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:24.902000 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 554/1108] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:27:24 2021] GET /identity/v3/projects/af621d04dda4452a90902aabb22b2a68 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:24.907508 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd837a-f76e-4507-bd2c-81cec77e6264 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:24.916608 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd837a-f76e-4507-bd2c-81cec77e6264 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:24.921316 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31b0fd-4055-4c55-8760-535069dd0e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:24.922113 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31b0fd-4055-4c55-8760-535069dd0e3c admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:24.922406 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31b0fd-4055-4c55-8760-535069dd0e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:24.922693 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31b0fd-4055-4c55-8760-535069dd0e3c admin admin] PATH_INFO: `/v3/projects/af621d04dda4452a90902aabb22b2a68/users/239000e6ed9c40b0a9286844cf26dc87/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:24.924475 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31b0fd-4055-4c55-8760-535069dd0e3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=af621d04dda4452a90902aabb22b2a68, user_id=239000e6ed9c40b0a9286844cf26dc87, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:24.927187 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31b0fd-4055-4c55-8760-535069dd0e3c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:24.940085 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 555/1109] 10.222.0.64 () {58 vars in 1460 bytes} [Thu Dec 16 14:27:24 2021] PUT /identity/v3/projects/af621d04dda4452a90902aabb22b2a68/users/239000e6ed9c40b0a9286844cf26dc87/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:27:26.983916 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712f0ff-d4cf-49d5-8954-4f23dbb5a39d None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:26.984439 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712f0ff-d4cf-49d5-8954-4f23dbb5a39d None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:26.984551 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712f0ff-d4cf-49d5-8954-4f23dbb5a39d None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:26.986340 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 555/1110] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:27:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:27:26.991949 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffabe0b-6a4f-4f86-88d9-b62fabe3b008 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:26.992529 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffabe0b-6a4f-4f86-88d9-b62fabe3b008 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:26.992529 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffabe0b-6a4f-4f86-88d9-b62fabe3b008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:27.014201 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-cffabe0b-6a4f-4f86-88d9-b62fabe3b008 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:27:27.016202 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-cffabe0b-6a4f-4f86-88d9-b62fabe3b008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:27:27.082014 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 556/1111] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:27:26 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:27:27.105231 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712f0ff-d4cf-49d5-8954-4f23dbb5a39d None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:27.117174 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712f0ff-d4cf-49d5-8954-4f23dbb5a39d None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:27.121541 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a1a0a-1d2b-47f6-88cb-37d0458f8a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:27.122254 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a1a0a-1d2b-47f6-88cb-37d0458f8a3d admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:27.122544 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a1a0a-1d2b-47f6-88cb-37d0458f8a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:27.122825 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a1a0a-1d2b-47f6-88cb-37d0458f8a3d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:27.135212 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a1a0a-1d2b-47f6-88cb-37d0458f8a3d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:27:27.142250 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-e18a1a0a-1d2b-47f6-88cb-37d0458f8a3d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:27:27.143401 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 556/1112] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:27:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:27:27.149651 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffabe0b-6a4f-4f86-88d9-b62fabe3b008 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:27.158557 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffabe0b-6a4f-4f86-88d9-b62fabe3b008 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:27.163327 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fdb02-e0e0-45de-8f8e-6d9b1e2204da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:27.163925 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fdb02-e0e0-45de-8f8e-6d9b1e2204da admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:27.164214 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fdb02-e0e0-45de-8f8e-6d9b1e2204da admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:27.164494 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fdb02-e0e0-45de-8f8e-6d9b1e2204da admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:27.165264 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fdb02-e0e0-45de-8f8e-6d9b1e2204da admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:27:27.165561 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fdb02-e0e0-45de-8f8e-6d9b1e2204da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:27.167154 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fdb02-e0e0-45de-8f8e-6d9b1e2204da admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:27.176355 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 557/1113] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:27:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:27.182328 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a1a0a-1d2b-47f6-88cb-37d0458f8a3d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:27.192473 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a1a0a-1d2b-47f6-88cb-37d0458f8a3d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:27.196757 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a2187-1d1a-4621-9bdb-28c074d47c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:27.197573 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a2187-1d1a-4621-9bdb-28c074d47c03 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:27.197868 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a2187-1d1a-4621-9bdb-28c074d47c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:27.198156 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a2187-1d1a-4621-9bdb-28c074d47c03 admin admin] PATH_INFO: `/v3/users/239000e6ed9c40b0a9286844cf26dc87` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:27.199251 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a2187-1d1a-4621-9bdb-28c074d47c03 admin admin] RBAC: Authorizing `identity:get_user(user_id=239000e6ed9c40b0a9286844cf26dc87)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:27.201397 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a2187-1d1a-4621-9bdb-28c074d47c03 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:27.203493 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 557/1114] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:27:27 2021] GET /identity/v3/users/239000e6ed9c40b0a9286844cf26dc87 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:27.209026 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fdb02-e0e0-45de-8f8e-6d9b1e2204da admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:27.218291 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fdb02-e0e0-45de-8f8e-6d9b1e2204da admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:27.222571 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb8eda-371a-48de-8ad0-af6f41c9bbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:27.223141 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb8eda-371a-48de-8ad0-af6f41c9bbcb admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:27.223438 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb8eda-371a-48de-8ad0-af6f41c9bbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:27.223721 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb8eda-371a-48de-8ad0-af6f41c9bbcb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:27.231410 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb8eda-371a-48de-8ad0-af6f41c9bbcb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:27.233189 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb8eda-371a-48de-8ad0-af6f41c9bbcb admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:27.241887 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 558/1115] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:27:27 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:27:27.247929 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a2187-1d1a-4621-9bdb-28c074d47c03 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:27.257685 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a2187-1d1a-4621-9bdb-28c074d47c03 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:27.261940 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de304b-8832-40f3-8826-966184c64a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:27.262717 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de304b-8832-40f3-8826-966184c64a6b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:27.263011 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de304b-8832-40f3-8826-966184c64a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:27.263298 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de304b-8832-40f3-8826-966184c64a6b admin admin] PATH_INFO: `/v3/projects/af621d04dda4452a90902aabb22b2a68` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:27.264395 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de304b-8832-40f3-8826-966184c64a6b admin admin] RBAC: Authorizing `identity:get_project(project_id=af621d04dda4452a90902aabb22b2a68)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:27.267017 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de304b-8832-40f3-8826-966184c64a6b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:27.268562 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 558/1116] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:27:27 2021] GET /identity/v3/projects/af621d04dda4452a90902aabb22b2a68 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:27.274580 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb8eda-371a-48de-8ad0-af6f41c9bbcb admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:27.283145 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb8eda-371a-48de-8ad0-af6f41c9bbcb admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:27.287425 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ce311-9803-4967-8063-1d713263c010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:27.287993 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ce311-9803-4967-8063-1d713263c010 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:27.288279 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ce311-9803-4967-8063-1d713263c010 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:27.288564 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ce311-9803-4967-8063-1d713263c010 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:27.289378 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ce311-9803-4967-8063-1d713263c010 admin admin] RBAC: Adding query filter params (role.id=90166eb3dcfa41e58450e140b8b0fea3, scope.project.id=af621d04dda4452a90902aabb22b2a68, user.id=239000e6ed9c40b0a9286844cf26dc87) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:27:27.289682 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ce311-9803-4967-8063-1d713263c010 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:27.291500 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ce311-9803-4967-8063-1d713263c010 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:27:27.297111 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 559/1117] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:27:27 2021] GET /identity/v3/role_assignments?user.id=239000e6ed9c40b0a9286844cf26dc87&scope.project.id=af621d04dda4452a90902aabb22b2a68&role.id=90166eb3dcfa41e58450e140b8b0fea3 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:01.837503 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab8d92-1097-4ddc-98ea-1a1db819cfc4 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:01.838103 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab8d92-1097-4ddc-98ea-1a1db819cfc4 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:01.838103 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab8d92-1097-4ddc-98ea-1a1db819cfc4 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:01.840388 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 559/1118] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:29:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:01.846357 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0e70c-c757-44d0-b5b9-4055d3724368 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:01.846848 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0e70c-c757-44d0-b5b9-4055d3724368 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:01.847227 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0e70c-c757-44d0-b5b9-4055d3724368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:01.868845 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-e5d0e70c-c757-44d0-b5b9-4055d3724368 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:01.870485 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e5d0e70c-c757-44d0-b5b9-4055d3724368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:01.877495 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 560/1119] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:29:01 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:29:01.902214 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab8d92-1097-4ddc-98ea-1a1db819cfc4 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:01.913786 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab8d92-1097-4ddc-98ea-1a1db819cfc4 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:01.917836 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971cf86-6646-48e1-af74-76e15f0e9185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:01.918531 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971cf86-6646-48e1-af74-76e15f0e9185 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:01.918816 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971cf86-6646-48e1-af74-76e15f0e9185 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:01.919094 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971cf86-6646-48e1-af74-76e15f0e9185 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:01.930680 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971cf86-6646-48e1-af74-76e15f0e9185 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:01.933021 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971cf86-6646-48e1-af74-76e15f0e9185 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:01.949766 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-c971cf86-6646-48e1-af74-76e15f0e9185 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:29:01.950819 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 560/1120] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:29:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:01.956805 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0e70c-c757-44d0-b5b9-4055d3724368 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:01.965498 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0e70c-c757-44d0-b5b9-4055d3724368 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:01.969792 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adca77c-f7a5-46f0-8054-a3681e8128d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:01.970383 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adca77c-f7a5-46f0-8054-a3681e8128d6 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:01.970679 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adca77c-f7a5-46f0-8054-a3681e8128d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:01.970967 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adca77c-f7a5-46f0-8054-a3681e8128d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:01.971667 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adca77c-f7a5-46f0-8054-a3681e8128d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:01.971965 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adca77c-f7a5-46f0-8054-a3681e8128d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:01.973585 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adca77c-f7a5-46f0-8054-a3681e8128d6 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:01.985569 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 561/1121] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:29:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:01.991122 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971cf86-6646-48e1-af74-76e15f0e9185 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:02.000841 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971cf86-6646-48e1-af74-76e15f0e9185 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:02.005021 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfb150-e148-4cff-9018-8a9ba640f16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:02.005595 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfb150-e148-4cff-9018-8a9ba640f16e admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:02.005881 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfb150-e148-4cff-9018-8a9ba640f16e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:02.006159 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfb150-e148-4cff-9018-8a9ba640f16e admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:02.006790 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dfb150-e148-4cff-9018-8a9ba640f16e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:02.008631 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dfb150-e148-4cff-9018-8a9ba640f16e admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:02.028255 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 561/1122] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Dec 16 14:29:01 2021] POST /identity/v3/users => generated 251 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:29:04.099609 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff44cd-85f8-47e9-9762-89fe67e2ddee None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:04.100154 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff44cd-85f8-47e9-9762-89fe67e2ddee None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:04.100154 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff44cd-85f8-47e9-9762-89fe67e2ddee None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:04.101894 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 562/1123] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:29:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:04.107178 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68148687-d6da-49a1-9026-2d57897520ad None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:04.107586 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68148687-d6da-49a1-9026-2d57897520ad None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:04.107681 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68148687-d6da-49a1-9026-2d57897520ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:04.131292 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-68148687-d6da-49a1-9026-2d57897520ad None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:04.132414 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-68148687-d6da-49a1-9026-2d57897520ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:04.140137 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 562/1124] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:29:04 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:29:04.162634 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff44cd-85f8-47e9-9762-89fe67e2ddee None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:04.174259 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff44cd-85f8-47e9-9762-89fe67e2ddee None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:04.178331 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a3473-20fa-478c-8a53-3e795ce990a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:04.179031 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a3473-20fa-478c-8a53-3e795ce990a1 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:04.179570 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a3473-20fa-478c-8a53-3e795ce990a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:04.179850 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a3473-20fa-478c-8a53-3e795ce990a1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:04.191176 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a3473-20fa-478c-8a53-3e795ce990a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:29:04.197459 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-537a3473-20fa-478c-8a53-3e795ce990a1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:29:04.199117 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 563/1125] 10.222.0.64 () {56 vars in 1123 bytes} [Thu Dec 16 14:29:04 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:04.205097 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68148687-d6da-49a1-9026-2d57897520ad None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:04.213610 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68148687-d6da-49a1-9026-2d57897520ad None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:04.217862 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0eb71-3cc5-4e28-9587-b77be8575821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:04.218444 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0eb71-3cc5-4e28-9587-b77be8575821 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:04.218729 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0eb71-3cc5-4e28-9587-b77be8575821 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:04.219010 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0eb71-3cc5-4e28-9587-b77be8575821 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:04.219710 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0eb71-3cc5-4e28-9587-b77be8575821 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:04.220005 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0eb71-3cc5-4e28-9587-b77be8575821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:04.221620 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0eb71-3cc5-4e28-9587-b77be8575821 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:04.229765 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 563/1126] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Dec 16 14:29:04 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:29:04.237121 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a3473-20fa-478c-8a53-3e795ce990a1 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:04.245918 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a3473-20fa-478c-8a53-3e795ce990a1 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:04.250226 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad54d5-454a-4dbb-bdb3-dc61d7e14a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:04.250929 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad54d5-454a-4dbb-bdb3-dc61d7e14a4e admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:04.251220 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad54d5-454a-4dbb-bdb3-dc61d7e14a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:04.251507 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad54d5-454a-4dbb-bdb3-dc61d7e14a4e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:04.263497 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad54d5-454a-4dbb-bdb3-dc61d7e14a4e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:04.265439 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad54d5-454a-4dbb-bdb3-dc61d7e14a4e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:04.282358 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-1cad54d5-454a-4dbb-bdb3-dc61d7e14a4e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:29:04.283433 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 564/1127] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:29:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:04.289334 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0eb71-3cc5-4e28-9587-b77be8575821 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:04.298571 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0eb71-3cc5-4e28-9587-b77be8575821 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:04.302844 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b14844-42fc-4122-898a-0c38c71e2695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:04.303430 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b14844-42fc-4122-898a-0c38c71e2695 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:04.303723 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b14844-42fc-4122-898a-0c38c71e2695 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:04.304009 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b14844-42fc-4122-898a-0c38c71e2695 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:04.304986 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b14844-42fc-4122-898a-0c38c71e2695 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:04.305290 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b14844-42fc-4122-898a-0c38c71e2695 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:04.306854 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b14844-42fc-4122-898a-0c38c71e2695 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:04.319425 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 564/1128] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:29:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:04.325510 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad54d5-454a-4dbb-bdb3-dc61d7e14a4e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:04.334563 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad54d5-454a-4dbb-bdb3-dc61d7e14a4e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:04.338809 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b06d12-a730-43eb-bc9e-aaaf38204899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:04.339506 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b06d12-a730-43eb-bc9e-aaaf38204899 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:04.339793 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b06d12-a730-43eb-bc9e-aaaf38204899 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:04.340074 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b06d12-a730-43eb-bc9e-aaaf38204899 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:04.352234 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b06d12-a730-43eb-bc9e-aaaf38204899 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:04.354245 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b06d12-a730-43eb-bc9e-aaaf38204899 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:04.372966 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-58b06d12-a730-43eb-bc9e-aaaf38204899 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 16 14:29:04.373996 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 565/1129] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:29:04 2021] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:04.379789 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b14844-42fc-4122-898a-0c38c71e2695 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:04.390402 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b14844-42fc-4122-898a-0c38c71e2695 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:04.394798 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18c469-91a0-4260-8fc3-97c0f4adc501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:04.395387 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18c469-91a0-4260-8fc3-97c0f4adc501 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:04.395679 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18c469-91a0-4260-8fc3-97c0f4adc501 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:04.395967 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18c469-91a0-4260-8fc3-97c0f4adc501 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:04.396748 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18c469-91a0-4260-8fc3-97c0f4adc501 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:04.397088 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18c469-91a0-4260-8fc3-97c0f4adc501 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:04.398904 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18c469-91a0-4260-8fc3-97c0f4adc501 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:04.426485 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 565/1130] 10.222.0.64 () {56 vars in 1164 bytes} [Thu Dec 16 14:29:04 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:04.432998 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b06d12-a730-43eb-bc9e-aaaf38204899 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:04.442329 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b06d12-a730-43eb-bc9e-aaaf38204899 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:04.446569 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb3645-5603-408c-b409-7886a88ce058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:04.447155 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb3645-5603-408c-b409-7886a88ce058 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:04.447445 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb3645-5603-408c-b409-7886a88ce058 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:04.448354 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb3645-5603-408c-b409-7886a88ce058 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:04.455859 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb3645-5603-408c-b409-7886a88ce058 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:04.457633 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb3645-5603-408c-b409-7886a88ce058 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:04.466388 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 566/1131] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:29:04 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:29:04.471929 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18c469-91a0-4260-8fc3-97c0f4adc501 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:04.481685 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18c469-91a0-4260-8fc3-97c0f4adc501 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:04.485944 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297e258-3da9-4269-aa72-8818d1abf7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:04.486648 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297e258-3da9-4269-aa72-8818d1abf7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:04.486942 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297e258-3da9-4269-aa72-8818d1abf7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:04.487227 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297e258-3da9-4269-aa72-8818d1abf7a7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:04.499439 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297e258-3da9-4269-aa72-8818d1abf7a7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:04.501400 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297e258-3da9-4269-aa72-8818d1abf7a7 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:04.517791 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-f297e258-3da9-4269-aa72-8818d1abf7a7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:29:04.518840 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 566/1132] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:29:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:04.524369 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb3645-5603-408c-b409-7886a88ce058 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:04.532760 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb3645-5603-408c-b409-7886a88ce058 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:04.537208 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e658d79-c25d-4146-b0ef-fb144c21feb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:04.537786 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e658d79-c25d-4146-b0ef-fb144c21feb2 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:04.538075 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e658d79-c25d-4146-b0ef-fb144c21feb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:04.538361 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e658d79-c25d-4146-b0ef-fb144c21feb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:04.539044 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e658d79-c25d-4146-b0ef-fb144c21feb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:04.539345 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e658d79-c25d-4146-b0ef-fb144c21feb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:04.540938 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e658d79-c25d-4146-b0ef-fb144c21feb2 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:04.553561 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 567/1133] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:29:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:04.559877 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297e258-3da9-4269-aa72-8818d1abf7a7 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:04.569186 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297e258-3da9-4269-aa72-8818d1abf7a7 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:04.573482 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc06b5f-9848-435c-a767-48ec11568513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:04.574177 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc06b5f-9848-435c-a767-48ec11568513 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:04.574474 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc06b5f-9848-435c-a767-48ec11568513 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:04.574761 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc06b5f-9848-435c-a767-48ec11568513 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:04.583094 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc06b5f-9848-435c-a767-48ec11568513 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:04.585241 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc06b5f-9848-435c-a767-48ec11568513 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:04.598444 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-ffc06b5f-9848-435c-a767-48ec11568513 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:29:04.599500 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 567/1134] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:29:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:04.605900 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e658d79-c25d-4146-b0ef-fb144c21feb2 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:04.615133 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e658d79-c25d-4146-b0ef-fb144c21feb2 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:04.619401 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75fd26-b695-42fe-94d4-a68c1ab961d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:04.620526 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75fd26-b695-42fe-94d4-a68c1ab961d2 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:04.620845 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75fd26-b695-42fe-94d4-a68c1ab961d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:04.621132 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75fd26-b695-42fe-94d4-a68c1ab961d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:04.621879 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75fd26-b695-42fe-94d4-a68c1ab961d2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:04.622186 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75fd26-b695-42fe-94d4-a68c1ab961d2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:04.624078 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75fd26-b695-42fe-94d4-a68c1ab961d2 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:04.636671 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 568/1135] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:29:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:04.642773 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc06b5f-9848-435c-a767-48ec11568513 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:04.651883 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc06b5f-9848-435c-a767-48ec11568513 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:04.656017 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c63388-0de8-469b-91e8-b3d25b72404a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:04.656576 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c63388-0de8-469b-91e8-b3d25b72404a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:04.656891 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c63388-0de8-469b-91e8-b3d25b72404a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:04.657174 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c63388-0de8-469b-91e8-b3d25b72404a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:04.657937 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c63388-0de8-469b-91e8-b3d25b72404a admin admin] RBAC: Adding query filter params (role.id=07f29be2087e43caaf6845ecf113b6e7, scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55, user.id=0e9a2114d29c4edeb20f394140d390bb) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:04.658238 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c63388-0de8-469b-91e8-b3d25b72404a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:04.660026 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c63388-0de8-469b-91e8-b3d25b72404a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:04.665235 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 568/1136] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:29:04 2021] GET /identity/v3/role_assignments?user.id=0e9a2114d29c4edeb20f394140d390bb&scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55&role.id=07f29be2087e43caaf6845ecf113b6e7 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:06.775188 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95850f6-0b0e-446f-8cc7-00e728dd6550 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:06.775742 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95850f6-0b0e-446f-8cc7-00e728dd6550 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:06.776041 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95850f6-0b0e-446f-8cc7-00e728dd6550 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:06.778501 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 569/1137] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:29:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:06.786369 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e175ec-d6fd-40cc-967d-bd6da6807161 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:06.786891 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e175ec-d6fd-40cc-967d-bd6da6807161 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:06.787327 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e175ec-d6fd-40cc-967d-bd6da6807161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:06.815994 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-e1e175ec-d6fd-40cc-967d-bd6da6807161 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:06.817168 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e1e175ec-d6fd-40cc-967d-bd6da6807161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:06.824706 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 569/1138] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:29:06 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:29:06.847196 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95850f6-0b0e-446f-8cc7-00e728dd6550 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:06.859631 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95850f6-0b0e-446f-8cc7-00e728dd6550 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:06.863712 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4d57a-2b60-486d-a3db-1648b6618efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:06.864425 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4d57a-2b60-486d-a3db-1648b6618efa admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:06.864717 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4d57a-2b60-486d-a3db-1648b6618efa admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:06.865038 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4d57a-2b60-486d-a3db-1648b6618efa admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:06.877200 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4d57a-2b60-486d-a3db-1648b6618efa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:29:06.883578 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-aee4d57a-2b60-486d-a3db-1648b6618efa admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:29:06.884692 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 570/1139] 10.222.0.64 () {56 vars in 1123 bytes} [Thu Dec 16 14:29:06 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:06.890919 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e175ec-d6fd-40cc-967d-bd6da6807161 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:06.900357 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e175ec-d6fd-40cc-967d-bd6da6807161 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:06.904953 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca00a8a-7e3f-481a-af88-1743e057b490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:06.905619 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca00a8a-7e3f-481a-af88-1743e057b490 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:06.905861 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca00a8a-7e3f-481a-af88-1743e057b490 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:06.906151 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca00a8a-7e3f-481a-af88-1743e057b490 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:06.906881 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca00a8a-7e3f-481a-af88-1743e057b490 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:06.907185 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca00a8a-7e3f-481a-af88-1743e057b490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:06.908802 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca00a8a-7e3f-481a-af88-1743e057b490 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:06.918438 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 570/1140] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Dec 16 14:29:06 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:06.924439 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4d57a-2b60-486d-a3db-1648b6618efa admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:06.935591 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4d57a-2b60-486d-a3db-1648b6618efa admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:06.940120 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc7b13-1515-4568-85f8-0d86c3141d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:06.940891 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc7b13-1515-4568-85f8-0d86c3141d85 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:06.941184 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc7b13-1515-4568-85f8-0d86c3141d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:06.941471 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc7b13-1515-4568-85f8-0d86c3141d85 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:06.953678 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc7b13-1515-4568-85f8-0d86c3141d85 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:06.955531 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc7b13-1515-4568-85f8-0d86c3141d85 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:06.972891 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-12dc7b13-1515-4568-85f8-0d86c3141d85 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:29:06.974008 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 571/1141] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:29:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:06.980365 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca00a8a-7e3f-481a-af88-1743e057b490 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:06.989597 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca00a8a-7e3f-481a-af88-1743e057b490 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:06.993824 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f24da-239a-4e14-8acc-cf4a65bde082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:06.995008 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f24da-239a-4e14-8acc-cf4a65bde082 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:06.995293 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f24da-239a-4e14-8acc-cf4a65bde082 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:06.995572 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f24da-239a-4e14-8acc-cf4a65bde082 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:06.996246 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f24da-239a-4e14-8acc-cf4a65bde082 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:06.996541 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f24da-239a-4e14-8acc-cf4a65bde082 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:06.998157 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f24da-239a-4e14-8acc-cf4a65bde082 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:07.010945 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 571/1142] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:29:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:07.017422 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc7b13-1515-4568-85f8-0d86c3141d85 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:07.028108 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc7b13-1515-4568-85f8-0d86c3141d85 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:07.032345 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d38f17-4dc1-4783-a724-38ca84a835ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:07.033104 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d38f17-4dc1-4783-a724-38ca84a835ec admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:07.033399 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d38f17-4dc1-4783-a724-38ca84a835ec admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:07.033686 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d38f17-4dc1-4783-a724-38ca84a835ec admin admin] PATH_INFO: `/v3/users/placement` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:07.046400 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d38f17-4dc1-4783-a724-38ca84a835ec admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:07.048427 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d38f17-4dc1-4783-a724-38ca84a835ec admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:07.066266 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-f3d38f17-4dc1-4783-a724-38ca84a835ec admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 16 14:29:07.067352 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 572/1143] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:29:07 2021] GET /identity/v3/users/placement => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:07.074016 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f24da-239a-4e14-8acc-cf4a65bde082 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:07.083280 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f24da-239a-4e14-8acc-cf4a65bde082 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:07.087766 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff3af2-6626-4eb4-935a-15c72b4fb61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:07.089033 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff3af2-6626-4eb4-935a-15c72b4fb61e admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:07.089326 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff3af2-6626-4eb4-935a-15c72b4fb61e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:07.089610 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff3af2-6626-4eb4-935a-15c72b4fb61e admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:07.090392 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff3af2-6626-4eb4-935a-15c72b4fb61e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:07.090694 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff3af2-6626-4eb4-935a-15c72b4fb61e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:07.092509 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff3af2-6626-4eb4-935a-15c72b4fb61e admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:07.120510 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 572/1144] 10.222.0.64 () {56 vars in 1164 bytes} [Thu Dec 16 14:29:07 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:07.126115 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d38f17-4dc1-4783-a724-38ca84a835ec admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:07.136024 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d38f17-4dc1-4783-a724-38ca84a835ec admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:07.140284 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29710d20-533a-4a5d-906c-04834ab03a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:07.141027 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29710d20-533a-4a5d-906c-04834ab03a8c admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:07.141319 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29710d20-533a-4a5d-906c-04834ab03a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:07.141602 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29710d20-533a-4a5d-906c-04834ab03a8c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:07.154666 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29710d20-533a-4a5d-906c-04834ab03a8c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:07.156497 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29710d20-533a-4a5d-906c-04834ab03a8c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:07.172843 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-29710d20-533a-4a5d-906c-04834ab03a8c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:29:07.173911 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 573/1145] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:29:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:29:07.180011 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff3af2-6626-4eb4-935a-15c72b4fb61e admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:07.189725 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff3af2-6626-4eb4-935a-15c72b4fb61e admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:07.193941 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e1f92-56ef-4ee5-853c-1ff1aff72d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:07.194521 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e1f92-56ef-4ee5-853c-1ff1aff72d75 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:07.194810 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e1f92-56ef-4ee5-853c-1ff1aff72d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:07.195092 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e1f92-56ef-4ee5-853c-1ff1aff72d75 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:07.195776 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e1f92-56ef-4ee5-853c-1ff1aff72d75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:07.196074 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e1f92-56ef-4ee5-853c-1ff1aff72d75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:07.198294 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e1f92-56ef-4ee5-853c-1ff1aff72d75 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:07.210269 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 573/1146] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:29:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:07.215960 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29710d20-533a-4a5d-906c-04834ab03a8c admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:07.226334 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29710d20-533a-4a5d-906c-04834ab03a8c admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:07.230518 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bf93a-6af5-4bcd-b7d7-099d7f122b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:07.231227 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bf93a-6af5-4bcd-b7d7-099d7f122b36 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:07.231515 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bf93a-6af5-4bcd-b7d7-099d7f122b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:07.231792 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bf93a-6af5-4bcd-b7d7-099d7f122b36 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:07.240312 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bf93a-6af5-4bcd-b7d7-099d7f122b36 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:07.242278 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bf93a-6af5-4bcd-b7d7-099d7f122b36 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:07.255992 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-fb5bf93a-6af5-4bcd-b7d7-099d7f122b36 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:29:07.257101 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 574/1147] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:29:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:07.264973 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e1f92-56ef-4ee5-853c-1ff1aff72d75 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:07.274389 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e1f92-56ef-4ee5-853c-1ff1aff72d75 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:07.280414 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead4c8f-cdf8-439e-97a7-0881f4bef7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:07.280981 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead4c8f-cdf8-439e-97a7-0881f4bef7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:07.281278 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead4c8f-cdf8-439e-97a7-0881f4bef7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:07.281567 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead4c8f-cdf8-439e-97a7-0881f4bef7c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:07.282321 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead4c8f-cdf8-439e-97a7-0881f4bef7c7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:07.282630 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead4c8f-cdf8-439e-97a7-0881f4bef7c7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:07.284460 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead4c8f-cdf8-439e-97a7-0881f4bef7c7 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:07.297531 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 574/1148] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:29:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:07.303674 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bf93a-6af5-4bcd-b7d7-099d7f122b36 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:07.314018 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bf93a-6af5-4bcd-b7d7-099d7f122b36 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:07.318334 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34d4bf-97a0-400b-9bb1-a68596e3df9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:07.319153 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34d4bf-97a0-400b-9bb1-a68596e3df9b admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:07.319478 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34d4bf-97a0-400b-9bb1-a68596e3df9b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:07.319802 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34d4bf-97a0-400b-9bb1-a68596e3df9b admin admin] PATH_INFO: `/v3/projects/244c8ef98d0445c6a0279c46d5cb7e55/users/0e9a2114d29c4edeb20f394140d390bb/roles/07f29be2087e43caaf6845ecf113b6e7` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:07.340003 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34d4bf-97a0-400b-9bb1-a68596e3df9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=244c8ef98d0445c6a0279c46d5cb7e55, user_id=0e9a2114d29c4edeb20f394140d390bb, role_id=07f29be2087e43caaf6845ecf113b6e7)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:07.342669 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34d4bf-97a0-400b-9bb1-a68596e3df9b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:07.355988 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 575/1149] 10.222.0.64 () {58 vars in 1460 bytes} [Thu Dec 16 14:29:07 2021] PUT /identity/v3/projects/244c8ef98d0445c6a0279c46d5cb7e55/users/0e9a2114d29c4edeb20f394140d390bb/roles/07f29be2087e43caaf6845ecf113b6e7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:29:09.425461 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee5335-36e0-4aa8-bda3-82e5d2e60178 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:09.426017 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee5335-36e0-4aa8-bda3-82e5d2e60178 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:09.426017 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee5335-36e0-4aa8-bda3-82e5d2e60178 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:09.427696 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 575/1150] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:29:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:09.433275 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c23f15-7bb9-415e-b900-830db7eed4fa None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:09.433675 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c23f15-7bb9-415e-b900-830db7eed4fa None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:09.433832 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c23f15-7bb9-415e-b900-830db7eed4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:09.455295 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-e8c23f15-7bb9-415e-b900-830db7eed4fa None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:09.456431 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e8c23f15-7bb9-415e-b900-830db7eed4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:09.519577 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 576/1151] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:29:09 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:29:09.543694 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee5335-36e0-4aa8-bda3-82e5d2e60178 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:09.555689 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee5335-36e0-4aa8-bda3-82e5d2e60178 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:09.559747 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f0e6d-a5f5-4f74-abcb-92d7cbd5bc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:09.560449 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f0e6d-a5f5-4f74-abcb-92d7cbd5bc8f admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:09.560735 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f0e6d-a5f5-4f74-abcb-92d7cbd5bc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:09.561082 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f0e6d-a5f5-4f74-abcb-92d7cbd5bc8f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:09.571817 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f0e6d-a5f5-4f74-abcb-92d7cbd5bc8f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:29:09.578019 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-1e0f0e6d-a5f5-4f74-abcb-92d7cbd5bc8f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:29:09.579084 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 576/1152] 10.222.0.64 () {56 vars in 1123 bytes} [Thu Dec 16 14:29:09 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:09.585488 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c23f15-7bb9-415e-b900-830db7eed4fa None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:09.594875 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c23f15-7bb9-415e-b900-830db7eed4fa None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:09.599197 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec551d5-7893-4b1c-af96-59d37d11fbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:09.599793 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec551d5-7893-4b1c-af96-59d37d11fbcd admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:09.600085 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec551d5-7893-4b1c-af96-59d37d11fbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:09.600372 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec551d5-7893-4b1c-af96-59d37d11fbcd admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:09.601133 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec551d5-7893-4b1c-af96-59d37d11fbcd admin admin] RBAC: Adding query filter params (name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:09.601438 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec551d5-7893-4b1c-af96-59d37d11fbcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:09.603035 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec551d5-7893-4b1c-af96-59d37d11fbcd admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:09.612493 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 577/1153] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Dec 16 14:29:09 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:09.618182 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f0e6d-a5f5-4f74-abcb-92d7cbd5bc8f admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:09.630427 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f0e6d-a5f5-4f74-abcb-92d7cbd5bc8f admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:09.634690 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e2253-bc75-4988-b473-d63719db811a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:09.635387 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e2253-bc75-4988-b473-d63719db811a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:09.635670 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e2253-bc75-4988-b473-d63719db811a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:09.635948 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e2253-bc75-4988-b473-d63719db811a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:09.646917 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e2253-bc75-4988-b473-d63719db811a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:09.648690 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e2253-bc75-4988-b473-d63719db811a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:09.665590 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-496e2253-bc75-4988-b473-d63719db811a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:29:09.667283 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 577/1154] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:29:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:09.673222 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec551d5-7893-4b1c-af96-59d37d11fbcd admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:09.682801 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec551d5-7893-4b1c-af96-59d37d11fbcd admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:09.687179 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16fa64-9401-4da7-a94c-2765b62a705b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:09.687760 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16fa64-9401-4da7-a94c-2765b62a705b admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:09.688053 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16fa64-9401-4da7-a94c-2765b62a705b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:09.688341 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16fa64-9401-4da7-a94c-2765b62a705b admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:09.689069 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16fa64-9401-4da7-a94c-2765b62a705b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:09.689378 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16fa64-9401-4da7-a94c-2765b62a705b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:09.690958 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16fa64-9401-4da7-a94c-2765b62a705b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:09.703199 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 578/1155] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:29:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:09.708735 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e2253-bc75-4988-b473-d63719db811a admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:09.718451 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e2253-bc75-4988-b473-d63719db811a admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:09.722672 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60689e-6827-4e8b-838d-1076f1bc6ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:09.723381 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60689e-6827-4e8b-838d-1076f1bc6ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:09.723668 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60689e-6827-4e8b-838d-1076f1bc6ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:09.723948 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60689e-6827-4e8b-838d-1076f1bc6ac4 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:09.736978 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60689e-6827-4e8b-838d-1076f1bc6ac4 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:09.738936 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60689e-6827-4e8b-838d-1076f1bc6ac4 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:09.756042 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-fa60689e-6827-4e8b-838d-1076f1bc6ac4 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 16 14:29:09.757139 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 578/1156] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:29:09 2021] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:29:09.763501 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16fa64-9401-4da7-a94c-2765b62a705b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:09.772983 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16fa64-9401-4da7-a94c-2765b62a705b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:09.777907 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593430a-c22c-40fd-ac91-299f18c2e43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:09.778500 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593430a-c22c-40fd-ac91-299f18c2e43c admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:09.778790 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593430a-c22c-40fd-ac91-299f18c2e43c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:09.779076 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593430a-c22c-40fd-ac91-299f18c2e43c admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:09.779869 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593430a-c22c-40fd-ac91-299f18c2e43c admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:09.780177 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593430a-c22c-40fd-ac91-299f18c2e43c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:09.782153 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593430a-c22c-40fd-ac91-299f18c2e43c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:09.810064 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 579/1157] 10.222.0.64 () {56 vars in 1164 bytes} [Thu Dec 16 14:29:09 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:09.815725 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60689e-6827-4e8b-838d-1076f1bc6ac4 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:09.825517 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60689e-6827-4e8b-838d-1076f1bc6ac4 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:09.829676 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c528ca-2190-41e8-8ab3-041e99f8db9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:09.830283 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c528ca-2190-41e8-8ab3-041e99f8db9d admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:09.830576 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c528ca-2190-41e8-8ab3-041e99f8db9d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:09.830855 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c528ca-2190-41e8-8ab3-041e99f8db9d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:09.839055 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c528ca-2190-41e8-8ab3-041e99f8db9d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:09.840746 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c528ca-2190-41e8-8ab3-041e99f8db9d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:09.849830 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 579/1158] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:29:09 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:29:09.855499 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593430a-c22c-40fd-ac91-299f18c2e43c admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:09.864652 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593430a-c22c-40fd-ac91-299f18c2e43c admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:09.868885 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf0878-7d1f-4e69-8d10-6b29efa0c187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:09.869592 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf0878-7d1f-4e69-8d10-6b29efa0c187 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:09.869876 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf0878-7d1f-4e69-8d10-6b29efa0c187 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:09.870155 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf0878-7d1f-4e69-8d10-6b29efa0c187 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:09.881276 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf0878-7d1f-4e69-8d10-6b29efa0c187 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:09.883132 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf0878-7d1f-4e69-8d10-6b29efa0c187 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:09.899732 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-5ddf0878-7d1f-4e69-8d10-6b29efa0c187 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:29:09.901413 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 580/1159] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:29:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:09.907312 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c528ca-2190-41e8-8ab3-041e99f8db9d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:09.915779 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c528ca-2190-41e8-8ab3-041e99f8db9d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:09.920131 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62140fcc-802b-4f5d-a4be-e33e6f55b762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:09.920734 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62140fcc-802b-4f5d-a4be-e33e6f55b762 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:09.921068 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62140fcc-802b-4f5d-a4be-e33e6f55b762 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:09.921379 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62140fcc-802b-4f5d-a4be-e33e6f55b762 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:09.922081 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62140fcc-802b-4f5d-a4be-e33e6f55b762 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:09.922383 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62140fcc-802b-4f5d-a4be-e33e6f55b762 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:09.923937 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62140fcc-802b-4f5d-a4be-e33e6f55b762 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:09.936401 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 580/1160] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:29:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:09.941659 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf0878-7d1f-4e69-8d10-6b29efa0c187 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:09.951342 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf0878-7d1f-4e69-8d10-6b29efa0c187 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:09.955619 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32ba45-e5a1-4df1-8d1a-4c4b90129c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:09.956326 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32ba45-e5a1-4df1-8d1a-4c4b90129c24 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:09.956613 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32ba45-e5a1-4df1-8d1a-4c4b90129c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:09.956936 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32ba45-e5a1-4df1-8d1a-4c4b90129c24 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:09.965932 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32ba45-e5a1-4df1-8d1a-4c4b90129c24 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:09.967883 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32ba45-e5a1-4df1-8d1a-4c4b90129c24 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:09.981123 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-8d32ba45-e5a1-4df1-8d1a-4c4b90129c24 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:29:09.982175 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 581/1161] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:29:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:09.987893 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62140fcc-802b-4f5d-a4be-e33e6f55b762 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:09.997214 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62140fcc-802b-4f5d-a4be-e33e6f55b762 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:10.001567 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3baf623-33a8-4575-931c-339d68b82db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:10.002179 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3baf623-33a8-4575-931c-339d68b82db9 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:10.002476 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3baf623-33a8-4575-931c-339d68b82db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:10.002763 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3baf623-33a8-4575-931c-339d68b82db9 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:10.003500 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3baf623-33a8-4575-931c-339d68b82db9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:10.003808 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3baf623-33a8-4575-931c-339d68b82db9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:10.005669 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3baf623-33a8-4575-931c-339d68b82db9 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:10.018596 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 581/1162] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:29:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:10.024505 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32ba45-e5a1-4df1-8d1a-4c4b90129c24 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:10.034459 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32ba45-e5a1-4df1-8d1a-4c4b90129c24 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:10.038706 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406c7cc-78c7-41a1-9105-6e3880f98d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:10.039279 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406c7cc-78c7-41a1-9105-6e3880f98d49 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:10.039570 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406c7cc-78c7-41a1-9105-6e3880f98d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:10.039853 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406c7cc-78c7-41a1-9105-6e3880f98d49 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:10.040630 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406c7cc-78c7-41a1-9105-6e3880f98d49 admin admin] RBAC: Adding query filter params (role.id=07f29be2087e43caaf6845ecf113b6e7, scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55, user.id=0e9a2114d29c4edeb20f394140d390bb) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:10.040974 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406c7cc-78c7-41a1-9105-6e3880f98d49 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:10.042808 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406c7cc-78c7-41a1-9105-6e3880f98d49 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:10.048451 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 582/1163] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:29:10 2021] GET /identity/v3/role_assignments?user.id=0e9a2114d29c4edeb20f394140d390bb&scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55&role.id=07f29be2087e43caaf6845ecf113b6e7 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:12.160248 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3ec8a-7ed6-482f-bcb7-a514a8871ad8 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:12.160761 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3ec8a-7ed6-482f-bcb7-a514a8871ad8 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:12.160761 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3ec8a-7ed6-482f-bcb7-a514a8871ad8 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:12.162431 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 582/1164] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:29:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:12.168170 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b9140-50c6-42d9-813b-5112c16241b2 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:12.168611 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b9140-50c6-42d9-813b-5112c16241b2 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:12.168738 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b9140-50c6-42d9-813b-5112c16241b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:12.191715 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-3e6b9140-50c6-42d9-813b-5112c16241b2 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:12.192880 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-3e6b9140-50c6-42d9-813b-5112c16241b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:12.199963 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 583/1165] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:29:12 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:29:12.222396 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3ec8a-7ed6-482f-bcb7-a514a8871ad8 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:12.234677 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3ec8a-7ed6-482f-bcb7-a514a8871ad8 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:12.238965 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877b5ac-4dff-4fd9-85e0-3cad88e70830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:12.239666 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877b5ac-4dff-4fd9-85e0-3cad88e70830 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:12.239951 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877b5ac-4dff-4fd9-85e0-3cad88e70830 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:12.240227 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877b5ac-4dff-4fd9-85e0-3cad88e70830 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:12.252141 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877b5ac-4dff-4fd9-85e0-3cad88e70830 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:29:12.258369 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-b877b5ac-4dff-4fd9-85e0-3cad88e70830 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:29:12.259490 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 583/1166] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:29:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:12.265801 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b9140-50c6-42d9-813b-5112c16241b2 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:12.275259 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b9140-50c6-42d9-813b-5112c16241b2 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:12.279708 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f4754-f9af-456f-bde0-e5f8c62baf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:12.280308 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f4754-f9af-456f-bde0-e5f8c62baf86 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:12.280600 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f4754-f9af-456f-bde0-e5f8c62baf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:12.280928 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f4754-f9af-456f-bde0-e5f8c62baf86 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:12.281647 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f4754-f9af-456f-bde0-e5f8c62baf86 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:12.281950 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f4754-f9af-456f-bde0-e5f8c62baf86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:12.283561 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f4754-f9af-456f-bde0-e5f8c62baf86 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:12.292772 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 584/1167] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:29:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:12.298477 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877b5ac-4dff-4fd9-85e0-3cad88e70830 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:12.309034 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877b5ac-4dff-4fd9-85e0-3cad88e70830 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:12.313259 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291b698-9a05-451c-b768-52ec889bd267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:12.313950 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291b698-9a05-451c-b768-52ec889bd267 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:12.314237 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291b698-9a05-451c-b768-52ec889bd267 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:12.314522 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291b698-9a05-451c-b768-52ec889bd267 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:12.325996 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291b698-9a05-451c-b768-52ec889bd267 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:12.327557 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291b698-9a05-451c-b768-52ec889bd267 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:12.344467 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-7291b698-9a05-451c-b768-52ec889bd267 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:29:12.345569 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 584/1168] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:29:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:12.351201 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f4754-f9af-456f-bde0-e5f8c62baf86 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:12.361125 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f4754-f9af-456f-bde0-e5f8c62baf86 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:12.365380 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97220fc8-22d6-4875-80e6-079a8d7e8e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:12.365983 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97220fc8-22d6-4875-80e6-079a8d7e8e09 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:12.366275 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97220fc8-22d6-4875-80e6-079a8d7e8e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:12.366562 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97220fc8-22d6-4875-80e6-079a8d7e8e09 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:12.367250 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97220fc8-22d6-4875-80e6-079a8d7e8e09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:12.367554 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97220fc8-22d6-4875-80e6-079a8d7e8e09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:12.369944 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97220fc8-22d6-4875-80e6-079a8d7e8e09 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:12.383301 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 585/1169] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:29:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:29:12.389211 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291b698-9a05-451c-b768-52ec889bd267 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:12.398360 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291b698-9a05-451c-b768-52ec889bd267 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:12.403209 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba20f87-696b-4466-b9b2-f2ffd56ebe12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:12.403922 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba20f87-696b-4466-b9b2-f2ffd56ebe12 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:12.404214 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba20f87-696b-4466-b9b2-f2ffd56ebe12 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:12.404494 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba20f87-696b-4466-b9b2-f2ffd56ebe12 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:12.417946 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba20f87-696b-4466-b9b2-f2ffd56ebe12 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:12.419857 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba20f87-696b-4466-b9b2-f2ffd56ebe12 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:12.437830 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-3ba20f87-696b-4466-b9b2-f2ffd56ebe12 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 16 14:29:12.438974 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 585/1170] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:29:12 2021] GET /identity/v3/users/placement => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:12.445085 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97220fc8-22d6-4875-80e6-079a8d7e8e09 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:12.454918 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97220fc8-22d6-4875-80e6-079a8d7e8e09 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:12.459548 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a3334-dc03-41c5-8fd5-261c7405e721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:12.460150 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a3334-dc03-41c5-8fd5-261c7405e721 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:12.460442 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a3334-dc03-41c5-8fd5-261c7405e721 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:12.460727 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a3334-dc03-41c5-8fd5-261c7405e721 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:12.461561 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a3334-dc03-41c5-8fd5-261c7405e721 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:12.461871 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a3334-dc03-41c5-8fd5-261c7405e721 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:12.464240 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a3334-dc03-41c5-8fd5-261c7405e721 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:12.493285 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 586/1171] 10.222.0.64 () {56 vars in 1164 bytes} [Thu Dec 16 14:29:12 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:12.499194 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba20f87-696b-4466-b9b2-f2ffd56ebe12 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:12.508683 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba20f87-696b-4466-b9b2-f2ffd56ebe12 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:12.512982 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cefbbd-f819-4ac4-9e97-3edb732b39dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:12.513553 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cefbbd-f819-4ac4-9e97-3edb732b39dd admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:12.513841 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cefbbd-f819-4ac4-9e97-3edb732b39dd admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:12.514121 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cefbbd-f819-4ac4-9e97-3edb732b39dd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:12.522210 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cefbbd-f819-4ac4-9e97-3edb732b39dd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:12.523940 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cefbbd-f819-4ac4-9e97-3edb732b39dd admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:12.533717 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 586/1172] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:29:12 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:29:12.539709 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a3334-dc03-41c5-8fd5-261c7405e721 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:12.550177 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a3334-dc03-41c5-8fd5-261c7405e721 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:12.554952 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5ea73-1a97-48e2-b6b6-49a1bd21b000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:12.555781 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5ea73-1a97-48e2-b6b6-49a1bd21b000 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:12.555965 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5ea73-1a97-48e2-b6b6-49a1bd21b000 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:12.556245 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5ea73-1a97-48e2-b6b6-49a1bd21b000 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:12.568750 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5ea73-1a97-48e2-b6b6-49a1bd21b000 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:12.570643 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5ea73-1a97-48e2-b6b6-49a1bd21b000 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:12.588644 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-c9b5ea73-1a97-48e2-b6b6-49a1bd21b000 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:29:12.589824 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 587/1173] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:29:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:12.595830 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cefbbd-f819-4ac4-9e97-3edb732b39dd admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:12.604551 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cefbbd-f819-4ac4-9e97-3edb732b39dd admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:12.609022 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a984c2d-da8e-4c05-8aa8-eb58b61cf80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:12.609602 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a984c2d-da8e-4c05-8aa8-eb58b61cf80d admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:12.609893 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a984c2d-da8e-4c05-8aa8-eb58b61cf80d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:12.610173 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a984c2d-da8e-4c05-8aa8-eb58b61cf80d admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:12.610857 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a984c2d-da8e-4c05-8aa8-eb58b61cf80d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:12.611157 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a984c2d-da8e-4c05-8aa8-eb58b61cf80d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:12.612721 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a984c2d-da8e-4c05-8aa8-eb58b61cf80d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:12.626265 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 587/1174] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:29:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:29:12.632070 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5ea73-1a97-48e2-b6b6-49a1bd21b000 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:12.642169 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5ea73-1a97-48e2-b6b6-49a1bd21b000 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:12.646514 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0b989-542b-47bf-89ef-44744c09dfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:12.647232 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0b989-542b-47bf-89ef-44744c09dfae admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:12.647519 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0b989-542b-47bf-89ef-44744c09dfae admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:12.647798 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0b989-542b-47bf-89ef-44744c09dfae admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:12.656603 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0b989-542b-47bf-89ef-44744c09dfae admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:12.658598 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0b989-542b-47bf-89ef-44744c09dfae admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:12.672007 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-7db0b989-542b-47bf-89ef-44744c09dfae admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:29:12.673103 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 588/1175] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:29:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:29:12.680747 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a984c2d-da8e-4c05-8aa8-eb58b61cf80d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:12.690778 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a984c2d-da8e-4c05-8aa8-eb58b61cf80d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:12.695079 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4daeade-eb05-4441-adc8-ce1dc5557a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:12.695641 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daeade-eb05-4441-adc8-ce1dc5557a5d admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:12.695935 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daeade-eb05-4441-adc8-ce1dc5557a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:12.696222 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daeade-eb05-4441-adc8-ce1dc5557a5d admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:12.697159 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4daeade-eb05-4441-adc8-ce1dc5557a5d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:12.698011 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4daeade-eb05-4441-adc8-ce1dc5557a5d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:12.699835 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4daeade-eb05-4441-adc8-ce1dc5557a5d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:12.712949 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 588/1176] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:29:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:12.719169 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0b989-542b-47bf-89ef-44744c09dfae admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:12.729241 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0b989-542b-47bf-89ef-44744c09dfae admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:12.733568 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ba810-9891-4114-a18b-1b7a419340d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:12.734191 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ba810-9891-4114-a18b-1b7a419340d1 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:12.734481 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ba810-9891-4114-a18b-1b7a419340d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:12.734768 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ba810-9891-4114-a18b-1b7a419340d1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:12.735552 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ba810-9891-4114-a18b-1b7a419340d1 admin admin] RBAC: Adding query filter params (role.id=90166eb3dcfa41e58450e140b8b0fea3, scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55, user.id=0e9a2114d29c4edeb20f394140d390bb) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:12.735861 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ba810-9891-4114-a18b-1b7a419340d1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:12.737772 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ba810-9891-4114-a18b-1b7a419340d1 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:12.743421 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 589/1177] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:29:12 2021] GET /identity/v3/role_assignments?user.id=0e9a2114d29c4edeb20f394140d390bb&scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55&role.id=90166eb3dcfa41e58450e140b8b0fea3 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:14.824318 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a74c18-b896-4da1-95a6-49691f18f5e4 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:14.824865 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a74c18-b896-4da1-95a6-49691f18f5e4 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:14.824957 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a74c18-b896-4da1-95a6-49691f18f5e4 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:14.826585 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 589/1178] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:29:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:14.831774 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b30e5-77f4-4294-b331-03e3bef7a93a None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:14.832175 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b30e5-77f4-4294-b331-03e3bef7a93a None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:14.832331 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b30e5-77f4-4294-b331-03e3bef7a93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:14.855725 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-2e4b30e5-77f4-4294-b331-03e3bef7a93a None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:14.856831 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-2e4b30e5-77f4-4294-b331-03e3bef7a93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:14.863874 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 590/1179] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:29:14 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:29:14.886088 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a74c18-b896-4da1-95a6-49691f18f5e4 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:14.897990 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a74c18-b896-4da1-95a6-49691f18f5e4 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:14.902687 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc47c3-e340-4137-8546-27e2acdebe9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:14.903392 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc47c3-e340-4137-8546-27e2acdebe9f admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:14.903685 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc47c3-e340-4137-8546-27e2acdebe9f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:14.903976 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc47c3-e340-4137-8546-27e2acdebe9f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:14.915017 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc47c3-e340-4137-8546-27e2acdebe9f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:29:14.921885 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-5fcc47c3-e340-4137-8546-27e2acdebe9f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:29:14.922981 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 590/1180] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:29:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:14.929382 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b30e5-77f4-4294-b331-03e3bef7a93a None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:14.938998 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b30e5-77f4-4294-b331-03e3bef7a93a None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:14.943300 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4caa4-553d-4847-aa5d-12cc94f40bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:14.943921 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4caa4-553d-4847-aa5d-12cc94f40bfa admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:14.944208 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4caa4-553d-4847-aa5d-12cc94f40bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:14.944488 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4caa4-553d-4847-aa5d-12cc94f40bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:14.945240 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4caa4-553d-4847-aa5d-12cc94f40bfa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:14.945541 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4caa4-553d-4847-aa5d-12cc94f40bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:14.947131 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4caa4-553d-4847-aa5d-12cc94f40bfa admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:14.955411 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 591/1181] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:29:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:14.961014 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc47c3-e340-4137-8546-27e2acdebe9f admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:14.972614 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc47c3-e340-4137-8546-27e2acdebe9f admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:14.976903 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869121b-1805-4f0a-86c0-d26a3fe2ffb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:14.977601 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869121b-1805-4f0a-86c0-d26a3fe2ffb8 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:14.977890 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869121b-1805-4f0a-86c0-d26a3fe2ffb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:14.978308 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869121b-1805-4f0a-86c0-d26a3fe2ffb8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:14.989782 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869121b-1805-4f0a-86c0-d26a3fe2ffb8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:14.991588 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869121b-1805-4f0a-86c0-d26a3fe2ffb8 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:15.008372 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-7869121b-1805-4f0a-86c0-d26a3fe2ffb8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:29:15.010030 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 591/1182] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:29:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:15.015964 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4caa4-553d-4847-aa5d-12cc94f40bfa admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:15.025937 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4caa4-553d-4847-aa5d-12cc94f40bfa admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:15.030456 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5818f8-83fb-4f18-ba16-d195e6465379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:15.031042 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5818f8-83fb-4f18-ba16-d195e6465379 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:15.031336 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5818f8-83fb-4f18-ba16-d195e6465379 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:15.031659 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5818f8-83fb-4f18-ba16-d195e6465379 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:15.032427 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5818f8-83fb-4f18-ba16-d195e6465379 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:15.032755 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5818f8-83fb-4f18-ba16-d195e6465379 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:15.034435 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5818f8-83fb-4f18-ba16-d195e6465379 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:15.046754 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 592/1183] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:29:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:15.052642 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869121b-1805-4f0a-86c0-d26a3fe2ffb8 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:15.062516 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869121b-1805-4f0a-86c0-d26a3fe2ffb8 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:15.066888 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecaa8b-f8dc-4c9d-b10f-25a72a346974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:15.067618 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecaa8b-f8dc-4c9d-b10f-25a72a346974 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:15.067907 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecaa8b-f8dc-4c9d-b10f-25a72a346974 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:15.068191 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecaa8b-f8dc-4c9d-b10f-25a72a346974 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:15.082052 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffecaa8b-f8dc-4c9d-b10f-25a72a346974 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:15.083990 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffecaa8b-f8dc-4c9d-b10f-25a72a346974 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:15.102834 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-ffecaa8b-f8dc-4c9d-b10f-25a72a346974 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 16 14:29:15.104458 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 592/1184] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:29:15 2021] GET /identity/v3/users/placement => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:15.110574 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5818f8-83fb-4f18-ba16-d195e6465379 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:15.120396 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5818f8-83fb-4f18-ba16-d195e6465379 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:15.125086 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17217d6d-fb42-4957-8cf6-89f829427fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:15.125689 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17217d6d-fb42-4957-8cf6-89f829427fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:15.125986 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17217d6d-fb42-4957-8cf6-89f829427fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:15.126273 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17217d6d-fb42-4957-8cf6-89f829427fa2 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:15.127062 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17217d6d-fb42-4957-8cf6-89f829427fa2 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:15.127361 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17217d6d-fb42-4957-8cf6-89f829427fa2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:15.129240 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17217d6d-fb42-4957-8cf6-89f829427fa2 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:15.158576 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 593/1185] 10.222.0.64 () {56 vars in 1164 bytes} [Thu Dec 16 14:29:15 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:15.164545 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecaa8b-f8dc-4c9d-b10f-25a72a346974 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:15.173836 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecaa8b-f8dc-4c9d-b10f-25a72a346974 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:15.178233 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff894b99-d9c3-4787-ba43-636c43b17aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:15.179207 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff894b99-d9c3-4787-ba43-636c43b17aed admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:15.179490 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff894b99-d9c3-4787-ba43-636c43b17aed admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:15.179765 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff894b99-d9c3-4787-ba43-636c43b17aed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:15.191518 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff894b99-d9c3-4787-ba43-636c43b17aed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:15.193337 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff894b99-d9c3-4787-ba43-636c43b17aed admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:15.210100 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-ff894b99-d9c3-4787-ba43-636c43b17aed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:29:15.211171 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 593/1186] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:29:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:29:15.217717 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17217d6d-fb42-4957-8cf6-89f829427fa2 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:15.227335 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17217d6d-fb42-4957-8cf6-89f829427fa2 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:15.231845 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d6e4d-ebaa-41b5-9216-2b84bd060977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:15.232441 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d6e4d-ebaa-41b5-9216-2b84bd060977 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:15.232735 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d6e4d-ebaa-41b5-9216-2b84bd060977 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:15.233054 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d6e4d-ebaa-41b5-9216-2b84bd060977 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:15.233749 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d6e4d-ebaa-41b5-9216-2b84bd060977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:15.234054 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d6e4d-ebaa-41b5-9216-2b84bd060977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:15.235731 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d6e4d-ebaa-41b5-9216-2b84bd060977 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:15.248886 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 594/1187] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:29:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:15.254615 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff894b99-d9c3-4787-ba43-636c43b17aed admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:15.264859 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff894b99-d9c3-4787-ba43-636c43b17aed admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:15.269153 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd5cc7-f2b3-4159-8e11-7af05178fab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:15.269864 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd5cc7-f2b3-4159-8e11-7af05178fab6 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:15.270146 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd5cc7-f2b3-4159-8e11-7af05178fab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:15.270427 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd5cc7-f2b3-4159-8e11-7af05178fab6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:15.279401 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd5cc7-f2b3-4159-8e11-7af05178fab6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:15.281364 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd5cc7-f2b3-4159-8e11-7af05178fab6 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:15.294531 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-1bdd5cc7-f2b3-4159-8e11-7af05178fab6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:29:15.295591 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 594/1188] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:29:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:15.301566 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d6e4d-ebaa-41b5-9216-2b84bd060977 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:15.311449 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d6e4d-ebaa-41b5-9216-2b84bd060977 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:15.315869 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92cf93-2096-4c73-8261-74250efd8588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:15.316470 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92cf93-2096-4c73-8261-74250efd8588 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:15.316742 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92cf93-2096-4c73-8261-74250efd8588 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:15.317066 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92cf93-2096-4c73-8261-74250efd8588 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:15.317803 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92cf93-2096-4c73-8261-74250efd8588 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:15.318107 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92cf93-2096-4c73-8261-74250efd8588 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:15.319998 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92cf93-2096-4c73-8261-74250efd8588 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:15.333363 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 595/1189] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:29:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:15.340425 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd5cc7-f2b3-4159-8e11-7af05178fab6 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:15.350739 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd5cc7-f2b3-4159-8e11-7af05178fab6 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:15.355060 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e81d4-6ac4-457f-bb17-d78a823c8c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:15.355858 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e81d4-6ac4-457f-bb17-d78a823c8c25 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:15.356145 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e81d4-6ac4-457f-bb17-d78a823c8c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:15.356429 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e81d4-6ac4-457f-bb17-d78a823c8c25 admin admin] PATH_INFO: `/v3/projects/244c8ef98d0445c6a0279c46d5cb7e55/users/0e9a2114d29c4edeb20f394140d390bb/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:15.358247 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e81d4-6ac4-457f-bb17-d78a823c8c25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=244c8ef98d0445c6a0279c46d5cb7e55, user_id=0e9a2114d29c4edeb20f394140d390bb, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:15.360909 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e81d4-6ac4-457f-bb17-d78a823c8c25 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:15.374167 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 595/1190] 10.222.0.64 () {58 vars in 1460 bytes} [Thu Dec 16 14:29:15 2021] PUT /identity/v3/projects/244c8ef98d0445c6a0279c46d5cb7e55/users/0e9a2114d29c4edeb20f394140d390bb/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:29:17.516141 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041e406-9e48-4122-85ee-1030a0e6d2d0 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:17.516673 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041e406-9e48-4122-85ee-1030a0e6d2d0 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:17.516812 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041e406-9e48-4122-85ee-1030a0e6d2d0 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:17.518413 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 596/1191] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:29:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:17.523921 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca41b48-363e-41fd-8bc3-1f4ffa1419a6 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:17.524318 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca41b48-363e-41fd-8bc3-1f4ffa1419a6 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:17.524491 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca41b48-363e-41fd-8bc3-1f4ffa1419a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:17.547445 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-3ca41b48-363e-41fd-8bc3-1f4ffa1419a6 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:17.548580 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-3ca41b48-363e-41fd-8bc3-1f4ffa1419a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:17.612892 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 596/1192] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:29:17 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:29:17.637188 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041e406-9e48-4122-85ee-1030a0e6d2d0 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:17.649091 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041e406-9e48-4122-85ee-1030a0e6d2d0 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:17.653601 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b82694-bb1a-4ea3-8570-08a97b3a1bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:17.654313 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b82694-bb1a-4ea3-8570-08a97b3a1bab admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:17.654605 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b82694-bb1a-4ea3-8570-08a97b3a1bab admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:17.654893 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b82694-bb1a-4ea3-8570-08a97b3a1bab admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:17.666291 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b82694-bb1a-4ea3-8570-08a97b3a1bab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 16 14:29:17.672525 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-24b82694-bb1a-4ea3-8570-08a97b3a1bab admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:29:17.673647 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 597/1193] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Dec 16 14:29:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:17.680062 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca41b48-363e-41fd-8bc3-1f4ffa1419a6 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:17.689114 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca41b48-363e-41fd-8bc3-1f4ffa1419a6 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:17.693329 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b64c3e-bfce-42fb-810c-0363fbf1f0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:17.693920 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b64c3e-bfce-42fb-810c-0363fbf1f0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:17.694206 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b64c3e-bfce-42fb-810c-0363fbf1f0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:17.694483 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b64c3e-bfce-42fb-810c-0363fbf1f0b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:17.695193 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b64c3e-bfce-42fb-810c-0363fbf1f0b7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:17.695488 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b64c3e-bfce-42fb-810c-0363fbf1f0b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:17.697708 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b64c3e-bfce-42fb-810c-0363fbf1f0b7 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:17.706013 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 597/1194] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Dec 16 14:29:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:17.711574 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b82694-bb1a-4ea3-8570-08a97b3a1bab admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:17.721315 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b82694-bb1a-4ea3-8570-08a97b3a1bab admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:17.725804 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b7e32-bd91-48e0-b230-80d0e26659a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:17.726510 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b7e32-bd91-48e0-b230-80d0e26659a0 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:17.726804 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b7e32-bd91-48e0-b230-80d0e26659a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:17.727091 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b7e32-bd91-48e0-b230-80d0e26659a0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:17.739755 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b7e32-bd91-48e0-b230-80d0e26659a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:17.741618 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b7e32-bd91-48e0-b230-80d0e26659a0 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:17.761028 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-cd1b7e32-bd91-48e0-b230-80d0e26659a0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:29:17.762102 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 598/1195] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:29:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:17.768163 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b64c3e-bfce-42fb-810c-0363fbf1f0b7 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:17.777564 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b64c3e-bfce-42fb-810c-0363fbf1f0b7 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:17.782044 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b884d7-38f9-4243-9260-87dc89288914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:17.782631 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b884d7-38f9-4243-9260-87dc89288914 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:17.782927 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b884d7-38f9-4243-9260-87dc89288914 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:17.783210 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b884d7-38f9-4243-9260-87dc89288914 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:17.783892 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b884d7-38f9-4243-9260-87dc89288914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:17.784194 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b884d7-38f9-4243-9260-87dc89288914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:17.785804 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b884d7-38f9-4243-9260-87dc89288914 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:17.798553 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 598/1196] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:29:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:17.804832 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b7e32-bd91-48e0-b230-80d0e26659a0 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:17.814622 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b7e32-bd91-48e0-b230-80d0e26659a0 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:17.818920 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbde6e4-bb41-45b1-9138-30d6bd17d2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:17.819631 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbde6e4-bb41-45b1-9138-30d6bd17d2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:17.819916 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbde6e4-bb41-45b1-9138-30d6bd17d2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:17.820193 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbde6e4-bb41-45b1-9138-30d6bd17d2a6 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:17.833240 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbde6e4-bb41-45b1-9138-30d6bd17d2a6 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:17.835230 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbde6e4-bb41-45b1-9138-30d6bd17d2a6 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:17.852339 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-efbde6e4-bb41-45b1-9138-30d6bd17d2a6 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 16 14:29:17.853445 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 599/1197] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:29:17 2021] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:29:17.859326 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b884d7-38f9-4243-9260-87dc89288914 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:17.869557 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b884d7-38f9-4243-9260-87dc89288914 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:17.873884 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af82e5-8d0f-40e1-a255-5a134f92183f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:17.874478 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af82e5-8d0f-40e1-a255-5a134f92183f admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:17.874770 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af82e5-8d0f-40e1-a255-5a134f92183f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:17.875056 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af82e5-8d0f-40e1-a255-5a134f92183f admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:17.875868 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af82e5-8d0f-40e1-a255-5a134f92183f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:17.876177 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af82e5-8d0f-40e1-a255-5a134f92183f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:17.878032 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af82e5-8d0f-40e1-a255-5a134f92183f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:17.906438 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 599/1198] 10.222.0.64 () {56 vars in 1164 bytes} [Thu Dec 16 14:29:17 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:17.912135 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbde6e4-bb41-45b1-9138-30d6bd17d2a6 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:17.921457 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbde6e4-bb41-45b1-9138-30d6bd17d2a6 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:17.925684 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36031c-aa19-4871-b4f2-6f0ac5923649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:17.926252 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36031c-aa19-4871-b4f2-6f0ac5923649 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:17.926543 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36031c-aa19-4871-b4f2-6f0ac5923649 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:17.926824 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36031c-aa19-4871-b4f2-6f0ac5923649 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:17.935110 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36031c-aa19-4871-b4f2-6f0ac5923649 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:17.936857 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36031c-aa19-4871-b4f2-6f0ac5923649 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:17.945783 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 600/1199] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Dec 16 14:29:17 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:29:17.952270 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af82e5-8d0f-40e1-a255-5a134f92183f admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:17.961495 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af82e5-8d0f-40e1-a255-5a134f92183f admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:17.965829 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78b92c-15f9-41cb-b513-db1c1d82ab00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:17.966534 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78b92c-15f9-41cb-b513-db1c1d82ab00 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:17.966824 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78b92c-15f9-41cb-b513-db1c1d82ab00 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:17.967105 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78b92c-15f9-41cb-b513-db1c1d82ab00 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:17.978918 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78b92c-15f9-41cb-b513-db1c1d82ab00 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:17.980855 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78b92c-15f9-41cb-b513-db1c1d82ab00 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:17.997813 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-aa78b92c-15f9-41cb-b513-db1c1d82ab00 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:29:17.998892 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 600/1200] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Dec 16 14:29:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:18.004608 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36031c-aa19-4871-b4f2-6f0ac5923649 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:18.013284 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36031c-aa19-4871-b4f2-6f0ac5923649 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:18.017636 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7d998-5a0d-4fa7-824c-dece4df68e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:18.018266 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7d998-5a0d-4fa7-824c-dece4df68e10 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:18.018507 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7d998-5a0d-4fa7-824c-dece4df68e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:18.018791 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7d998-5a0d-4fa7-824c-dece4df68e10 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:18.019483 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7d998-5a0d-4fa7-824c-dece4df68e10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:18.019784 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7d998-5a0d-4fa7-824c-dece4df68e10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:18.021397 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7d998-5a0d-4fa7-824c-dece4df68e10 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:18.033481 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 601/1201] 10.222.0.64 () {56 vars in 1130 bytes} [Thu Dec 16 14:29:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:18.039171 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78b92c-15f9-41cb-b513-db1c1d82ab00 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:18.049469 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78b92c-15f9-41cb-b513-db1c1d82ab00 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:18.054229 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a8292-3439-45c3-8f5c-c0dfeab7cff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:18.055005 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a8292-3439-45c3-8f5c-c0dfeab7cff8 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:18.055323 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a8292-3439-45c3-8f5c-c0dfeab7cff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:18.055604 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a8292-3439-45c3-8f5c-c0dfeab7cff8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:18.066963 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a8292-3439-45c3-8f5c-c0dfeab7cff8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:18.069094 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a8292-3439-45c3-8f5c-c0dfeab7cff8 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:18.082435 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING keystone.server.flask.application [None req-da8a8292-3439-45c3-8f5c-c0dfeab7cff8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:29:18.083531 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 601/1202] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Dec 16 14:29:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:18.089524 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7d998-5a0d-4fa7-824c-dece4df68e10 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:18.099386 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7d998-5a0d-4fa7-824c-dece4df68e10 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:18.104264 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467b0dd-3353-46f3-b873-f6fbf9a82505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:18.104882 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467b0dd-3353-46f3-b873-f6fbf9a82505 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:18.105175 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467b0dd-3353-46f3-b873-f6fbf9a82505 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:18.105457 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467b0dd-3353-46f3-b873-f6fbf9a82505 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:18.106203 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467b0dd-3353-46f3-b873-f6fbf9a82505 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:18.106506 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467b0dd-3353-46f3-b873-f6fbf9a82505 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:18.108466 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467b0dd-3353-46f3-b873-f6fbf9a82505 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:18.122437 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 602/1203] 10.222.0.64 () {56 vars in 1169 bytes} [Thu Dec 16 14:29:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:18.129197 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a8292-3439-45c3-8f5c-c0dfeab7cff8 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:18.139772 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a8292-3439-45c3-8f5c-c0dfeab7cff8 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:18.147132 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a1e7f-fee8-4b04-9325-93196095f366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:18.147735 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a1e7f-fee8-4b04-9325-93196095f366 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:18.148050 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a1e7f-fee8-4b04-9325-93196095f366 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:18.148323 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a1e7f-fee8-4b04-9325-93196095f366 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:18.149145 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a1e7f-fee8-4b04-9325-93196095f366 admin admin] RBAC: Adding query filter params (role.id=90166eb3dcfa41e58450e140b8b0fea3, scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55, user.id=0e9a2114d29c4edeb20f394140d390bb) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:18.149453 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a1e7f-fee8-4b04-9325-93196095f366 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:18.151683 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a1e7f-fee8-4b04-9325-93196095f366 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:18.159634 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 602/1204] 10.222.0.64 () {56 vars in 1395 bytes} [Thu Dec 16 14:29:18 2021] GET /identity/v3/role_assignments?user.id=0e9a2114d29c4edeb20f394140d390bb&scope.project.id=244c8ef98d0445c6a0279c46d5cb7e55&role.id=90166eb3dcfa41e58450e140b8b0fea3 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:20.283031 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f046b6-32c1-4731-9415-2dc854f9b2bb None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:20.283627 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f046b6-32c1-4731-9415-2dc854f9b2bb None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:20.283627 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f046b6-32c1-4731-9415-2dc854f9b2bb None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:20.285294 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 603/1205] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:29:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:20.290731 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a25c6-570c-4988-bac6-788180fa6a9b None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:20.291130 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a25c6-570c-4988-bac6-788180fa6a9b None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:20.291299 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a25c6-570c-4988-bac6-788180fa6a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:20.313559 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-0e1a25c6-570c-4988-bac6-788180fa6a9b None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:20.314708 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-0e1a25c6-570c-4988-bac6-788180fa6a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:20.322334 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 603/1206] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:29:20 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:29:20.344682 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f046b6-32c1-4731-9415-2dc854f9b2bb None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:20.356458 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f046b6-32c1-4731-9415-2dc854f9b2bb None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:20.360546 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9f84e-e23b-4e7b-848c-d499d608458b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:20.361296 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9f84e-e23b-4e7b-848c-d499d608458b admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:20.361577 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9f84e-e23b-4e7b-848c-d499d608458b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:20.361855 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9f84e-e23b-4e7b-848c-d499d608458b admin admin] PATH_INFO: `/v3/services/placement` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:20.362473 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b9f84e-e23b-4e7b-848c-d499d608458b admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:20.364049 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b9f84e-e23b-4e7b-848c-d499d608458b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:20.374240 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-36b9f84e-e23b-4e7b-848c-d499d608458b admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 16 14:29:20.375276 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 604/1207] 10.222.0.64 () {56 vars in 1138 bytes} [Thu Dec 16 14:29:20 2021] GET /identity/v3/services/placement => generated 90 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:20.385695 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a25c6-570c-4988-bac6-788180fa6a9b None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:20.395086 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a25c6-570c-4988-bac6-788180fa6a9b None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:20.399413 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d769a-8d1b-44ac-a500-a62d468dfead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:20.400595 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d769a-8d1b-44ac-a500-a62d468dfead admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:20.400919 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d769a-8d1b-44ac-a500-a62d468dfead admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:20.401203 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d769a-8d1b-44ac-a500-a62d468dfead admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:20.401875 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d769a-8d1b-44ac-a500-a62d468dfead admin admin] RBAC: Adding query filter params (name=placement) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:20.402174 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d769a-8d1b-44ac-a500-a62d468dfead admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:20.403731 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d769a-8d1b-44ac-a500-a62d468dfead admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:20.408534 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 604/1208] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Dec 16 14:29:20 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:20.414228 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9f84e-e23b-4e7b-848c-d499d608458b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:20.423640 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9f84e-e23b-4e7b-848c-d499d608458b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:20.427877 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bccc32-4935-4359-bb26-5004721f5f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:20.428715 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bccc32-4935-4359-bb26-5004721f5f79 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:20.429039 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bccc32-4935-4359-bb26-5004721f5f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:20.429327 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bccc32-4935-4359-bb26-5004721f5f79 admin admin] PATH_INFO: `/v3/services` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:20.429999 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bccc32-4935-4359-bb26-5004721f5f79 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:20.430303 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bccc32-4935-4359-bb26-5004721f5f79 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:20.431866 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bccc32-4935-4359-bb26-5004721f5f79 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:20.436090 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 605/1209] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Dec 16 14:29:20 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:22.490931 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b8f2b-9d11-434c-be3e-9fb150f3a065 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:22.491462 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b8f2b-9d11-434c-be3e-9fb150f3a065 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:22.491576 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b8f2b-9d11-434c-be3e-9fb150f3a065 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:22.493209 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 605/1210] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:29:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:22.498930 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323739e8-5586-4db0-b10b-6fe9736de131 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:22.499303 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323739e8-5586-4db0-b10b-6fe9736de131 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:22.499509 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323739e8-5586-4db0-b10b-6fe9736de131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:22.521070 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-323739e8-5586-4db0-b10b-6fe9736de131 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:22.522208 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-323739e8-5586-4db0-b10b-6fe9736de131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:22.529263 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 606/1211] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:29:22 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:29:22.551797 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b8f2b-9d11-434c-be3e-9fb150f3a065 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:22.564493 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b8f2b-9d11-434c-be3e-9fb150f3a065 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:22.568553 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f577b4b-86ce-46de-98f9-48b4d8392954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:22.569179 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f577b4b-86ce-46de-98f9-48b4d8392954 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:22.569478 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f577b4b-86ce-46de-98f9-48b4d8392954 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:22.569763 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f577b4b-86ce-46de-98f9-48b4d8392954 admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:22.570435 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f577b4b-86ce-46de-98f9-48b4d8392954 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:22.572052 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f577b4b-86ce-46de-98f9-48b4d8392954 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:22.584474 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 606/1212] 10.222.0.64 () {60 vars in 1162 bytes} [Thu Dec 16 14:29:22 2021] POST /identity/v3/services => generated 246 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:29:24.674519 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7003c66-26b3-4fbe-9a08-3bfb0acf92e5 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:24.675076 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7003c66-26b3-4fbe-9a08-3bfb0acf92e5 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:24.675076 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7003c66-26b3-4fbe-9a08-3bfb0acf92e5 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:24.676736 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 607/1213] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:29:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:24.682803 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddc653-2eec-4721-9c73-70276e73e1da None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:24.683220 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddc653-2eec-4721-9c73-70276e73e1da None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:24.683360 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddc653-2eec-4721-9c73-70276e73e1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:24.705247 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-92ddc653-2eec-4721-9c73-70276e73e1da None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:24.706369 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-92ddc653-2eec-4721-9c73-70276e73e1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:24.724402 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 607/1214] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:29:24 2021] POST /identity/v3/auth/tokens => generated 3516 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:29:24.747534 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7003c66-26b3-4fbe-9a08-3bfb0acf92e5 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:24.759374 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7003c66-26b3-4fbe-9a08-3bfb0acf92e5 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:24.763528 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049733e6-42c4-4fd7-92df-a74676cd3781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:24.764239 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049733e6-42c4-4fd7-92df-a74676cd3781 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:24.764525 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049733e6-42c4-4fd7-92df-a74676cd3781 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:24.764832 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049733e6-42c4-4fd7-92df-a74676cd3781 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:24.765466 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049733e6-42c4-4fd7-92df-a74676cd3781 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:24.767044 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049733e6-42c4-4fd7-92df-a74676cd3781 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:24.777356 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-049733e6-42c4-4fd7-92df-a74676cd3781 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 16 14:29:24.778395 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 608/1215] 10.222.0.64 () {56 vars in 1138 bytes} [Thu Dec 16 14:29:24 2021] GET /identity/v3/services/placement => generated 90 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:24.784204 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddc653-2eec-4721-9c73-70276e73e1da None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:24.793246 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddc653-2eec-4721-9c73-70276e73e1da None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:24.797535 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7f5dc-a9a2-41d7-86e6-d1dec024aaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:24.798116 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7f5dc-a9a2-41d7-86e6-d1dec024aaf0 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:24.798404 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7f5dc-a9a2-41d7-86e6-d1dec024aaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:24.798686 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7f5dc-a9a2-41d7-86e6-d1dec024aaf0 admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:24.799354 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7f5dc-a9a2-41d7-86e6-d1dec024aaf0 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:24.799653 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7f5dc-a9a2-41d7-86e6-d1dec024aaf0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:24.801303 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7f5dc-a9a2-41d7-86e6-d1dec024aaf0 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:24.807331 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 608/1216] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Dec 16 14:29:24 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:24.812943 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049733e6-42c4-4fd7-92df-a74676cd3781 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:24.822373 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049733e6-42c4-4fd7-92df-a74676cd3781 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:24.826691 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0de96-4241-4033-a1e8-54c85f5f9c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:24.827259 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0de96-4241-4033-a1e8-54c85f5f9c80 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:24.827553 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0de96-4241-4033-a1e8-54c85f5f9c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:24.827840 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0de96-4241-4033-a1e8-54c85f5f9c80 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:24.828591 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0de96-4241-4033-a1e8-54c85f5f9c80 admin admin] RBAC: Adding query filter params (interface=public, service_id=70dc7672f59b48b1855185a1d87f4f0e, region_id=RegionOne) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:24.828931 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0de96-4241-4033-a1e8-54c85f5f9c80 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:24.830494 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0de96-4241-4033-a1e8-54c85f5f9c80 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:24.835622 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 609/1217] 10.222.0.64 () {56 vars in 1272 bytes} [Thu Dec 16 14:29:24 2021] GET /identity/v3/endpoints?service_id=70dc7672f59b48b1855185a1d87f4f0e&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:24.841212 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7f5dc-a9a2-41d7-86e6-d1dec024aaf0 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:24.850529 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7f5dc-a9a2-41d7-86e6-d1dec024aaf0 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:24.855381 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9439c34-587d-4df3-b55d-4ce3c42756bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:24.855960 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9439c34-587d-4df3-b55d-4ce3c42756bf admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:24.856246 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9439c34-587d-4df3-b55d-4ce3c42756bf admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:24.856526 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9439c34-587d-4df3-b55d-4ce3c42756bf admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:24.857203 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9439c34-587d-4df3-b55d-4ce3c42756bf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:24.858748 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9439c34-587d-4df3-b55d-4ce3c42756bf admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:24.865690 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 609/1218] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Dec 16 14:29:24 2021] GET /identity/v3/services => generated 2430 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:29:26.942835 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f620c-3699-4e96-b991-ab34c5064556 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:26.943390 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f620c-3699-4e96-b991-ab34c5064556 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:26.943390 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f620c-3699-4e96-b991-ab34c5064556 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:26.945123 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 610/1219] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:29:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:26.950965 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b051c0-4c2c-4f35-a172-be2f535d3fa6 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:26.951361 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b051c0-4c2c-4f35-a172-be2f535d3fa6 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:26.951527 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b051c0-4c2c-4f35-a172-be2f535d3fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:26.973159 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-e5b051c0-4c2c-4f35-a172-be2f535d3fa6 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:26.974303 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e5b051c0-4c2c-4f35-a172-be2f535d3fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:26.981786 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 610/1220] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:29:26 2021] POST /identity/v3/auth/tokens => generated 3516 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:29:27.004511 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f620c-3699-4e96-b991-ab34c5064556 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:27.017166 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f620c-3699-4e96-b991-ab34c5064556 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:27.021628 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06112fb4-f1e2-471f-a752-bb0460cf18c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:27.022348 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06112fb4-f1e2-471f-a752-bb0460cf18c5 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:27.022637 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06112fb4-f1e2-471f-a752-bb0460cf18c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:27.022921 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06112fb4-f1e2-471f-a752-bb0460cf18c5 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:27.023557 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06112fb4-f1e2-471f-a752-bb0460cf18c5 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:27.025186 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06112fb4-f1e2-471f-a752-bb0460cf18c5 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:27.035606 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING keystone.server.flask.application [None req-06112fb4-f1e2-471f-a752-bb0460cf18c5 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 16 14:29:27.036840 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 611/1221] 10.222.0.64 () {56 vars in 1138 bytes} [Thu Dec 16 14:29:27 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:29:27.043836 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b051c0-4c2c-4f35-a172-be2f535d3fa6 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:27.052547 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b051c0-4c2c-4f35-a172-be2f535d3fa6 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:27.057703 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb0069-aced-4e07-99b5-192555838d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:27.058290 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb0069-aced-4e07-99b5-192555838d5b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:27.058581 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb0069-aced-4e07-99b5-192555838d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:27.058865 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb0069-aced-4e07-99b5-192555838d5b admin admin] PATH_INFO: `/v3/services` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:27.059537 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb0069-aced-4e07-99b5-192555838d5b admin admin] RBAC: Adding query filter params (name=placement) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:29:27.059837 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb0069-aced-4e07-99b5-192555838d5b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:27.061447 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb0069-aced-4e07-99b5-192555838d5b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:27.066469 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 611/1222] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Dec 16 14:29:27 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:27.071975 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06112fb4-f1e2-471f-a752-bb0460cf18c5 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:27.081591 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06112fb4-f1e2-471f-a752-bb0460cf18c5 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:27.085811 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c999945-67fa-4665-9e55-f45a24fc033b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:27.086373 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c999945-67fa-4665-9e55-f45a24fc033b admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:27.086684 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c999945-67fa-4665-9e55-f45a24fc033b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:27.086945 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c999945-67fa-4665-9e55-f45a24fc033b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:27.087629 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c999945-67fa-4665-9e55-f45a24fc033b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:27.089225 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c999945-67fa-4665-9e55-f45a24fc033b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:29:27.106924 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 612/1223] 10.222.0.64 () {60 vars in 1165 bytes} [Thu Dec 16 14:29:27 2021] POST /identity/v3/endpoints => generated 331 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:30:50.355571 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc7a8c-a110-47a9-be85-ccf3baf61e3c None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:50.356172 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc7a8c-a110-47a9-be85-ccf3baf61e3c None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:50.356172 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc7a8c-a110-47a9-be85-ccf3baf61e3c None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:50.358568 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 612/1224] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:30:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:30:50.363856 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb169274-2fe7-4cf5-a9ca-a173d97c6397 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:50.364746 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb169274-2fe7-4cf5-a9ca-a173d97c6397 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:50.365356 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb169274-2fe7-4cf5-a9ca-a173d97c6397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:50.466030 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-cb169274-2fe7-4cf5-a9ca-a173d97c6397 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:30:50.467635 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-cb169274-2fe7-4cf5-a9ca-a173d97c6397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:50.599250 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 613/1225] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:30:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:30:50.623288 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc7a8c-a110-47a9-be85-ccf3baf61e3c None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:30:50.625382 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-2fcc7a8c-a110-47a9-be85-ccf3baf61e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:50.779580 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc7a8c-a110-47a9-be85-ccf3baf61e3c None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:30:50.892640 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c0688-b44a-41ce-8b0b-fc143d009e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:30:50.893720 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c0688-b44a-41ce-8b0b-fc143d009e53 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:50.894249 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c0688-b44a-41ce-8b0b-fc143d009e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:50.894759 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c0688-b44a-41ce-8b0b-fc143d009e53 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:50.895674 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c0688-b44a-41ce-8b0b-fc143d009e53 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:30:50.897748 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c0688-b44a-41ce-8b0b-fc143d009e53 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:30:50.913431 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 613/1226] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Dec 16 14:30:50 2021] GET /identity/v3/projects => generated 2553 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:30:53.077673 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388e187-5bc2-45b2-bcb8-35635358c0ed None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:53.078198 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388e187-5bc2-45b2-bcb8-35635358c0ed None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:53.078285 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388e187-5bc2-45b2-bcb8-35635358c0ed None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:53.079917 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 614/1227] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:30:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:30:53.085199 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e0e2a-7a50-4b55-b1be-186d35119fce None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:53.085610 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e0e2a-7a50-4b55-b1be-186d35119fce None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:53.085782 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e0e2a-7a50-4b55-b1be-186d35119fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:53.174467 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-457e0e2a-7a50-4b55-b1be-186d35119fce None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:30:53.175567 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-457e0e2a-7a50-4b55-b1be-186d35119fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:53.281845 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 614/1228] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:30:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:30:53.329732 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60219164-3431-4c64-b5e9-7cf212910c89 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:53.330028 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60219164-3431-4c64-b5e9-7cf212910c89 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:53.330321 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60219164-3431-4c64-b5e9-7cf212910c89 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:53.332011 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 615/1229] 10.222.0.64 () {54 vars in 963 bytes} [Thu Dec 16 14:30:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:30:53.337807 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30750043-d870-43ae-8301-1a6d41d404d8 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:53.338107 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30750043-d870-43ae-8301-1a6d41d404d8 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:53.338394 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30750043-d870-43ae-8301-1a6d41d404d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:53.433382 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-30750043-d870-43ae-8301-1a6d41d404d8 None None] MFA Rules not processed for user `34e25627f3384826b35caf92a804c6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:30:53.434439 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-30750043-d870-43ae-8301-1a6d41d404d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:53.518493 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 615/1230] 10.222.0.64 () {58 vars in 1060 bytes} [Thu Dec 16 14:30:53 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:30:53.528037 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60219164-3431-4c64-b5e9-7cf212910c89 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:30:53.529579 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-60219164-3431-4c64-b5e9-7cf212910c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:53.644804 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60219164-3431-4c64-b5e9-7cf212910c89 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:30:53.726667 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505e40c-7cc2-4c85-b441-a04e897e83b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:30:53.727251 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505e40c-7cc2-4c85-b441-a04e897e83b4 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:53.728059 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505e40c-7cc2-4c85-b441-a04e897e83b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:53.728337 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505e40c-7cc2-4c85-b441-a04e897e83b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:53.729912 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-b505e40c-7cc2-4c85-b441-a04e897e83b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:53.849746 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505e40c-7cc2-4c85-b441-a04e897e83b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:30:53.851166 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505e40c-7cc2-4c85-b441-a04e897e83b4 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:30:53.872026 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 616/1231] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:30:53 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:30:56.204718 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7624a99-30a2-4c0a-b089-0a1dd1822fd3 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:56.205272 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7624a99-30a2-4c0a-b089-0a1dd1822fd3 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:56.205390 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7624a99-30a2-4c0a-b089-0a1dd1822fd3 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:56.206975 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 616/1232] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:30:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:30:56.212335 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ff642-33e9-4aa5-9106-e7fa30aaa530 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:56.212722 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ff642-33e9-4aa5-9106-e7fa30aaa530 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:56.212940 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ff642-33e9-4aa5-9106-e7fa30aaa530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:56.296980 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-713ff642-33e9-4aa5-9106-e7fa30aaa530 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:30:56.298140 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-713ff642-33e9-4aa5-9106-e7fa30aaa530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:56.406189 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 617/1233] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:30:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:30:56.458376 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436c504-56c4-4aeb-ac29-56279d7dc3c9 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:56.458609 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436c504-56c4-4aeb-ac29-56279d7dc3c9 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:56.458897 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436c504-56c4-4aeb-ac29-56279d7dc3c9 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:56.460608 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 617/1234] 10.222.0.64 () {54 vars in 963 bytes} [Thu Dec 16 14:30:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:30:56.467011 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135f220-65d2-4d1d-8290-5a19351933c5 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:56.467314 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135f220-65d2-4d1d-8290-5a19351933c5 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:56.467605 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135f220-65d2-4d1d-8290-5a19351933c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:56.564215 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-c135f220-65d2-4d1d-8290-5a19351933c5 None None] MFA Rules not processed for user `34e25627f3384826b35caf92a804c6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:30:56.565395 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-c135f220-65d2-4d1d-8290-5a19351933c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:56.648880 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 618/1235] 10.222.0.64 () {58 vars in 1060 bytes} [Thu Dec 16 14:30:56 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:30:56.658283 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436c504-56c4-4aeb-ac29-56279d7dc3c9 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:30:56.659722 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-5436c504-56c4-4aeb-ac29-56279d7dc3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:56.776837 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436c504-56c4-4aeb-ac29-56279d7dc3c9 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:30:56.860074 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3232e-c0cc-4212-a74a-f7066ce8ce56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:30:56.860655 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3232e-c0cc-4212-a74a-f7066ce8ce56 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:56.860974 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3232e-c0cc-4212-a74a-f7066ce8ce56 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:56.861262 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3232e-c0cc-4212-a74a-f7066ce8ce56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:56.862805 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-1be3232e-c0cc-4212-a74a-f7066ce8ce56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:56.984980 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3232e-c0cc-4212-a74a-f7066ce8ce56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:30:56.986404 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3232e-c0cc-4212-a74a-f7066ce8ce56 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:30:57.005097 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 618/1236] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:30:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:30:59.615051 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d75461-095e-4bf1-aa2c-bc199834a853 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:59.615587 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d75461-095e-4bf1-aa2c-bc199834a853 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:59.615587 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d75461-095e-4bf1-aa2c-bc199834a853 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:59.617296 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 619/1237] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:30:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:30:59.623656 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65aa974-b80c-45fb-9cb1-dc2be5165186 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:59.624071 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65aa974-b80c-45fb-9cb1-dc2be5165186 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:59.624227 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65aa974-b80c-45fb-9cb1-dc2be5165186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:59.710623 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-f65aa974-b80c-45fb-9cb1-dc2be5165186 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:30:59.711870 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-f65aa974-b80c-45fb-9cb1-dc2be5165186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:59.821793 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 619/1238] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:30:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:30:59.855736 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d75461-095e-4bf1-aa2c-bc199834a853 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:30:59.857218 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-18d75461-095e-4bf1-aa2c-bc199834a853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:59.996167 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d75461-095e-4bf1-aa2c-bc199834a853 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:00.099661 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335278d-bad9-4c74-86a2-2c2b83dfda4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:00.100441 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335278d-bad9-4c74-86a2-2c2b83dfda4c admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:00.100727 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335278d-bad9-4c74-86a2-2c2b83dfda4c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:00.101039 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335278d-bad9-4c74-86a2-2c2b83dfda4c admin admin] PATH_INFO: `/v3/projects/9fcacc34d06d4718a100e858ed8da87e` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:00.112222 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335278d-bad9-4c74-86a2-2c2b83dfda4c admin admin] RBAC: Authorizing `identity:get_project(project_id=9fcacc34d06d4718a100e858ed8da87e)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:00.114290 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335278d-bad9-4c74-86a2-2c2b83dfda4c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:31:00.115850 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 620/1239] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:30:59 2021] GET /identity/v3/projects/9fcacc34d06d4718a100e858ed8da87e => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:31:00.128447 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65aa974-b80c-45fb-9cb1-dc2be5165186 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:00.129615 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-f65aa974-b80c-45fb-9cb1-dc2be5165186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:00.240516 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65aa974-b80c-45fb-9cb1-dc2be5165186 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:00.322329 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4defa9c-c2ea-4e66-b696-9fb00873e53d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:00.322896 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4defa9c-c2ea-4e66-b696-9fb00873e53d service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:00.323183 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4defa9c-c2ea-4e66-b696-9fb00873e53d service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:00.323463 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4defa9c-c2ea-4e66-b696-9fb00873e53d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:00.325006 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-c4defa9c-c2ea-4e66-b696-9fb00873e53d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:00.444520 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4defa9c-c2ea-4e66-b696-9fb00873e53d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:00.446475 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4defa9c-c2ea-4e66-b696-9fb00873e53d service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:31:00.465656 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 620/1240] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:31:00 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:31:03.149542 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8d29e-0c6a-44ef-800b-f8c3f4b0ad74 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:03.150043 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8d29e-0c6a-44ef-800b-f8c3f4b0ad74 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:03.150043 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8d29e-0c6a-44ef-800b-f8c3f4b0ad74 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:03.151724 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 621/1241] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:31:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:03.157062 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4700388-51e1-4cb6-931f-fa99e51465bd None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:03.157469 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4700388-51e1-4cb6-931f-fa99e51465bd None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:03.157636 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4700388-51e1-4cb6-931f-fa99e51465bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:03.244325 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-d4700388-51e1-4cb6-931f-fa99e51465bd None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:03.245508 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-d4700388-51e1-4cb6-931f-fa99e51465bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:03.349539 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 621/1242] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:31:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:03.381340 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8d29e-0c6a-44ef-800b-f8c3f4b0ad74 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:03.382783 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-1bc8d29e-0c6a-44ef-800b-f8c3f4b0ad74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:03.522067 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8d29e-0c6a-44ef-800b-f8c3f4b0ad74 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:03.624341 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9094d-974a-40d8-9ea8-074a2bada1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:03.625157 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9094d-974a-40d8-9ea8-074a2bada1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:03.625449 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9094d-974a-40d8-9ea8-074a2bada1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:03.625732 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9094d-974a-40d8-9ea8-074a2bada1f6 admin admin] PATH_INFO: `/v3/projects/9fcacc34d06d4718a100e858ed8da87e` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:03.637205 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9094d-974a-40d8-9ea8-074a2bada1f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=9fcacc34d06d4718a100e858ed8da87e)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:03.639269 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9094d-974a-40d8-9ea8-074a2bada1f6 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:31:03.640930 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 622/1243] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:31:03 2021] GET /identity/v3/projects/9fcacc34d06d4718a100e858ed8da87e => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:31:03.653233 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4700388-51e1-4cb6-931f-fa99e51465bd None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:03.654367 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-d4700388-51e1-4cb6-931f-fa99e51465bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:03.765657 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4700388-51e1-4cb6-931f-fa99e51465bd None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:03.849224 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f8c13-2069-4c1d-955d-89caa3213e53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:03.849724 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f8c13-2069-4c1d-955d-89caa3213e53 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:03.850015 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f8c13-2069-4c1d-955d-89caa3213e53 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:03.850302 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f8c13-2069-4c1d-955d-89caa3213e53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:03.851938 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-6d7f8c13-2069-4c1d-955d-89caa3213e53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:03.974248 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f8c13-2069-4c1d-955d-89caa3213e53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:03.975681 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f8c13-2069-4c1d-955d-89caa3213e53 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:31:03.995871 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 622/1244] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:31:03 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:31:07.051403 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c70fbe-d763-47b3-93cf-80e2f836f00a None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:07.051999 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c70fbe-d763-47b3-93cf-80e2f836f00a None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:07.051999 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c70fbe-d763-47b3-93cf-80e2f836f00a None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:07.053695 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 623/1245] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:31:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:07.059342 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8a193-cd9d-4f2f-aa37-e825277de641 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:07.059792 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8a193-cd9d-4f2f-aa37-e825277de641 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:07.059987 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8a193-cd9d-4f2f-aa37-e825277de641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:07.147641 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-dcc8a193-cd9d-4f2f-aa37-e825277de641 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:07.149742 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-dcc8a193-cd9d-4f2f-aa37-e825277de641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:07.265261 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 623/1246] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:31:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:07.303260 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c70fbe-d763-47b3-93cf-80e2f836f00a None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:07.304889 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-d1c70fbe-d763-47b3-93cf-80e2f836f00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:07.430959 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c70fbe-d763-47b3-93cf-80e2f836f00a None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:07.517032 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2083b66-101c-470d-bbb8-aa7d248919e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:07.517628 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2083b66-101c-470d-bbb8-aa7d248919e8 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:07.517924 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2083b66-101c-470d-bbb8-aa7d248919e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:07.518210 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2083b66-101c-470d-bbb8-aa7d248919e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:07.519766 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-a2083b66-101c-470d-bbb8-aa7d248919e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:07.643925 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2083b66-101c-470d-bbb8-aa7d248919e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:07.645333 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2083b66-101c-470d-bbb8-aa7d248919e8 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:31:07.664891 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 624/1247] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:31:07 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:31:09.849616 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c0b4f-784d-4c7a-8a00-c3c9409272f8 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:09.850129 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c0b4f-784d-4c7a-8a00-c3c9409272f8 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:09.850364 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c0b4f-784d-4c7a-8a00-c3c9409272f8 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:09.852866 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 624/1248] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:31:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:09.858619 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f159997-c8a1-4ed1-9905-f76e4968a0c1 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:09.859060 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f159997-c8a1-4ed1-9905-f76e4968a0c1 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:09.859241 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f159997-c8a1-4ed1-9905-f76e4968a0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:09.948620 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-9f159997-c8a1-4ed1-9905-f76e4968a0c1 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:09.950293 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-9f159997-c8a1-4ed1-9905-f76e4968a0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:10.068950 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 625/1249] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:31:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:10.099763 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c0b4f-784d-4c7a-8a00-c3c9409272f8 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:10.101261 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-483c0b4f-784d-4c7a-8a00-c3c9409272f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:10.224774 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c0b4f-784d-4c7a-8a00-c3c9409272f8 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:10.310785 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe34b32-67f0-42ec-bce4-a3d71aa3318d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:10.311374 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe34b32-67f0-42ec-bce4-a3d71aa3318d service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:10.311669 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe34b32-67f0-42ec-bce4-a3d71aa3318d service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:10.311957 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe34b32-67f0-42ec-bce4-a3d71aa3318d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:10.313546 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-2fe34b32-67f0-42ec-bce4-a3d71aa3318d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:10.438166 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe34b32-67f0-42ec-bce4-a3d71aa3318d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:10.439597 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe34b32-67f0-42ec-bce4-a3d71aa3318d service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:31:10.462247 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 625/1250] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:31:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:31:12.606589 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a764aaa-6c30-411f-816d-722951f4a5cc None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:12.607226 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a764aaa-6c30-411f-816d-722951f4a5cc None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:12.607226 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a764aaa-6c30-411f-816d-722951f4a5cc None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:12.608891 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 626/1251] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:31:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:12.614213 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875e636-c05c-407d-ba44-b53050594dcc None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:12.614621 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875e636-c05c-407d-ba44-b53050594dcc None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:12.614776 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875e636-c05c-407d-ba44-b53050594dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:12.700927 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-9875e636-c05c-407d-ba44-b53050594dcc None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:12.702105 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-9875e636-c05c-407d-ba44-b53050594dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:12.807540 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 626/1252] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:31:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:12.839087 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a764aaa-6c30-411f-816d-722951f4a5cc None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:12.840534 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-6a764aaa-6c30-411f-816d-722951f4a5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:12.978622 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a764aaa-6c30-411f-816d-722951f4a5cc None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:13.083069 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222201d-e00e-426c-8d36-b736d3e5cefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:13.083861 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222201d-e00e-426c-8d36-b736d3e5cefa admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:13.084149 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222201d-e00e-426c-8d36-b736d3e5cefa admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:13.084428 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222201d-e00e-426c-8d36-b736d3e5cefa admin admin] PATH_INFO: `/v3/projects/9fcacc34d06d4718a100e858ed8da87e` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:13.095804 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222201d-e00e-426c-8d36-b736d3e5cefa admin admin] RBAC: Authorizing `identity:get_project(project_id=9fcacc34d06d4718a100e858ed8da87e)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:13.097918 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222201d-e00e-426c-8d36-b736d3e5cefa admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:31:13.099599 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 627/1253] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:31:12 2021] GET /identity/v3/projects/9fcacc34d06d4718a100e858ed8da87e => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:31:13.112202 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875e636-c05c-407d-ba44-b53050594dcc None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:13.113372 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-9875e636-c05c-407d-ba44-b53050594dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:13.221427 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875e636-c05c-407d-ba44-b53050594dcc None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:13.305933 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f03b88-21d6-48c9-a30e-db5d5fd3b4d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:13.306539 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f03b88-21d6-48c9-a30e-db5d5fd3b4d8 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:13.306825 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f03b88-21d6-48c9-a30e-db5d5fd3b4d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:13.307102 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f03b88-21d6-48c9-a30e-db5d5fd3b4d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:13.308633 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-00f03b88-21d6-48c9-a30e-db5d5fd3b4d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:13.429454 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f03b88-21d6-48c9-a30e-db5d5fd3b4d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:13.430873 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f03b88-21d6-48c9-a30e-db5d5fd3b4d8 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:31:13.450170 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 627/1254] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:31:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:31:15.775154 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e16a8-a22a-4e1b-8f7f-b1d6a87e1c28 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:15.775711 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e16a8-a22a-4e1b-8f7f-b1d6a87e1c28 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:15.775825 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e16a8-a22a-4e1b-8f7f-b1d6a87e1c28 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:15.777582 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 628/1255] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:31:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:15.783152 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b2456-bc17-40f8-8d27-ca574e5b2828 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:15.783619 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b2456-bc17-40f8-8d27-ca574e5b2828 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:15.783738 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b2456-bc17-40f8-8d27-ca574e5b2828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:15.872716 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-302b2456-bc17-40f8-8d27-ca574e5b2828 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:15.873894 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-302b2456-bc17-40f8-8d27-ca574e5b2828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:15.986456 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 628/1256] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:31:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:16.022678 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e16a8-a22a-4e1b-8f7f-b1d6a87e1c28 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:16.024221 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-8a3e16a8-a22a-4e1b-8f7f-b1d6a87e1c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:16.143214 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e16a8-a22a-4e1b-8f7f-b1d6a87e1c28 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:16.224472 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2adc01-81d3-4e86-a35a-e3e55d1a7d22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:16.225082 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2adc01-81d3-4e86-a35a-e3e55d1a7d22 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:16.225369 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2adc01-81d3-4e86-a35a-e3e55d1a7d22 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:16.225648 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2adc01-81d3-4e86-a35a-e3e55d1a7d22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:16.227684 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-da2adc01-81d3-4e86-a35a-e3e55d1a7d22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:16.350790 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2adc01-81d3-4e86-a35a-e3e55d1a7d22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:16.352677 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2adc01-81d3-4e86-a35a-e3e55d1a7d22 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:31:16.372133 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 629/1257] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:31:16 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:31:18.479893 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c565098-9c5c-4a12-97d3-e0e55498034c None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:18.480460 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c565098-9c5c-4a12-97d3-e0e55498034c None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:18.480460 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c565098-9c5c-4a12-97d3-e0e55498034c None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:18.482148 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 629/1258] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:31:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:18.487410 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b65b75-0fa1-4e76-b31c-b6f0f0ffa4b1 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:18.487866 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b65b75-0fa1-4e76-b31c-b6f0f0ffa4b1 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:18.487970 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b65b75-0fa1-4e76-b31c-b6f0f0ffa4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:18.572257 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-e7b65b75-0fa1-4e76-b31c-b6f0f0ffa4b1 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:18.573454 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e7b65b75-0fa1-4e76-b31c-b6f0f0ffa4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:18.680357 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 630/1259] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:31:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:18.721042 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c565098-9c5c-4a12-97d3-e0e55498034c None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:18.722650 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-8c565098-9c5c-4a12-97d3-e0e55498034c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:18.843240 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c565098-9c5c-4a12-97d3-e0e55498034c None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:18.925491 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a7f7c-7135-4ce8-948f-b209924a012d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:18.926076 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a7f7c-7135-4ce8-948f-b209924a012d service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:18.926372 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a7f7c-7135-4ce8-948f-b209924a012d service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:18.926660 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a7f7c-7135-4ce8-948f-b209924a012d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:18.928213 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-df6a7f7c-7135-4ce8-948f-b209924a012d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:19.057453 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a7f7c-7135-4ce8-948f-b209924a012d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:19.058899 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a7f7c-7135-4ce8-948f-b209924a012d service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:31:19.078224 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 630/1260] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:31:18 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:31:21.548988 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a480f-34c6-4ccf-9abb-925ec6778d39 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:21.549604 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a480f-34c6-4ccf-9abb-925ec6778d39 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:21.549604 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a480f-34c6-4ccf-9abb-925ec6778d39 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:21.551288 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 631/1261] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:31:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:21.557090 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eccf5b-1286-4393-a89f-fc93cd1e7489 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:21.557511 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eccf5b-1286-4393-a89f-fc93cd1e7489 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:21.557661 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eccf5b-1286-4393-a89f-fc93cd1e7489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:21.651259 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-a4eccf5b-1286-4393-a89f-fc93cd1e7489 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:21.652405 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-a4eccf5b-1286-4393-a89f-fc93cd1e7489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:21.763754 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 631/1262] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:31:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:21.800397 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a480f-34c6-4ccf-9abb-925ec6778d39 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:21.802401 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-4a0a480f-34c6-4ccf-9abb-925ec6778d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:21.914038 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a480f-34c6-4ccf-9abb-925ec6778d39 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:21.917394 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a83248-5f29-47a0-a4d4-c1e95d5d0a24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:21.917968 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a83248-5f29-47a0-a4d4-c1e95d5d0a24 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:21.918253 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a83248-5f29-47a0-a4d4-c1e95d5d0a24 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:21.918531 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a83248-5f29-47a0-a4d4-c1e95d5d0a24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:21.927312 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a83248-5f29-47a0-a4d4-c1e95d5d0a24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:21.928757 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a83248-5f29-47a0-a4d4-c1e95d5d0a24 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:31:21.938023 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 632/1263] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:31:21 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:31:26.386095 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eedc27-0434-404e-94c9-7ca896a1df41 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:26.386598 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eedc27-0434-404e-94c9-7ca896a1df41 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:26.386598 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eedc27-0434-404e-94c9-7ca896a1df41 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:26.388259 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 632/1264] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:31:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:26.393727 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74db57b-41f4-42d3-910b-c4a6b9b472fd None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:26.394158 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74db57b-41f4-42d3-910b-c4a6b9b472fd None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:26.394281 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74db57b-41f4-42d3-910b-c4a6b9b472fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:26.422665 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-d74db57b-41f4-42d3-910b-c4a6b9b472fd None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:26.422665 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-d74db57b-41f4-42d3-910b-c4a6b9b472fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:26.430397 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 633/1265] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:31:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:26.469227 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eedc27-0434-404e-94c9-7ca896a1df41 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:26.480109 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eedc27-0434-404e-94c9-7ca896a1df41 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:26.483384 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba53ec-708c-44f8-8d52-431524604446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:26.483949 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba53ec-708c-44f8-8d52-431524604446 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:26.484232 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba53ec-708c-44f8-8d52-431524604446 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:26.484509 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba53ec-708c-44f8-8d52-431524604446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:26.493959 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba53ec-708c-44f8-8d52-431524604446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:26.495371 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba53ec-708c-44f8-8d52-431524604446 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:31:26.504850 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 633/1266] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:31:26 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:31:29.461468 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d754b8-adf3-4781-9fa1-a5925828c25f None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:29.461994 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d754b8-adf3-4781-9fa1-a5925828c25f None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:29.462114 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d754b8-adf3-4781-9fa1-a5925828c25f None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:29.463716 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 634/1267] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:31:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:29.468878 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c778dc-eeb3-49df-8f71-4dfd374f7705 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:29.469299 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c778dc-eeb3-49df-8f71-4dfd374f7705 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:29.469447 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c778dc-eeb3-49df-8f71-4dfd374f7705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:29.493300 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-91c778dc-eeb3-49df-8f71-4dfd374f7705 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:29.494395 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-91c778dc-eeb3-49df-8f71-4dfd374f7705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:29.501482 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 634/1268] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:31:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:31:29.540020 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d754b8-adf3-4781-9fa1-a5925828c25f None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:29.550809 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d754b8-adf3-4781-9fa1-a5925828c25f None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:29.554383 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b80d94-e827-4067-8e7b-5ca5924a219b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:29.554947 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b80d94-e827-4067-8e7b-5ca5924a219b service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:29.555236 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b80d94-e827-4067-8e7b-5ca5924a219b service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:29.555521 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b80d94-e827-4067-8e7b-5ca5924a219b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:29.564206 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b80d94-e827-4067-8e7b-5ca5924a219b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:29.565652 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b80d94-e827-4067-8e7b-5ca5924a219b service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:31:29.574962 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 635/1269] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:31:29 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:31:34.518058 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d255e-8fde-4b01-94bc-df740c8760a4 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:34.518666 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d255e-8fde-4b01-94bc-df740c8760a4 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:34.518666 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d255e-8fde-4b01-94bc-df740c8760a4 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:34.520321 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 635/1270] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:31:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:34.526534 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f9a94-9695-41bb-a2dc-8dee5d927245 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:34.527434 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f9a94-9695-41bb-a2dc-8dee5d927245 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:34.527797 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f9a94-9695-41bb-a2dc-8dee5d927245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:34.550613 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-bd7f9a94-9695-41bb-a2dc-8dee5d927245 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:34.551809 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-bd7f9a94-9695-41bb-a2dc-8dee5d927245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:34.560398 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 636/1271] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:31:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:34.600805 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d255e-8fde-4b01-94bc-df740c8760a4 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:34.611876 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d255e-8fde-4b01-94bc-df740c8760a4 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:34.615647 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058245ba-6093-49b6-882c-70cbf5bda20f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:34.616229 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058245ba-6093-49b6-882c-70cbf5bda20f service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:34.616542 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058245ba-6093-49b6-882c-70cbf5bda20f service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:34.616915 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058245ba-6093-49b6-882c-70cbf5bda20f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:34.627259 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058245ba-6093-49b6-882c-70cbf5bda20f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:34.628751 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058245ba-6093-49b6-882c-70cbf5bda20f service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:31:34.639016 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 636/1272] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:31:34 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:31:39.131031 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a766b8-ce38-41dc-b6ab-88b4271cc081 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:39.131539 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a766b8-ce38-41dc-b6ab-88b4271cc081 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:39.131851 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a766b8-ce38-41dc-b6ab-88b4271cc081 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:39.143676 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 637/1273] 10.222.0.64 () {54 vars in 921 bytes} [Thu Dec 16 14:31:39 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:39.145679 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfcc95-5c56-4fe8-b3c6-253b544e581d None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:39.146561 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfcc95-5c56-4fe8-b3c6-253b544e581d None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:39.147066 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfcc95-5c56-4fe8-b3c6-253b544e581d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:39.272165 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-b5bfcc95-5c56-4fe8-b3c6-253b544e581d None None] MFA Rules not processed for user `0e9a2114d29c4edeb20f394140d390bb`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:39.273413 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-b5bfcc95-5c56-4fe8-b3c6-253b544e581d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:39.377701 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 637/1274] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Dec 16 14:31:39 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:31:39.765510 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8ec3b-e6be-458d-a92d-9effbf743c86 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:39.766119 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8ec3b-e6be-458d-a92d-9effbf743c86 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:39.766711 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8ec3b-e6be-458d-a92d-9effbf743c86 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:39.768591 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 638/1275] 10.222.0.64 () {54 vars in 921 bytes} [Thu Dec 16 14:31:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:39.773806 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c94a22-2db7-4dbb-8f70-1f227e61cc09 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:39.774102 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c94a22-2db7-4dbb-8f70-1f227e61cc09 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:39.774387 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c94a22-2db7-4dbb-8f70-1f227e61cc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:39.800419 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-42c94a22-2db7-4dbb-8f70-1f227e61cc09 None None] MFA Rules not processed for user `0e9a2114d29c4edeb20f394140d390bb`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:39.801600 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-42c94a22-2db7-4dbb-8f70-1f227e61cc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:39.814437 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 638/1276] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Dec 16 14:31:39 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:43.650144 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73f34c-702c-4514-8dc0-b261dd404e79 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:43.650778 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73f34c-702c-4514-8dc0-b261dd404e79 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:43.651027 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73f34c-702c-4514-8dc0-b261dd404e79 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:43.653111 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 639/1277] 10.222.0.64 () {54 vars in 921 bytes} [Thu Dec 16 14:31:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:43.657978 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e6a94-dd18-4fb7-9321-3ae9d37ff911 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:43.658817 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e6a94-dd18-4fb7-9321-3ae9d37ff911 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:43.659328 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e6a94-dd18-4fb7-9321-3ae9d37ff911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:43.684451 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-ec3e6a94-dd18-4fb7-9321-3ae9d37ff911 None None] MFA Rules not processed for user `0e9a2114d29c4edeb20f394140d390bb`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:43.686768 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-ec3e6a94-dd18-4fb7-9321-3ae9d37ff911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:43.696593 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 639/1278] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Dec 16 14:31:43 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:45.154745 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05845ed-39a9-46cf-9e16-a0ab05def23f None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:45.155238 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05845ed-39a9-46cf-9e16-a0ab05def23f None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:45.155368 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05845ed-39a9-46cf-9e16-a0ab05def23f None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:45.157213 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 640/1279] 10.222.0.64 () {54 vars in 921 bytes} [Thu Dec 16 14:31:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:45.162642 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178c1c6-8846-463b-a221-8afbf1380042 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:45.163088 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178c1c6-8846-463b-a221-8afbf1380042 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:45.163980 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178c1c6-8846-463b-a221-8afbf1380042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:45.188484 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-d178c1c6-8846-463b-a221-8afbf1380042 None None] MFA Rules not processed for user `0e9a2114d29c4edeb20f394140d390bb`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:45.189875 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-d178c1c6-8846-463b-a221-8afbf1380042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:45.199200 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 640/1280] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Dec 16 14:31:45 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:49.101207 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec640de-f8a5-4126-b607-da0a28a23385 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:49.101740 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec640de-f8a5-4126-b607-da0a28a23385 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:49.101833 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec640de-f8a5-4126-b607-da0a28a23385 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:49.103430 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 641/1281] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:31:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:49.109092 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64165cd1-49b4-470e-9374-41ec79418f0a None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:49.109637 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64165cd1-49b4-470e-9374-41ec79418f0a None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:49.109740 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64165cd1-49b4-470e-9374-41ec79418f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:49.132203 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-64165cd1-49b4-470e-9374-41ec79418f0a None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:49.133509 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-64165cd1-49b4-470e-9374-41ec79418f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:49.142077 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 641/1282] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:31:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:49.190966 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2479e-7105-40d1-b4ab-a1cbdd60f65d None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:49.191263 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2479e-7105-40d1-b4ab-a1cbdd60f65d None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:49.191551 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2479e-7105-40d1-b4ab-a1cbdd60f65d None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:49.193323 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 642/1283] 10.222.0.64 () {54 vars in 959 bytes} [Thu Dec 16 14:31:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 16 14:31:49.198949 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5039f88-c995-4e31-93a2-764eb2c777d7 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:49.199245 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5039f88-c995-4e31-93a2-764eb2c777d7 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:49.199532 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5039f88-c995-4e31-93a2-764eb2c777d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:49.274043 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-f5039f88-c995-4e31-93a2-764eb2c777d7 None None] MFA Rules not processed for user `8e416527de444ef1b744da062ee1e7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:49.275127 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-f5039f88-c995-4e31-93a2-764eb2c777d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:49.369459 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 642/1284] 10.222.0.64 () {58 vars in 1056 bytes} [Thu Dec 16 14:31:49 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:49.377550 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2479e-7105-40d1-b4ab-a1cbdd60f65d None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:49.392267 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2479e-7105-40d1-b4ab-a1cbdd60f65d None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:49.397496 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45b9c6-3824-4e07-bd6c-84ec75b19e84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:49.398071 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45b9c6-3824-4e07-bd6c-84ec75b19e84 service nova] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:49.398364 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45b9c6-3824-4e07-bd6c-84ec75b19e84 service nova] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:49.398645 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45b9c6-3824-4e07-bd6c-84ec75b19e84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:49.407205 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45b9c6-3824-4e07-bd6c-84ec75b19e84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:49.409135 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45b9c6-3824-4e07-bd6c-84ec75b19e84 service nova] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:31:49.422752 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 643/1285] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:31:49 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:31:51.864455 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d6a97-b839-4fff-8cfb-099802479895 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:51.865088 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d6a97-b839-4fff-8cfb-099802479895 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:51.865088 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d6a97-b839-4fff-8cfb-099802479895 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:51.867449 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 643/1286] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:31:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:51.873251 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7491ce-2b6b-4a42-9ce9-1a0886ce3b99 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:51.873749 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7491ce-2b6b-4a42-9ce9-1a0886ce3b99 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:51.873827 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7491ce-2b6b-4a42-9ce9-1a0886ce3b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:51.896595 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-2d7491ce-2b6b-4a42-9ce9-1a0886ce3b99 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:51.897840 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-2d7491ce-2b6b-4a42-9ce9-1a0886ce3b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:51.905223 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 644/1287] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:31:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:51.951459 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d6a97-b839-4fff-8cfb-099802479895 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:51.965013 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d6a97-b839-4fff-8cfb-099802479895 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:51.970218 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ca0ca-176e-4971-803c-8c519a3b64d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:51.970790 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ca0ca-176e-4971-803c-8c519a3b64d1 service nova] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:51.971078 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ca0ca-176e-4971-803c-8c519a3b64d1 service nova] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:51.971358 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ca0ca-176e-4971-803c-8c519a3b64d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:51.980322 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ca0ca-176e-4971-803c-8c519a3b64d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:51.981933 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ca0ca-176e-4971-803c-8c519a3b64d1 service nova] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:31:51.991643 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 644/1288] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:31:51 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:31:54.493220 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89f799-159b-47a8-bbb7-3dfa63cc4b42 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:54.493755 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89f799-159b-47a8-bbb7-3dfa63cc4b42 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:54.493851 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89f799-159b-47a8-bbb7-3dfa63cc4b42 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:54.495501 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 645/1289] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:31:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:54.501084 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6bab9-3bd7-412a-80d8-24b9d3547fb6 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:54.501473 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6bab9-3bd7-412a-80d8-24b9d3547fb6 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:54.501663 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6bab9-3bd7-412a-80d8-24b9d3547fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:54.524513 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-f3d6bab9-3bd7-412a-80d8-24b9d3547fb6 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:54.525680 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-f3d6bab9-3bd7-412a-80d8-24b9d3547fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:54.532848 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 645/1290] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:31:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:54.577921 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64493baf-9eb0-4da5-9947-c4cf628c2250 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:54.578236 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64493baf-9eb0-4da5-9947-c4cf628c2250 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:54.578518 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64493baf-9eb0-4da5-9947-c4cf628c2250 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:54.580195 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 646/1291] 10.222.0.64 () {54 vars in 959 bytes} [Thu Dec 16 14:31:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:54.585949 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dfceb-e9b5-4dad-8c4e-a5ec1bb09f9c None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:54.586270 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dfceb-e9b5-4dad-8c4e-a5ec1bb09f9c None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:54.586553 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dfceb-e9b5-4dad-8c4e-a5ec1bb09f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:54.609373 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-c38dfceb-e9b5-4dad-8c4e-a5ec1bb09f9c None None] MFA Rules not processed for user `8e416527de444ef1b744da062ee1e7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:54.610507 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-c38dfceb-e9b5-4dad-8c4e-a5ec1bb09f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:54.619330 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 646/1292] 10.222.0.64 () {58 vars in 1056 bytes} [Thu Dec 16 14:31:54 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:54.626964 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64493baf-9eb0-4da5-9947-c4cf628c2250 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:54.640871 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64493baf-9eb0-4da5-9947-c4cf628c2250 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:54.645902 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28452d-f212-4966-a70c-92c1dfbd857f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:54.646664 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28452d-f212-4966-a70c-92c1dfbd857f service nova] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:54.646802 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28452d-f212-4966-a70c-92c1dfbd857f service nova] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:54.647020 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28452d-f212-4966-a70c-92c1dfbd857f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:54.655239 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b28452d-f212-4966-a70c-92c1dfbd857f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:54.656856 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b28452d-f212-4966-a70c-92c1dfbd857f service nova] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:31:54.666362 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 647/1293] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:31:54 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:31:56.870111 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea33241-71fe-457c-a316-12603c7151bd None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:56.870946 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea33241-71fe-457c-a316-12603c7151bd None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:56.870946 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea33241-71fe-457c-a316-12603c7151bd None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:56.872295 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 647/1294] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:31:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:56.878302 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43b646-d551-418e-8628-804eda9fbeb8 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:56.878709 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43b646-d551-418e-8628-804eda9fbeb8 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:56.878938 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43b646-d551-418e-8628-804eda9fbeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:56.907816 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-3b43b646-d551-418e-8628-804eda9fbeb8 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:56.909170 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-3b43b646-d551-418e-8628-804eda9fbeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:56.916901 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 648/1295] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:31:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:56.964857 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea33241-71fe-457c-a316-12603c7151bd None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:56.979650 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea33241-71fe-457c-a316-12603c7151bd None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:56.984842 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32015b82-c489-4833-b056-627b91752482 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:56.985428 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32015b82-c489-4833-b056-627b91752482 service nova] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:56.985717 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32015b82-c489-4833-b056-627b91752482 service nova] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:56.986001 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32015b82-c489-4833-b056-627b91752482 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:56.995262 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32015b82-c489-4833-b056-627b91752482 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:56.996869 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32015b82-c489-4833-b056-627b91752482 service nova] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:31:57.007036 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 648/1296] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:31:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:31:59.187601 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b749e-fb9d-4c2e-93ee-acf2de2f72e6 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:59.188125 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b749e-fb9d-4c2e-93ee-acf2de2f72e6 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:59.188125 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b749e-fb9d-4c2e-93ee-acf2de2f72e6 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:59.189855 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 649/1297] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:31:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:59.195769 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee8c35-6b41-463b-a549-6ff707c09105 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:59.196200 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee8c35-6b41-463b-a549-6ff707c09105 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:59.196353 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee8c35-6b41-463b-a549-6ff707c09105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:59.218643 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-13ee8c35-6b41-463b-a549-6ff707c09105 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:59.219788 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-13ee8c35-6b41-463b-a549-6ff707c09105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:59.227768 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 649/1298] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:31:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:59.271374 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b749e-fb9d-4c2e-93ee-acf2de2f72e6 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:59.285750 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b749e-fb9d-4c2e-93ee-acf2de2f72e6 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:59.291444 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9b503-1c7a-4b3a-a814-1034cb7320f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:59.292035 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9b503-1c7a-4b3a-a814-1034cb7320f5 service nova] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:59.292322 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9b503-1c7a-4b3a-a814-1034cb7320f5 service nova] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:59.292624 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9b503-1c7a-4b3a-a814-1034cb7320f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:59.300714 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9b503-1c7a-4b3a-a814-1034cb7320f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:59.302300 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9b503-1c7a-4b3a-a814-1034cb7320f5 service nova] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:31:59.311082 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 650/1299] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:31:59 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:32:01.461575 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb1bf9-93c5-4769-aa5e-506d7f0c097c None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:01.462143 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb1bf9-93c5-4769-aa5e-506d7f0c097c None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:01.462143 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb1bf9-93c5-4769-aa5e-506d7f0c097c None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:01.463834 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 650/1300] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:32:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 16 14:32:01.469140 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73caef-eb1d-4130-8511-462612be5b59 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:01.469567 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73caef-eb1d-4130-8511-462612be5b59 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:01.469701 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73caef-eb1d-4130-8511-462612be5b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:01.492356 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-2e73caef-eb1d-4130-8511-462612be5b59 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:01.493549 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-2e73caef-eb1d-4130-8511-462612be5b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:01.500715 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 651/1301] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:32:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:32:01.545064 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb1bf9-93c5-4769-aa5e-506d7f0c097c None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:32:01.559331 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb1bf9-93c5-4769-aa5e-506d7f0c097c None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:32:01.564834 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026389bd-e768-4c35-bc69-869fadf6662f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:32:01.565417 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026389bd-e768-4c35-bc69-869fadf6662f service nova] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:01.565708 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026389bd-e768-4c35-bc69-869fadf6662f service nova] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:01.565991 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026389bd-e768-4c35-bc69-869fadf6662f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:01.574544 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026389bd-e768-4c35-bc69-869fadf6662f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:32:01.576108 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026389bd-e768-4c35-bc69-869fadf6662f service nova] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:32:01.585974 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 651/1302] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:32:01 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:32:03.728082 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076e11f-a49a-4794-8bb3-bac0afd34bb0 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:03.728648 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076e11f-a49a-4794-8bb3-bac0afd34bb0 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:03.728648 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076e11f-a49a-4794-8bb3-bac0afd34bb0 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:03.730352 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 652/1303] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:32:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:32:03.736228 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c74e1-f487-4310-9efd-a07a8e40ffa1 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:03.736669 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c74e1-f487-4310-9efd-a07a8e40ffa1 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:03.736840 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c74e1-f487-4310-9efd-a07a8e40ffa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:03.762457 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-2c1c74e1-f487-4310-9efd-a07a8e40ffa1 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:03.763624 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-2c1c74e1-f487-4310-9efd-a07a8e40ffa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:03.770900 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 652/1304] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:32:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:32:03.812750 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076e11f-a49a-4794-8bb3-bac0afd34bb0 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:32:03.827803 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076e11f-a49a-4794-8bb3-bac0afd34bb0 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:32:03.834652 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca9781-08bc-44b9-824e-9f46f62b13e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:32:03.835246 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca9781-08bc-44b9-824e-9f46f62b13e2 service nova] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:03.835545 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca9781-08bc-44b9-824e-9f46f62b13e2 service nova] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:03.835832 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca9781-08bc-44b9-824e-9f46f62b13e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:03.846326 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca9781-08bc-44b9-824e-9f46f62b13e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:32:03.847934 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca9781-08bc-44b9-824e-9f46f62b13e2 service nova] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:32:03.858182 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 653/1305] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:32:03 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:32:05.987445 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36922ac6-9063-469e-9596-d3ade5cad6d4 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:05.987980 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36922ac6-9063-469e-9596-d3ade5cad6d4 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:05.988097 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36922ac6-9063-469e-9596-d3ade5cad6d4 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:05.989899 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 653/1306] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:32:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:32:05.995610 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b8337-84fe-4946-93aa-d3d123b22986 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:05.996103 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b8337-84fe-4946-93aa-d3d123b22986 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:05.996198 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b8337-84fe-4946-93aa-d3d123b22986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:06.019875 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-5a1b8337-84fe-4946-93aa-d3d123b22986 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:06.021076 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-5a1b8337-84fe-4946-93aa-d3d123b22986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:06.029009 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 654/1307] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:32:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:32:06.073497 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36922ac6-9063-469e-9596-d3ade5cad6d4 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:32:06.089135 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36922ac6-9063-469e-9596-d3ade5cad6d4 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:32:06.094586 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b041e6a-bb0a-40e1-a8f9-e33ce1e32cc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:32:06.095171 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b041e6a-bb0a-40e1-a8f9-e33ce1e32cc6 service nova] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:06.095466 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b041e6a-bb0a-40e1-a8f9-e33ce1e32cc6 service nova] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:06.095751 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b041e6a-bb0a-40e1-a8f9-e33ce1e32cc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:06.105305 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b041e6a-bb0a-40e1-a8f9-e33ce1e32cc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:32:06.106896 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b041e6a-bb0a-40e1-a8f9-e33ce1e32cc6 service nova] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:32:06.116835 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 654/1308] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:32:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:32:08.314888 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e7697-2b9f-43ea-b446-86d6bd5c48c9 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:08.315462 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e7697-2b9f-43ea-b446-86d6bd5c48c9 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:08.315462 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e7697-2b9f-43ea-b446-86d6bd5c48c9 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:08.317279 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 655/1309] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:32:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:32:08.322830 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf72cc3-4e3b-4e8e-85e8-85c3b4cfa9d4 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:08.323283 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf72cc3-4e3b-4e8e-85e8-85c3b4cfa9d4 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:08.323424 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf72cc3-4e3b-4e8e-85e8-85c3b4cfa9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:08.346282 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-eaf72cc3-4e3b-4e8e-85e8-85c3b4cfa9d4 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:08.347482 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-eaf72cc3-4e3b-4e8e-85e8-85c3b4cfa9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:08.355870 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 655/1310] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:32:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:32:08.399645 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e7697-2b9f-43ea-b446-86d6bd5c48c9 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:32:08.414092 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e7697-2b9f-43ea-b446-86d6bd5c48c9 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:32:08.419230 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d9092-7772-466e-9979-ad03af90ecb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:32:08.419803 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d9092-7772-466e-9979-ad03af90ecb2 service nova] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:08.420094 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d9092-7772-466e-9979-ad03af90ecb2 service nova] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:08.420379 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d9092-7772-466e-9979-ad03af90ecb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:08.429021 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d9092-7772-466e-9979-ad03af90ecb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:32:08.430606 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d9092-7772-466e-9979-ad03af90ecb2 service nova] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:32:08.439960 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 656/1311] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:32:08 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:32:10.558062 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfaf24-d785-44af-ab12-c7ca1c7ec97a None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:10.558632 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfaf24-d785-44af-ab12-c7ca1c7ec97a None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:10.558632 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfaf24-d785-44af-ab12-c7ca1c7ec97a None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:10.560319 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 656/1312] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:32:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:32:10.565814 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458c9d7-b26e-4390-b835-d11e5d3db4f8 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:10.566276 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458c9d7-b26e-4390-b835-d11e5d3db4f8 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:10.566415 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458c9d7-b26e-4390-b835-d11e5d3db4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:10.589230 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-0458c9d7-b26e-4390-b835-d11e5d3db4f8 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:10.590367 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-0458c9d7-b26e-4390-b835-d11e5d3db4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:10.597486 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 657/1313] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:32:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:32:10.640804 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfaf24-d785-44af-ab12-c7ca1c7ec97a None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:32:10.655063 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfaf24-d785-44af-ab12-c7ca1c7ec97a None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:32:10.661016 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eafb40-fa09-4151-86df-82c1c4ab8817 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:32:10.662311 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eafb40-fa09-4151-86df-82c1c4ab8817 service nova] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:10.662711 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eafb40-fa09-4151-86df-82c1c4ab8817 service nova] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:10.663094 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eafb40-fa09-4151-86df-82c1c4ab8817 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:10.672516 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eafb40-fa09-4151-86df-82c1c4ab8817 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:32:10.674145 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eafb40-fa09-4151-86df-82c1c4ab8817 service nova] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:32:10.683083 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 657/1314] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:32:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:32:12.843129 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a046835-c494-4b65-a1af-d1cdadb157dc None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:12.843659 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a046835-c494-4b65-a1af-d1cdadb157dc None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:12.843747 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a046835-c494-4b65-a1af-d1cdadb157dc None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:12.845459 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 658/1315] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:32:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:32:12.851112 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87fb35-9a69-4531-9b7b-251464433811 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:12.851605 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87fb35-9a69-4531-9b7b-251464433811 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:12.851698 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87fb35-9a69-4531-9b7b-251464433811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:12.875245 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-ea87fb35-9a69-4531-9b7b-251464433811 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:12.876448 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-ea87fb35-9a69-4531-9b7b-251464433811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:12.884384 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 658/1316] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:32:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:32:12.929874 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a046835-c494-4b65-a1af-d1cdadb157dc None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:32:12.944302 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a046835-c494-4b65-a1af-d1cdadb157dc None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:32:12.949715 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9ae7b-f9aa-4ae0-a067-8cfd520ed080 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:32:12.950293 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9ae7b-f9aa-4ae0-a067-8cfd520ed080 service nova] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:12.950578 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9ae7b-f9aa-4ae0-a067-8cfd520ed080 service nova] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:12.950857 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9ae7b-f9aa-4ae0-a067-8cfd520ed080 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:12.959694 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9ae7b-f9aa-4ae0-a067-8cfd520ed080 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:32:12.961236 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9ae7b-f9aa-4ae0-a067-8cfd520ed080 service nova] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:32:12.970312 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 659/1317] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:32:12 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:32:15.169923 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480c046-4c42-4069-87b0-e8901aad1025 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:15.170762 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480c046-4c42-4069-87b0-e8901aad1025 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:15.170762 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480c046-4c42-4069-87b0-e8901aad1025 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:15.172393 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 659/1318] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:32:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:32:15.178604 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5451c-baf5-4bf8-9d18-aed2b2e587f9 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:15.179223 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5451c-baf5-4bf8-9d18-aed2b2e587f9 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:15.179223 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5451c-baf5-4bf8-9d18-aed2b2e587f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:15.202686 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-f5f5451c-baf5-4bf8-9d18-aed2b2e587f9 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:15.203902 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-f5f5451c-baf5-4bf8-9d18-aed2b2e587f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:15.211265 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 660/1319] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:32:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:32:15.256503 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480c046-4c42-4069-87b0-e8901aad1025 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:32:15.270210 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480c046-4c42-4069-87b0-e8901aad1025 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:32:15.275346 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec44b2-d683-4745-9e2e-d6344172dcf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:32:15.275953 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec44b2-d683-4745-9e2e-d6344172dcf3 service nova] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:15.276258 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec44b2-d683-4745-9e2e-d6344172dcf3 service nova] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:15.276534 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec44b2-d683-4745-9e2e-d6344172dcf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:15.285390 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec44b2-d683-4745-9e2e-d6344172dcf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:32:15.287471 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec44b2-d683-4745-9e2e-d6344172dcf3 service nova] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:32:15.297258 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 660/1320] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:32:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:32:25.670370 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf1a9b-2b62-459d-b674-0a7189675090 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:25.670957 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf1a9b-2b62-459d-b674-0a7189675090 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:25.670957 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf1a9b-2b62-459d-b674-0a7189675090 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:25.672613 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 661/1321] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:32:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:32:25.678529 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeafa86-10ed-4df8-8e9e-3544d08d0e87 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:25.678983 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeafa86-10ed-4df8-8e9e-3544d08d0e87 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:25.679144 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeafa86-10ed-4df8-8e9e-3544d08d0e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:25.703112 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-ceeafa86-10ed-4df8-8e9e-3544d08d0e87 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:25.704262 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-ceeafa86-10ed-4df8-8e9e-3544d08d0e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:25.711480 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 661/1322] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:32:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:32:25.772855 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c19b42-5392-42be-a26e-b915a71cb5ac None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:25.773154 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c19b42-5392-42be-a26e-b915a71cb5ac None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:25.773441 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c19b42-5392-42be-a26e-b915a71cb5ac None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:25.775347 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 662/1323] 10.222.0.64 () {54 vars in 962 bytes} [Thu Dec 16 14:32:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:32:25.780189 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebaf934-df0d-4289-8ad9-12c8dfb98ebb None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:25.780560 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebaf934-df0d-4289-8ad9-12c8dfb98ebb None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:25.780961 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebaf934-df0d-4289-8ad9-12c8dfb98ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:25.849768 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-4ebaf934-df0d-4289-8ad9-12c8dfb98ebb None None] MFA Rules not processed for user `0050dc5fdd5641318319ff698112188c`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:25.850923 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-4ebaf934-df0d-4289-8ad9-12c8dfb98ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:25.919588 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 662/1324] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Dec 16 14:32:25 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:32:25.928200 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c19b42-5392-42be-a26e-b915a71cb5ac None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:32:25.939123 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c19b42-5392-42be-a26e-b915a71cb5ac None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:32:25.942802 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4524e69-90de-47a5-b828-a2dbf43f6f89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:32:25.943410 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4524e69-90de-47a5-b828-a2dbf43f6f89 service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:25.943699 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4524e69-90de-47a5-b828-a2dbf43f6f89 service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:25.943982 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4524e69-90de-47a5-b828-a2dbf43f6f89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:25.954175 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4524e69-90de-47a5-b828-a2dbf43f6f89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:32:25.955637 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4524e69-90de-47a5-b828-a2dbf43f6f89 service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:32:25.966231 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 663/1325] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:32:25 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:32:39.926427 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449256c9-4b2f-47f7-953e-0247336123c6 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:39.926968 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449256c9-4b2f-47f7-953e-0247336123c6 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:39.927095 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449256c9-4b2f-47f7-953e-0247336123c6 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:39.928679 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 663/1326] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:32:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:32:39.933925 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794149ce-0026-4b4d-96cc-275c20930f50 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:39.934358 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794149ce-0026-4b4d-96cc-275c20930f50 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:39.934510 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794149ce-0026-4b4d-96cc-275c20930f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:39.956894 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-794149ce-0026-4b4d-96cc-275c20930f50 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:39.958076 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-794149ce-0026-4b4d-96cc-275c20930f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:39.965662 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 664/1327] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:32:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:32:40.023120 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56928661-5542-42e2-81cb-4a6983a44243 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:40.023410 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56928661-5542-42e2-81cb-4a6983a44243 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:40.023764 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56928661-5542-42e2-81cb-4a6983a44243 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:40.025391 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 664/1328] 10.222.0.64 () {54 vars in 956 bytes} [Thu Dec 16 14:32:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:32:40.030179 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bde33-298e-4723-b816-777881985bd1 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:40.030477 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bde33-298e-4723-b816-777881985bd1 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:40.030765 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bde33-298e-4723-b816-777881985bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:40.098226 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-052bde33-298e-4723-b816-777881985bd1 None None] MFA Rules not processed for user `2ccebf28ac494f608c33437fc34139be`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:40.099383 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-052bde33-298e-4723-b816-777881985bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:40.166480 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 665/1329] 10.222.0.64 () {58 vars in 1053 bytes} [Thu Dec 16 14:32:40 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:32:40.174183 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56928661-5542-42e2-81cb-4a6983a44243 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:32:40.184360 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56928661-5542-42e2-81cb-4a6983a44243 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:32:40.187630 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde2ae4-0893-4a77-ae03-7b8c1978fc27 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ccebf28ac494f608c33437fc34139be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:32:40.188183 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde2ae4-0893-4a77-ae03-7b8c1978fc27 service glance] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:40.188467 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde2ae4-0893-4a77-ae03-7b8c1978fc27 service glance] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:40.188747 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde2ae4-0893-4a77-ae03-7b8c1978fc27 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:40.197753 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde2ae4-0893-4a77-ae03-7b8c1978fc27 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:32:40.199154 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde2ae4-0893-4a77-ae03-7b8c1978fc27 service glance] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:32:40.208869 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 665/1330] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:32:40 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:32:40.643365 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54694e36-75a8-41e6-b236-cf0ece88118c None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:40.643665 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54694e36-75a8-41e6-b236-cf0ece88118c None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:40.643952 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54694e36-75a8-41e6-b236-cf0ece88118c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:40.713107 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-54694e36-75a8-41e6-b236-cf0ece88118c None None] MFA Rules not processed for user `fa7dedfceea346ca997eedec181935c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:40.714361 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-54694e36-75a8-41e6-b236-cf0ece88118c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:40.785342 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 666/1331] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Dec 16 14:32:40 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:32:40.830080 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef9c84-096f-4c70-9154-936d9f960604 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:40.830384 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef9c84-096f-4c70-9154-936d9f960604 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:40.830701 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef9c84-096f-4c70-9154-936d9f960604 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:40.832510 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 666/1332] 10.222.0.64 () {54 vars in 942 bytes} [Thu Dec 16 14:32:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:32:40.839455 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdeb67-21fd-420a-8ab0-4df683a82c46 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:40.839793 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdeb67-21fd-420a-8ab0-4df683a82c46 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:40.840081 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdeb67-21fd-420a-8ab0-4df683a82c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:40.908934 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-70fdeb67-21fd-420a-8ab0-4df683a82c46 None None] MFA Rules not processed for user `de4c90e44b96488aa47fbbc302e4f7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:40.910138 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-70fdeb67-21fd-420a-8ab0-4df683a82c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:40.989154 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 667/1333] 10.222.0.64 () {58 vars in 1039 bytes} [Thu Dec 16 14:32:40 2021] POST /identity/v3/auth/tokens => generated 3734 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:32:40.998537 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef9c84-096f-4c70-9154-936d9f960604 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:32:41.011570 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef9c84-096f-4c70-9154-936d9f960604 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:32:41.016480 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2546d42-b401-40ea-8212-6e80d9fe127d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de4c90e44b96488aa47fbbc302e4f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:32:41.017079 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2546d42-b401-40ea-8212-6e80d9fe127d service swift] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:41.017368 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2546d42-b401-40ea-8212-6e80d9fe127d service swift] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:41.017648 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2546d42-b401-40ea-8212-6e80d9fe127d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:41.026554 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2546d42-b401-40ea-8212-6e80d9fe127d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:32:41.028128 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2546d42-b401-40ea-8212-6e80d9fe127d service swift] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:32:41.035777 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 667/1334] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Dec 16 14:32:40 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:32:58.028130 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b4e73-d08d-4453-a146-494670820aba None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:58.028704 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b4e73-d08d-4453-a146-494670820aba None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:58.028704 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b4e73-d08d-4453-a146-494670820aba None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:58.030462 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 668/1335] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:32:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:32:58.036393 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe171e5c-5f39-4c73-aad8-7a3af2b10605 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:58.036881 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe171e5c-5f39-4c73-aad8-7a3af2b10605 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:58.036985 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe171e5c-5f39-4c73-aad8-7a3af2b10605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:58.059425 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-fe171e5c-5f39-4c73-aad8-7a3af2b10605 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:58.060553 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-fe171e5c-5f39-4c73-aad8-7a3af2b10605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:58.067611 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 668/1336] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:32:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:32:58.089956 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b4e73-d08d-4453-a146-494670820aba None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:32:58.102281 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b4e73-d08d-4453-a146-494670820aba None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:32:58.106720 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec7cd9-caaa-4883-8f86-30f4fc439ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:32:58.107337 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec7cd9-caaa-4883-8f86-30f4fc439ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:58.107629 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec7cd9-caaa-4883-8f86-30f4fc439ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:58.107915 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec7cd9-caaa-4883-8f86-30f4fc439ba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:58.108629 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec7cd9-caaa-4883-8f86-30f4fc439ba9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:32:58.110637 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec7cd9-caaa-4883-8f86-30f4fc439ba9 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:32:58.126328 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 669/1337] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Dec 16 14:32:58 2021] GET /identity/v3/projects => generated 2553 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:33:00.179957 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f946a9-c8f4-455d-9a9b-93312d2f12eb None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:00.180520 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f946a9-c8f4-455d-9a9b-93312d2f12eb None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:00.180520 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f946a9-c8f4-455d-9a9b-93312d2f12eb None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:00.182235 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 669/1338] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:33:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:33:00.187631 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d81537-f487-42cb-87f0-7f0024121196 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:00.188037 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d81537-f487-42cb-87f0-7f0024121196 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:00.188203 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d81537-f487-42cb-87f0-7f0024121196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:00.210719 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-b7d81537-f487-42cb-87f0-7f0024121196 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:00.211852 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-b7d81537-f487-42cb-87f0-7f0024121196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:00.218913 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 670/1339] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:33:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:33:00.240868 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f946a9-c8f4-455d-9a9b-93312d2f12eb None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:00.254183 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f946a9-c8f4-455d-9a9b-93312d2f12eb None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:00.258457 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f025b-2939-463a-9580-e4b09a3cb7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:00.259235 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f025b-2939-463a-9580-e4b09a3cb7ba admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:00.259526 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f025b-2939-463a-9580-e4b09a3cb7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:00.259809 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f025b-2939-463a-9580-e4b09a3cb7ba admin admin] PATH_INFO: `/v3/projects/4379b60ef2094a39988c4f13a32f6cb0` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:00.260968 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f025b-2939-463a-9580-e4b09a3cb7ba admin admin] RBAC: Authorizing `identity:get_project(project_id=4379b60ef2094a39988c4f13a32f6cb0)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:00.262749 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f025b-2939-463a-9580-e4b09a3cb7ba admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:00.264297 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 670/1340] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:33:00 2021] GET /identity/v3/projects/4379b60ef2094a39988c4f13a32f6cb0 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:33:00.270921 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d81537-f487-42cb-87f0-7f0024121196 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:00.279735 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d81537-f487-42cb-87f0-7f0024121196 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:00.284053 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9457cf5-d4b0-44a7-81ba-436ef86f4577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:00.284634 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9457cf5-d4b0-44a7-81ba-436ef86f4577 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:00.284961 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9457cf5-d4b0-44a7-81ba-436ef86f4577 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:00.285248 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9457cf5-d4b0-44a7-81ba-436ef86f4577 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:00.285980 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9457cf5-d4b0-44a7-81ba-436ef86f4577 admin admin] RBAC: Adding query filter params (scope.project.id=4379b60ef2094a39988c4f13a32f6cb0) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:33:00.286274 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9457cf5-d4b0-44a7-81ba-436ef86f4577 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:00.288105 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9457cf5-d4b0-44a7-81ba-436ef86f4577 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:00.294036 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 671/1341] 10.222.0.64 () {56 vars in 1231 bytes} [Thu Dec 16 14:33:00 2021] GET /identity/v3/role_assignments?scope.project.id=4379b60ef2094a39988c4f13a32f6cb0 => generated 879 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:33:00.299660 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f025b-2939-463a-9580-e4b09a3cb7ba admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:00.308926 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f025b-2939-463a-9580-e4b09a3cb7ba admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:00.313258 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a94ad3-df71-4623-9278-0384878b00f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:00.314027 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a94ad3-df71-4623-9278-0384878b00f1 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:00.314316 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a94ad3-df71-4623-9278-0384878b00f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:00.314600 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a94ad3-df71-4623-9278-0384878b00f1 admin admin] PATH_INFO: `/v3/users/8c2ac62eab7c4164bfd09ecc79a439aa` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:00.316199 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a94ad3-df71-4623-9278-0384878b00f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=8c2ac62eab7c4164bfd09ecc79a439aa)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:00.318030 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a94ad3-df71-4623-9278-0384878b00f1 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:00.319480 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 671/1342] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:33:00 2021] GET /identity/v3/users/8c2ac62eab7c4164bfd09ecc79a439aa => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:33:02.431917 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b6acd-cd6c-4744-a5f6-c986a727c91e None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:02.432471 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b6acd-cd6c-4744-a5f6-c986a727c91e None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:02.432584 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b6acd-cd6c-4744-a5f6-c986a727c91e None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:02.434244 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 672/1343] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:33:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:33:02.439552 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1a020-9f4e-411e-b0c5-0aae727f196d None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:02.440001 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1a020-9f4e-411e-b0c5-0aae727f196d None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:02.440104 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1a020-9f4e-411e-b0c5-0aae727f196d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:02.463189 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-52b1a020-9f4e-411e-b0c5-0aae727f196d None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:02.464334 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-52b1a020-9f4e-411e-b0c5-0aae727f196d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:02.471339 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 672/1344] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:33:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:33:02.493278 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b6acd-cd6c-4744-a5f6-c986a727c91e None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:02.505536 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b6acd-cd6c-4744-a5f6-c986a727c91e None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:02.509621 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf75005-f003-4af0-871a-28f5bff011e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:02.510386 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf75005-f003-4af0-871a-28f5bff011e5 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:02.510671 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf75005-f003-4af0-871a-28f5bff011e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:02.510947 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf75005-f003-4af0-871a-28f5bff011e5 admin admin] PATH_INFO: `/v3/projects/6bf86bc7a5ce44648e90c18c73f6d76c` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:02.523124 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf75005-f003-4af0-871a-28f5bff011e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=6bf86bc7a5ce44648e90c18c73f6d76c)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:02.525183 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf75005-f003-4af0-871a-28f5bff011e5 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:02.526704 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 673/1345] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:33:02 2021] GET /identity/v3/projects/6bf86bc7a5ce44648e90c18c73f6d76c => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:33:02.532534 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1a020-9f4e-411e-b0c5-0aae727f196d None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:02.541491 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1a020-9f4e-411e-b0c5-0aae727f196d None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:02.546145 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df380448-ad28-45b1-afb3-7662b1d6a542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:02.546694 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df380448-ad28-45b1-afb3-7662b1d6a542 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:02.547032 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df380448-ad28-45b1-afb3-7662b1d6a542 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:02.547274 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df380448-ad28-45b1-afb3-7662b1d6a542 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:02.547993 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df380448-ad28-45b1-afb3-7662b1d6a542 admin admin] RBAC: Adding query filter params (scope.project.id=6bf86bc7a5ce44648e90c18c73f6d76c) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:33:02.548294 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df380448-ad28-45b1-afb3-7662b1d6a542 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:02.550193 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df380448-ad28-45b1-afb3-7662b1d6a542 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:02.555445 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 673/1346] 10.222.0.64 () {56 vars in 1231 bytes} [Thu Dec 16 14:33:02 2021] GET /identity/v3/role_assignments?scope.project.id=6bf86bc7a5ce44648e90c18c73f6d76c => generated 526 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:33:02.561065 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf75005-f003-4af0-871a-28f5bff011e5 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:02.570899 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf75005-f003-4af0-871a-28f5bff011e5 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:02.575152 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdb5c7-d537-4d6a-a890-51b566d7af85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:02.575933 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdb5c7-d537-4d6a-a890-51b566d7af85 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:02.576222 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdb5c7-d537-4d6a-a890-51b566d7af85 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:02.576501 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdb5c7-d537-4d6a-a890-51b566d7af85 admin admin] PATH_INFO: `/v3/users/245b657d6ed940609c3837f4ba5782d7` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:02.594789 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdb5c7-d537-4d6a-a890-51b566d7af85 admin admin] RBAC: Authorizing `identity:get_user(user_id=245b657d6ed940609c3837f4ba5782d7)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:02.596937 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdb5c7-d537-4d6a-a890-51b566d7af85 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:02.598448 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 674/1347] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:33:02 2021] GET /identity/v3/users/245b657d6ed940609c3837f4ba5782d7 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:33:04.694385 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ab63c-c7b0-4c07-b2b9-70c91279fd00 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:04.694941 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ab63c-c7b0-4c07-b2b9-70c91279fd00 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:04.694941 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ab63c-c7b0-4c07-b2b9-70c91279fd00 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:04.696630 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 674/1348] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:33:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:33:04.702182 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c295d-8e4e-415b-8861-10389193bb36 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:04.702616 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c295d-8e4e-415b-8861-10389193bb36 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:04.702782 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c295d-8e4e-415b-8861-10389193bb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:04.725136 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-b16c295d-8e4e-415b-8861-10389193bb36 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:04.726282 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-b16c295d-8e4e-415b-8861-10389193bb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:04.733449 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 675/1349] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:33:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:33:04.756969 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ab63c-c7b0-4c07-b2b9-70c91279fd00 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:04.771049 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ab63c-c7b0-4c07-b2b9-70c91279fd00 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:04.775212 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576b4c9-f338-4f2b-8fee-e692210cd970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:04.775978 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576b4c9-f338-4f2b-8fee-e692210cd970 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:04.776269 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576b4c9-f338-4f2b-8fee-e692210cd970 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:04.776553 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576b4c9-f338-4f2b-8fee-e692210cd970 admin admin] PATH_INFO: `/v3/projects/7a7037aca4f5455ebc03d2d45a2cbae8` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:04.788811 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576b4c9-f338-4f2b-8fee-e692210cd970 admin admin] RBAC: Authorizing `identity:get_project(project_id=7a7037aca4f5455ebc03d2d45a2cbae8)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:04.790929 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576b4c9-f338-4f2b-8fee-e692210cd970 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:04.792501 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 675/1350] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:33:04 2021] GET /identity/v3/projects/7a7037aca4f5455ebc03d2d45a2cbae8 => generated 311 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:33:04.798984 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c295d-8e4e-415b-8861-10389193bb36 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:04.807990 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c295d-8e4e-415b-8861-10389193bb36 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:04.812577 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457be811-bf4c-4d2d-b901-52568ebc2b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:04.813208 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457be811-bf4c-4d2d-b901-52568ebc2b72 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:04.813532 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457be811-bf4c-4d2d-b901-52568ebc2b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:04.813822 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457be811-bf4c-4d2d-b901-52568ebc2b72 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:04.814584 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457be811-bf4c-4d2d-b901-52568ebc2b72 admin admin] RBAC: Adding query filter params (scope.project.id=7a7037aca4f5455ebc03d2d45a2cbae8) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:33:04.814944 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457be811-bf4c-4d2d-b901-52568ebc2b72 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:04.817416 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457be811-bf4c-4d2d-b901-52568ebc2b72 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:04.823299 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 676/1351] 10.222.0.64 () {56 vars in 1231 bytes} [Thu Dec 16 14:33:04 2021] GET /identity/v3/role_assignments?scope.project.id=7a7037aca4f5455ebc03d2d45a2cbae8 => generated 877 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:33:04.829215 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576b4c9-f338-4f2b-8fee-e692210cd970 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:04.839194 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576b4c9-f338-4f2b-8fee-e692210cd970 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:04.843430 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585d884-b79f-4568-abe2-5b45c8f88e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:04.844215 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585d884-b79f-4568-abe2-5b45c8f88e27 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:04.844505 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585d884-b79f-4568-abe2-5b45c8f88e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:04.844823 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585d884-b79f-4568-abe2-5b45c8f88e27 admin admin] PATH_INFO: `/v3/users/ae07f8a9f9784a29b26f93862f7ace6b` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:04.863024 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585d884-b79f-4568-abe2-5b45c8f88e27 admin admin] RBAC: Authorizing `identity:get_user(user_id=ae07f8a9f9784a29b26f93862f7ace6b)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:04.865164 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585d884-b79f-4568-abe2-5b45c8f88e27 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:04.866697 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 676/1352] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:33:04 2021] GET /identity/v3/users/ae07f8a9f9784a29b26f93862f7ace6b => generated 286 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:33:04.872614 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457be811-bf4c-4d2d-b901-52568ebc2b72 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:04.882598 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457be811-bf4c-4d2d-b901-52568ebc2b72 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:04.886910 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb1440-d45e-4109-9e17-f4c3a7cdefd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:04.887700 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb1440-d45e-4109-9e17-f4c3a7cdefd0 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:04.887993 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb1440-d45e-4109-9e17-f4c3a7cdefd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:04.888283 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb1440-d45e-4109-9e17-f4c3a7cdefd0 admin admin] PATH_INFO: `/v3/users/b10f6a57c78940768b18d0349fee6de2` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:04.906973 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb1440-d45e-4109-9e17-f4c3a7cdefd0 admin admin] RBAC: Authorizing `identity:get_user(user_id=b10f6a57c78940768b18d0349fee6de2)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:04.909145 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb1440-d45e-4109-9e17-f4c3a7cdefd0 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:04.910665 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 677/1353] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:33:04 2021] GET /identity/v3/users/b10f6a57c78940768b18d0349fee6de2 => generated 285 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:33:07.093621 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e03e6-62ce-418e-9933-4fb41ff5c4aa None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:07.094173 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e03e6-62ce-418e-9933-4fb41ff5c4aa None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:07.094173 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e03e6-62ce-418e-9933-4fb41ff5c4aa None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:07.095864 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 677/1354] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:33:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 16 14:33:07.101149 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363c766-4a24-48f5-841b-785e51b30570 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:07.101541 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363c766-4a24-48f5-841b-785e51b30570 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:07.101719 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363c766-4a24-48f5-841b-785e51b30570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:07.123282 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-7363c766-4a24-48f5-841b-785e51b30570 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:07.124414 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-7363c766-4a24-48f5-841b-785e51b30570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:07.133125 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 678/1355] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:33:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:33:07.156105 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e03e6-62ce-418e-9933-4fb41ff5c4aa None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:07.168371 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e03e6-62ce-418e-9933-4fb41ff5c4aa None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:07.172602 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e1499-57d1-4891-bf10-9271aa39e814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:07.173436 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e1499-57d1-4891-bf10-9271aa39e814 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:07.173725 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e1499-57d1-4891-bf10-9271aa39e814 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:07.174008 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e1499-57d1-4891-bf10-9271aa39e814 admin admin] PATH_INFO: `/v3/projects/9fcacc34d06d4718a100e858ed8da87e` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:07.185898 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e1499-57d1-4891-bf10-9271aa39e814 admin admin] RBAC: Authorizing `identity:get_project(project_id=9fcacc34d06d4718a100e858ed8da87e)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:07.187945 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e1499-57d1-4891-bf10-9271aa39e814 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:07.189555 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 678/1356] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:33:07 2021] GET /identity/v3/projects/9fcacc34d06d4718a100e858ed8da87e => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:33:07.196234 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363c766-4a24-48f5-841b-785e51b30570 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:07.205078 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363c766-4a24-48f5-841b-785e51b30570 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:07.210110 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc619c85-4287-4694-9e95-a9df3ce224d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:07.210695 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc619c85-4287-4694-9e95-a9df3ce224d7 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:07.210988 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc619c85-4287-4694-9e95-a9df3ce224d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:07.211276 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc619c85-4287-4694-9e95-a9df3ce224d7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:07.212001 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc619c85-4287-4694-9e95-a9df3ce224d7 admin admin] RBAC: Adding query filter params (scope.project.id=9fcacc34d06d4718a100e858ed8da87e) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:33:07.212305 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc619c85-4287-4694-9e95-a9df3ce224d7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:07.214178 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc619c85-4287-4694-9e95-a9df3ce224d7 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:07.220658 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 679/1357] 10.222.0.64 () {56 vars in 1231 bytes} [Thu Dec 16 14:33:07 2021] GET /identity/v3/role_assignments?scope.project.id=9fcacc34d06d4718a100e858ed8da87e => generated 1934 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:33:07.226384 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e1499-57d1-4891-bf10-9271aa39e814 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:07.235747 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e1499-57d1-4891-bf10-9271aa39e814 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:07.240024 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d29bc-981e-49f5-b71e-02be49ee68ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:07.240821 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d29bc-981e-49f5-b71e-02be49ee68ed admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:07.241114 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d29bc-981e-49f5-b71e-02be49ee68ed admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:07.241394 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d29bc-981e-49f5-b71e-02be49ee68ed admin admin] PATH_INFO: `/v3/users/67f731571f024ec0a6d66107af3b9b7b` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:07.261448 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d29bc-981e-49f5-b71e-02be49ee68ed admin admin] RBAC: Authorizing `identity:get_user(user_id=67f731571f024ec0a6d66107af3b9b7b)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:07.263565 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d29bc-981e-49f5-b71e-02be49ee68ed admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:07.265124 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 679/1358] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:33:07 2021] GET /identity/v3/users/67f731571f024ec0a6d66107af3b9b7b => generated 275 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:33:07.271797 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc619c85-4287-4694-9e95-a9df3ce224d7 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:07.281329 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc619c85-4287-4694-9e95-a9df3ce224d7 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:07.285644 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc82f8-0daf-4095-af4c-0a21a86da60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:07.286429 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc82f8-0daf-4095-af4c-0a21a86da60c admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:07.286717 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc82f8-0daf-4095-af4c-0a21a86da60c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:07.287002 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc82f8-0daf-4095-af4c-0a21a86da60c admin admin] PATH_INFO: `/v3/users/8c2ac62eab7c4164bfd09ecc79a439aa` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:07.288107 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc82f8-0daf-4095-af4c-0a21a86da60c admin admin] RBAC: Authorizing `identity:get_user(user_id=8c2ac62eab7c4164bfd09ecc79a439aa)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:07.289947 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc82f8-0daf-4095-af4c-0a21a86da60c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:07.291397 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 680/1359] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:33:07 2021] GET /identity/v3/users/8c2ac62eab7c4164bfd09ecc79a439aa => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:33:09.451090 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d81417-a409-47c0-957e-85c6effb1771 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:09.451656 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d81417-a409-47c0-957e-85c6effb1771 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:09.451656 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d81417-a409-47c0-957e-85c6effb1771 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:09.453355 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 680/1360] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:33:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:33:09.458549 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fca7fb-df8f-475c-9135-3466268ad700 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:09.458951 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fca7fb-df8f-475c-9135-3466268ad700 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:09.459126 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fca7fb-df8f-475c-9135-3466268ad700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:09.481523 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-d3fca7fb-df8f-475c-9135-3466268ad700 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:09.482673 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-d3fca7fb-df8f-475c-9135-3466268ad700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:09.490475 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 681/1361] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:33:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:33:09.512746 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d81417-a409-47c0-957e-85c6effb1771 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:09.524763 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d81417-a409-47c0-957e-85c6effb1771 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:09.529081 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba62efc-397d-48b0-901f-e28d422c5873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:09.529845 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba62efc-397d-48b0-901f-e28d422c5873 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:09.530136 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba62efc-397d-48b0-901f-e28d422c5873 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:09.530419 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba62efc-397d-48b0-901f-e28d422c5873 admin admin] PATH_INFO: `/v3/projects/a8d01303259142829964b8d84896cd8b` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:09.542839 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba62efc-397d-48b0-901f-e28d422c5873 admin admin] RBAC: Authorizing `identity:get_project(project_id=a8d01303259142829964b8d84896cd8b)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:09.544893 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba62efc-397d-48b0-901f-e28d422c5873 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:09.546437 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 681/1362] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:33:09 2021] GET /identity/v3/projects/a8d01303259142829964b8d84896cd8b => generated 312 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:33:09.552984 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fca7fb-df8f-475c-9135-3466268ad700 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:09.561737 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fca7fb-df8f-475c-9135-3466268ad700 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:09.566061 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18f881-cb45-42fd-af86-ebe11ec2209a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:09.566649 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18f881-cb45-42fd-af86-ebe11ec2209a admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:09.566943 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18f881-cb45-42fd-af86-ebe11ec2209a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:09.567230 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18f881-cb45-42fd-af86-ebe11ec2209a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:09.567954 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18f881-cb45-42fd-af86-ebe11ec2209a admin admin] RBAC: Adding query filter params (scope.project.id=a8d01303259142829964b8d84896cd8b) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:33:09.568260 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18f881-cb45-42fd-af86-ebe11ec2209a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:09.570156 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18f881-cb45-42fd-af86-ebe11ec2209a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:09.575456 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 682/1363] 10.222.0.64 () {56 vars in 1231 bytes} [Thu Dec 16 14:33:09 2021] GET /identity/v3/role_assignments?scope.project.id=a8d01303259142829964b8d84896cd8b => generated 526 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:33:09.581438 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba62efc-397d-48b0-901f-e28d422c5873 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:09.590598 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba62efc-397d-48b0-901f-e28d422c5873 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:09.594848 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72ed8b-0355-4c24-9484-c0e15a2754a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:09.595622 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72ed8b-0355-4c24-9484-c0e15a2754a6 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:09.595907 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72ed8b-0355-4c24-9484-c0e15a2754a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:09.596186 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72ed8b-0355-4c24-9484-c0e15a2754a6 admin admin] PATH_INFO: `/v3/users/67f731571f024ec0a6d66107af3b9b7b` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:09.597905 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72ed8b-0355-4c24-9484-c0e15a2754a6 admin admin] RBAC: Authorizing `identity:get_user(user_id=67f731571f024ec0a6d66107af3b9b7b)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:09.599963 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72ed8b-0355-4c24-9484-c0e15a2754a6 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:09.601439 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 682/1364] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:33:09 2021] GET /identity/v3/users/67f731571f024ec0a6d66107af3b9b7b => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:33:11.718952 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a38e52-fb0b-4b10-adad-4490439ab69a None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:11.719578 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a38e52-fb0b-4b10-adad-4490439ab69a None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:11.719578 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a38e52-fb0b-4b10-adad-4490439ab69a None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:11.721240 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 683/1365] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:33:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:33:11.726553 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f0cd2-11eb-407d-b98f-d6bed45503c0 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:11.727091 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f0cd2-11eb-407d-b98f-d6bed45503c0 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:11.727197 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f0cd2-11eb-407d-b98f-d6bed45503c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:11.749671 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-393f0cd2-11eb-407d-b98f-d6bed45503c0 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:11.750933 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-393f0cd2-11eb-407d-b98f-d6bed45503c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:11.758918 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 683/1366] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:33:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:33:11.782105 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a38e52-fb0b-4b10-adad-4490439ab69a None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:11.794304 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a38e52-fb0b-4b10-adad-4490439ab69a None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:11.798481 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7352c62-e06c-455e-bae6-db7f6947911d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:11.799821 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7352c62-e06c-455e-bae6-db7f6947911d admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:11.800146 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7352c62-e06c-455e-bae6-db7f6947911d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:11.800434 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7352c62-e06c-455e-bae6-db7f6947911d admin admin] PATH_INFO: `/v3/projects/acd89025087841f89da0bfc29ec9d034` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:11.814036 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7352c62-e06c-455e-bae6-db7f6947911d admin admin] RBAC: Authorizing `identity:get_project(project_id=acd89025087841f89da0bfc29ec9d034)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:11.816719 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7352c62-e06c-455e-bae6-db7f6947911d admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:11.818344 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 684/1367] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:33:11 2021] GET /identity/v3/projects/acd89025087841f89da0bfc29ec9d034 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:33:11.824495 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f0cd2-11eb-407d-b98f-d6bed45503c0 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:11.833468 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f0cd2-11eb-407d-b98f-d6bed45503c0 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:11.837807 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b12fa5-f68e-4373-9370-d834abae4c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:11.838390 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b12fa5-f68e-4373-9370-d834abae4c02 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:11.838697 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b12fa5-f68e-4373-9370-d834abae4c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:11.839020 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b12fa5-f68e-4373-9370-d834abae4c02 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:11.839749 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b12fa5-f68e-4373-9370-d834abae4c02 admin admin] RBAC: Adding query filter params (scope.project.id=acd89025087841f89da0bfc29ec9d034) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:33:11.840050 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b12fa5-f68e-4373-9370-d834abae4c02 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:11.842049 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b12fa5-f68e-4373-9370-d834abae4c02 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:11.848526 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 684/1368] 10.222.0.64 () {56 vars in 1231 bytes} [Thu Dec 16 14:33:11 2021] GET /identity/v3/role_assignments?scope.project.id=acd89025087841f89da0bfc29ec9d034 => generated 1934 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:33:11.854323 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7352c62-e06c-455e-bae6-db7f6947911d admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:11.864252 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7352c62-e06c-455e-bae6-db7f6947911d admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:11.868589 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5712c6e-f843-4768-b726-c9313de5b470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:11.869403 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5712c6e-f843-4768-b726-c9313de5b470 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:11.869695 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5712c6e-f843-4768-b726-c9313de5b470 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:11.869980 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5712c6e-f843-4768-b726-c9313de5b470 admin admin] PATH_INFO: `/v3/users/8d8a1622bcd9425897519d9da0cbc520` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:11.888849 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5712c6e-f843-4768-b726-c9313de5b470 admin admin] RBAC: Authorizing `identity:get_user(user_id=8d8a1622bcd9425897519d9da0cbc520)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:11.890999 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5712c6e-f843-4768-b726-c9313de5b470 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:11.892533 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 685/1369] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:33:11 2021] GET /identity/v3/users/8d8a1622bcd9425897519d9da0cbc520 => generated 283 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:33:11.898256 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b12fa5-f68e-4373-9370-d834abae4c02 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:11.907750 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b12fa5-f68e-4373-9370-d834abae4c02 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:11.912076 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff1798-4cf2-4ec8-89f0-ac8446c9eb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:11.912894 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff1798-4cf2-4ec8-89f0-ac8446c9eb59 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:11.913184 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff1798-4cf2-4ec8-89f0-ac8446c9eb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:11.913465 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff1798-4cf2-4ec8-89f0-ac8446c9eb59 admin admin] PATH_INFO: `/v3/users/8c2ac62eab7c4164bfd09ecc79a439aa` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:11.914571 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff1798-4cf2-4ec8-89f0-ac8446c9eb59 admin admin] RBAC: Authorizing `identity:get_user(user_id=8c2ac62eab7c4164bfd09ecc79a439aa)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:11.916349 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff1798-4cf2-4ec8-89f0-ac8446c9eb59 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:11.918105 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 685/1370] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:33:11 2021] GET /identity/v3/users/8c2ac62eab7c4164bfd09ecc79a439aa => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:33:14.083059 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc2410-9cc3-4291-9d34-40aa3b6ca45e None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:14.083643 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc2410-9cc3-4291-9d34-40aa3b6ca45e None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:14.083765 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc2410-9cc3-4291-9d34-40aa3b6ca45e None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:14.085475 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 686/1371] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:33:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:33:14.090633 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed5ad5-9f5e-4e63-967e-c4fcbe1d84db None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:14.091023 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed5ad5-9f5e-4e63-967e-c4fcbe1d84db None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:14.091198 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed5ad5-9f5e-4e63-967e-c4fcbe1d84db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:14.113509 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-c1ed5ad5-9f5e-4e63-967e-c4fcbe1d84db None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:14.114648 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-c1ed5ad5-9f5e-4e63-967e-c4fcbe1d84db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:14.122581 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 686/1372] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:33:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:33:14.145962 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc2410-9cc3-4291-9d34-40aa3b6ca45e None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:14.158353 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc2410-9cc3-4291-9d34-40aa3b6ca45e None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:14.162552 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152e7c0-0f2d-40ac-a99c-7e9c40711446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:14.163322 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152e7c0-0f2d-40ac-a99c-7e9c40711446 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:14.163607 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152e7c0-0f2d-40ac-a99c-7e9c40711446 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:14.163889 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152e7c0-0f2d-40ac-a99c-7e9c40711446 admin admin] PATH_INFO: `/v3/projects/af621d04dda4452a90902aabb22b2a68` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:14.176319 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152e7c0-0f2d-40ac-a99c-7e9c40711446 admin admin] RBAC: Authorizing `identity:get_project(project_id=af621d04dda4452a90902aabb22b2a68)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:14.178383 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152e7c0-0f2d-40ac-a99c-7e9c40711446 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:14.179935 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 687/1373] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Dec 16 14:33:14 2021] GET /identity/v3/projects/af621d04dda4452a90902aabb22b2a68 => generated 361 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:33:14.186399 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed5ad5-9f5e-4e63-967e-c4fcbe1d84db None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:14.195676 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed5ad5-9f5e-4e63-967e-c4fcbe1d84db None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:14.200101 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcba6d6-2199-460e-b13b-db1c616632c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:14.200681 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcba6d6-2199-460e-b13b-db1c616632c0 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:14.200998 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcba6d6-2199-460e-b13b-db1c616632c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:14.201284 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcba6d6-2199-460e-b13b-db1c616632c0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:14.202003 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcba6d6-2199-460e-b13b-db1c616632c0 admin admin] RBAC: Adding query filter params (scope.project.id=af621d04dda4452a90902aabb22b2a68) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:33:14.202311 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcba6d6-2199-460e-b13b-db1c616632c0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:14.204126 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcba6d6-2199-460e-b13b-db1c616632c0 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:14.210237 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 687/1374] 10.222.0.64 () {56 vars in 1231 bytes} [Thu Dec 16 14:33:14 2021] GET /identity/v3/role_assignments?scope.project.id=af621d04dda4452a90902aabb22b2a68 => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:33:14.216013 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152e7c0-0f2d-40ac-a99c-7e9c40711446 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:14.225359 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152e7c0-0f2d-40ac-a99c-7e9c40711446 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:14.230207 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de00e4-41aa-4ad6-8a37-a060532764d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:14.230996 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de00e4-41aa-4ad6-8a37-a060532764d0 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:14.231283 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de00e4-41aa-4ad6-8a37-a060532764d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:14.231567 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de00e4-41aa-4ad6-8a37-a060532764d0 admin admin] PATH_INFO: `/v3/users/239000e6ed9c40b0a9286844cf26dc87` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:14.249932 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de00e4-41aa-4ad6-8a37-a060532764d0 admin admin] RBAC: Authorizing `identity:get_user(user_id=239000e6ed9c40b0a9286844cf26dc87)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:14.252654 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de00e4-41aa-4ad6-8a37-a060532764d0 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:14.254289 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 688/1375] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Dec 16 14:33:14 2021] GET /identity/v3/users/239000e6ed9c40b0a9286844cf26dc87 => generated 311 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:33:19.343939 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68490d-60b7-478d-b2ee-1cb620262b28 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:19.344559 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68490d-60b7-478d-b2ee-1cb620262b28 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:19.344559 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68490d-60b7-478d-b2ee-1cb620262b28 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:19.346856 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 688/1376] 10.222.0.64 () {54 vars in 918 bytes} [Thu Dec 16 14:33:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:33:19.352620 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de998f62-8d02-40c8-bf88-bdd91417f789 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:19.353084 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de998f62-8d02-40c8-bf88-bdd91417f789 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:19.353225 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de998f62-8d02-40c8-bf88-bdd91417f789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:19.374962 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-de998f62-8d02-40c8-bf88-bdd91417f789 None None] MFA Rules not processed for user `0e9a2114d29c4edeb20f394140d390bb`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:19.376109 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-de998f62-8d02-40c8-bf88-bdd91417f789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:19.384293 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 689/1377] 10.222.0.64 () {58 vars in 1015 bytes} [Thu Dec 16 14:33:19 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:33:19.398858 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb79d9d-5abc-479f-9c3c-5c04a9674e69 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:19.399153 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb79d9d-5abc-479f-9c3c-5c04a9674e69 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:19.399438 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb79d9d-5abc-479f-9c3c-5c04a9674e69 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:19.401134 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 689/1378] 10.222.0.64 () {54 vars in 918 bytes} [Thu Dec 16 14:33:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:33:19.405618 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f0a83-d80d-40da-b007-555ef4146e06 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:19.405913 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f0a83-d80d-40da-b007-555ef4146e06 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:19.406198 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f0a83-d80d-40da-b007-555ef4146e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:19.428331 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-8f2f0a83-d80d-40da-b007-555ef4146e06 None None] MFA Rules not processed for user `8e416527de444ef1b744da062ee1e7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:19.429540 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-8f2f0a83-d80d-40da-b007-555ef4146e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:19.437893 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 690/1379] 10.222.0.64 () {58 vars in 1015 bytes} [Thu Dec 16 14:33:19 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:33:21.883612 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe66d88-29b0-46ba-a655-91c0f593556b None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:21.884044 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe66d88-29b0-46ba-a655-91c0f593556b None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:21.884240 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe66d88-29b0-46ba-a655-91c0f593556b None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:21.885994 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 690/1380] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:33:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:33:21.891581 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ed382-41ff-4a56-a18b-4edd517bf390 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:21.891992 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ed382-41ff-4a56-a18b-4edd517bf390 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:21.892151 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ed382-41ff-4a56-a18b-4edd517bf390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:21.915385 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-031ed382-41ff-4a56-a18b-4edd517bf390 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:21.916538 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-031ed382-41ff-4a56-a18b-4edd517bf390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:21.925106 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 691/1381] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:33:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:33:21.966350 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe66d88-29b0-46ba-a655-91c0f593556b None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:21.980404 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe66d88-29b0-46ba-a655-91c0f593556b None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:21.985307 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf0e43-2942-4fc1-92d8-e118a5fbb7bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:21.985861 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf0e43-2942-4fc1-92d8-e118a5fbb7bb service nova] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:21.986177 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf0e43-2942-4fc1-92d8-e118a5fbb7bb service nova] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:21.986460 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf0e43-2942-4fc1-92d8-e118a5fbb7bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:21.994210 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf0e43-2942-4fc1-92d8-e118a5fbb7bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:21.995774 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf0e43-2942-4fc1-92d8-e118a5fbb7bb service nova] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:22.004498 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 691/1382] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:33:21 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:33:23.363035 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e72ba5-50a8-4e6e-b254-6c3e08c12e75 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:23.363632 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e72ba5-50a8-4e6e-b254-6c3e08c12e75 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:23.363632 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e72ba5-50a8-4e6e-b254-6c3e08c12e75 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:23.365290 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 692/1383] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 16 14:33:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:33:23.370237 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bd491-0539-48d4-b9a8-41e0cbbc596b None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:23.370689 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bd491-0539-48d4-b9a8-41e0cbbc596b None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:23.370786 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bd491-0539-48d4-b9a8-41e0cbbc596b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:23.393728 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-a80bd491-0539-48d4-b9a8-41e0cbbc596b None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:23.394947 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-a80bd491-0539-48d4-b9a8-41e0cbbc596b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:23.402177 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 692/1384] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 16 14:33:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:33:23.552721 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e72ba5-50a8-4e6e-b254-6c3e08c12e75 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:23.567597 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e72ba5-50a8-4e6e-b254-6c3e08c12e75 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:23.572617 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36489ebe-8e00-4cdc-b768-8a1b039a72de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:23.573221 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36489ebe-8e00-4cdc-b768-8a1b039a72de service nova] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:23.573518 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36489ebe-8e00-4cdc-b768-8a1b039a72de service nova] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:23.573806 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36489ebe-8e00-4cdc-b768-8a1b039a72de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:23.582395 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36489ebe-8e00-4cdc-b768-8a1b039a72de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:23.584011 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36489ebe-8e00-4cdc-b768-8a1b039a72de service nova] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:23.593084 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 693/1385] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:33:23 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:33:24.985049 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197a381-7b51-4ba9-907d-5e0957d053ab None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:24.985592 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197a381-7b51-4ba9-907d-5e0957d053ab None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:24.985685 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197a381-7b51-4ba9-907d-5e0957d053ab None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:24.987314 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 693/1386] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 16 14:33:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 16 14:33:24.992285 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c99c4-9f7a-486d-b668-aec78d1738ee None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:24.992731 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c99c4-9f7a-486d-b668-aec78d1738ee None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:24.992890 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c99c4-9f7a-486d-b668-aec78d1738ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:25.014668 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-ee6c99c4-9f7a-486d-b668-aec78d1738ee None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:25.015822 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-ee6c99c4-9f7a-486d-b668-aec78d1738ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:25.023536 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 694/1387] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 16 14:33:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:33:25.173270 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197a381-7b51-4ba9-907d-5e0957d053ab None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:25.187268 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197a381-7b51-4ba9-907d-5e0957d053ab None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:25.193012 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf86bd6-2d8f-4883-bd9a-b55317d9a33d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:25.193581 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf86bd6-2d8f-4883-bd9a-b55317d9a33d service nova] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:25.193871 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf86bd6-2d8f-4883-bd9a-b55317d9a33d service nova] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:25.194156 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf86bd6-2d8f-4883-bd9a-b55317d9a33d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:25.202481 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf86bd6-2d8f-4883-bd9a-b55317d9a33d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:25.204030 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf86bd6-2d8f-4883-bd9a-b55317d9a33d service nova] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:25.212938 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 694/1388] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:33:25 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:33:26.590393 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44785a-bed5-4952-ab80-e566809a4826 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:26.590963 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44785a-bed5-4952-ab80-e566809a4826 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:26.590963 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44785a-bed5-4952-ab80-e566809a4826 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:26.592696 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 695/1389] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 16 14:33:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:33:26.597844 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865116c4-4c27-4dbd-9f30-5f5edfef12ae None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:26.598275 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865116c4-4c27-4dbd-9f30-5f5edfef12ae None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:26.598408 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865116c4-4c27-4dbd-9f30-5f5edfef12ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:26.620853 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-865116c4-4c27-4dbd-9f30-5f5edfef12ae None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:26.621997 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-865116c4-4c27-4dbd-9f30-5f5edfef12ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:26.629825 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 695/1390] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 16 14:33:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:33:26.783359 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44785a-bed5-4952-ab80-e566809a4826 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:26.797002 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44785a-bed5-4952-ab80-e566809a4826 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:26.801968 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24476efa-109f-45e7-b190-302ffc64cc95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:26.802815 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24476efa-109f-45e7-b190-302ffc64cc95 service nova] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:26.803112 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24476efa-109f-45e7-b190-302ffc64cc95 service nova] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:26.803395 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24476efa-109f-45e7-b190-302ffc64cc95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:26.811971 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24476efa-109f-45e7-b190-302ffc64cc95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:26.813613 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24476efa-109f-45e7-b190-302ffc64cc95 service nova] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:26.822851 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 696/1391] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:33:26 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:33:28.195231 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c030b-4177-44c9-a3e2-836acaccd439 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:28.195792 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c030b-4177-44c9-a3e2-836acaccd439 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:28.195792 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c030b-4177-44c9-a3e2-836acaccd439 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:28.197547 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 696/1392] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 16 14:33:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:33:28.202692 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5b6f3-c9aa-420f-9753-2067d8354d3a None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:28.203139 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5b6f3-c9aa-420f-9753-2067d8354d3a None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:28.203283 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5b6f3-c9aa-420f-9753-2067d8354d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:28.224944 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-2bd5b6f3-c9aa-420f-9753-2067d8354d3a None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:28.226102 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-2bd5b6f3-c9aa-420f-9753-2067d8354d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:28.233363 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 697/1393] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 16 14:33:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:33:28.385909 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c030b-4177-44c9-a3e2-836acaccd439 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:28.399811 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c030b-4177-44c9-a3e2-836acaccd439 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:28.404884 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bffad6-e2f6-4c09-ac0d-5b4103fed0ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:28.405449 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bffad6-e2f6-4c09-ac0d-5b4103fed0ef service nova] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:28.405743 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bffad6-e2f6-4c09-ac0d-5b4103fed0ef service nova] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:28.406028 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bffad6-e2f6-4c09-ac0d-5b4103fed0ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:28.413910 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bffad6-e2f6-4c09-ac0d-5b4103fed0ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:28.415457 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bffad6-e2f6-4c09-ac0d-5b4103fed0ef service nova] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:28.424847 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 697/1394] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:33:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:33:29.737746 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41914d5e-241f-49da-bb3e-e271ac6c93d0 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:29.738318 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41914d5e-241f-49da-bb3e-e271ac6c93d0 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:29.738412 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41914d5e-241f-49da-bb3e-e271ac6c93d0 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:29.740049 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 698/1395] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 16 14:33:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:33:29.745168 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbf5b7-3464-4ea3-9615-c999f1a0155e None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:29.745583 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbf5b7-3464-4ea3-9615-c999f1a0155e None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:29.745771 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbf5b7-3464-4ea3-9615-c999f1a0155e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:29.768446 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-71fbf5b7-3464-4ea3-9615-c999f1a0155e None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:29.769626 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-71fbf5b7-3464-4ea3-9615-c999f1a0155e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:29.776831 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 698/1396] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 16 14:33:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:33:29.925667 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41914d5e-241f-49da-bb3e-e271ac6c93d0 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:29.939455 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41914d5e-241f-49da-bb3e-e271ac6c93d0 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:29.944536 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620a256-3e44-431d-a344-4a812df6c20e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:29.945241 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620a256-3e44-431d-a344-4a812df6c20e service nova] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:29.945524 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620a256-3e44-431d-a344-4a812df6c20e service nova] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:29.945868 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620a256-3e44-431d-a344-4a812df6c20e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:29.953991 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1620a256-3e44-431d-a344-4a812df6c20e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:29.955575 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1620a256-3e44-431d-a344-4a812df6c20e service nova] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:29.964654 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 699/1397] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:33:29 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:33:31.273240 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183be2f-36f5-473b-ad83-e96af8f9800b None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:31.273808 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183be2f-36f5-473b-ad83-e96af8f9800b None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:31.273808 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183be2f-36f5-473b-ad83-e96af8f9800b None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:31.275486 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 699/1398] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 16 14:33:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:33:31.280531 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c13b9-b0f5-42a6-9708-5ccb00077294 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:31.281005 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c13b9-b0f5-42a6-9708-5ccb00077294 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:31.281149 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c13b9-b0f5-42a6-9708-5ccb00077294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:31.303805 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-424c13b9-b0f5-42a6-9708-5ccb00077294 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:31.305003 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-424c13b9-b0f5-42a6-9708-5ccb00077294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:31.312252 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 700/1399] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 16 14:33:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:33:31.460912 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183be2f-36f5-473b-ad83-e96af8f9800b None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:31.474483 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183be2f-36f5-473b-ad83-e96af8f9800b None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:31.479584 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e959b-b885-484b-96a6-1537fad3c3ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:31.480151 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e959b-b885-484b-96a6-1537fad3c3ca service nova] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:31.480442 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e959b-b885-484b-96a6-1537fad3c3ca service nova] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:31.480728 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e959b-b885-484b-96a6-1537fad3c3ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:31.488939 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e959b-b885-484b-96a6-1537fad3c3ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:31.490495 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e959b-b885-484b-96a6-1537fad3c3ca service nova] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:31.499526 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 700/1400] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:33:31 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:33:32.787450 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5d30f-be0a-4b45-8512-0b0ba99d7100 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:32.788020 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5d30f-be0a-4b45-8512-0b0ba99d7100 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:32.788020 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5d30f-be0a-4b45-8512-0b0ba99d7100 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:32.789723 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 701/1401] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 16 14:33:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:33:32.794949 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce9062-785c-4188-9cb9-516db581cb44 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:32.795350 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce9062-785c-4188-9cb9-516db581cb44 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:32.795566 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce9062-785c-4188-9cb9-516db581cb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:32.817628 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-83ce9062-785c-4188-9cb9-516db581cb44 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:32.818766 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-83ce9062-785c-4188-9cb9-516db581cb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:32.826279 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 701/1402] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 16 14:33:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:33:32.976914 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5d30f-be0a-4b45-8512-0b0ba99d7100 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:32.991429 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5d30f-be0a-4b45-8512-0b0ba99d7100 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:32.996464 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eacb08-fa04-4f6f-8d8b-00d1d69f1e57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:32.997195 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eacb08-fa04-4f6f-8d8b-00d1d69f1e57 service nova] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:32.997488 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eacb08-fa04-4f6f-8d8b-00d1d69f1e57 service nova] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:32.997774 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eacb08-fa04-4f6f-8d8b-00d1d69f1e57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:33.006169 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eacb08-fa04-4f6f-8d8b-00d1d69f1e57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:33.007779 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eacb08-fa04-4f6f-8d8b-00d1d69f1e57 service nova] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:33.017376 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 702/1403] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:33:32 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:33:34.330849 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd5114-d8ec-4ed3-8651-1df0793c6eea None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:34.331446 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd5114-d8ec-4ed3-8651-1df0793c6eea None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:34.331446 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd5114-d8ec-4ed3-8651-1df0793c6eea None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:34.333121 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 702/1404] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 16 14:33:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:33:34.338164 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17a2c6-299b-4a19-8138-05d9af909b71 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:34.338574 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17a2c6-299b-4a19-8138-05d9af909b71 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:34.338745 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17a2c6-299b-4a19-8138-05d9af909b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:34.361453 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-ec17a2c6-299b-4a19-8138-05d9af909b71 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:34.362589 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-ec17a2c6-299b-4a19-8138-05d9af909b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:34.369734 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 703/1405] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 16 14:33:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:33:34.543831 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd5114-d8ec-4ed3-8651-1df0793c6eea None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:34.557638 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd5114-d8ec-4ed3-8651-1df0793c6eea None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:34.562981 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11204ee-aa5f-4616-983e-d52e4310a344 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:34.564182 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11204ee-aa5f-4616-983e-d52e4310a344 service nova] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:34.564403 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11204ee-aa5f-4616-983e-d52e4310a344 service nova] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:34.564680 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11204ee-aa5f-4616-983e-d52e4310a344 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:34.573087 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11204ee-aa5f-4616-983e-d52e4310a344 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:34.574645 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11204ee-aa5f-4616-983e-d52e4310a344 service nova] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:34.584429 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 703/1406] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:33:34 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:33:36.621005 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840f9ff-a1fa-4cec-bd8b-745b9d597dbb None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:36.621614 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840f9ff-a1fa-4cec-bd8b-745b9d597dbb None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:36.621751 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840f9ff-a1fa-4cec-bd8b-745b9d597dbb None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:36.624237 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 704/1407] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:33:36 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:33:36.631298 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cdbcd-ce70-4df7-9945-60c3fd86808f None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:36.631809 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cdbcd-ce70-4df7-9945-60c3fd86808f None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:36.631903 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cdbcd-ce70-4df7-9945-60c3fd86808f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:36.654561 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-818cdbcd-ce70-4df7-9945-60c3fd86808f None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:36.655705 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-818cdbcd-ce70-4df7-9945-60c3fd86808f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:36.663138 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 704/1408] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:33:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:33:36.701212 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840f9ff-a1fa-4cec-bd8b-745b9d597dbb None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:36.712488 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840f9ff-a1fa-4cec-bd8b-745b9d597dbb None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:36.716032 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caa9d6-7e22-4337-a492-36cc4e7a291a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:36.716606 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caa9d6-7e22-4337-a492-36cc4e7a291a service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:36.716935 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caa9d6-7e22-4337-a492-36cc4e7a291a service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:36.717225 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caa9d6-7e22-4337-a492-36cc4e7a291a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:36.726633 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85caa9d6-7e22-4337-a492-36cc4e7a291a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:36.728060 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85caa9d6-7e22-4337-a492-36cc4e7a291a service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:36.738022 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 705/1409] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:33:36 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:33:38.927637 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838a208-ad7f-4516-baf2-be7a6b00d44f None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:38.928192 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838a208-ad7f-4516-baf2-be7a6b00d44f None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:38.928192 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838a208-ad7f-4516-baf2-be7a6b00d44f None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:38.929942 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 705/1410] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:33:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:33:38.935317 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85feb7-1e1b-49d0-8da6-988b4dd50ac6 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:38.935726 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85feb7-1e1b-49d0-8da6-988b4dd50ac6 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:38.935899 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85feb7-1e1b-49d0-8da6-988b4dd50ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:38.957655 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-4e85feb7-1e1b-49d0-8da6-988b4dd50ac6 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:38.958811 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-4e85feb7-1e1b-49d0-8da6-988b4dd50ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:38.965942 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 706/1411] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:33:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:33:39.004810 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838a208-ad7f-4516-baf2-be7a6b00d44f None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:39.006753 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-d838a208-ad7f-4516-baf2-be7a6b00d44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:39.019914 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838a208-ad7f-4516-baf2-be7a6b00d44f None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:39.023588 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f25a49-578c-4aff-b26c-9feb098da735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:39.024155 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f25a49-578c-4aff-b26c-9feb098da735 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:39.024449 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f25a49-578c-4aff-b26c-9feb098da735 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:39.024734 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f25a49-578c-4aff-b26c-9feb098da735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:39.034012 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f25a49-578c-4aff-b26c-9feb098da735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:39.035424 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f25a49-578c-4aff-b26c-9feb098da735 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:39.044586 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 706/1412] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:33:39 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:33:41.592686 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d61cd0-247a-47df-8efb-335f73983e21 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:41.593239 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d61cd0-247a-47df-8efb-335f73983e21 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:41.593361 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d61cd0-247a-47df-8efb-335f73983e21 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:41.595017 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 707/1413] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:33:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:33:41.600290 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddf54d-5246-4b77-94c8-5770ddf1261c None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:41.600762 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddf54d-5246-4b77-94c8-5770ddf1261c None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:41.600889 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddf54d-5246-4b77-94c8-5770ddf1261c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:41.622922 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-c0ddf54d-5246-4b77-94c8-5770ddf1261c None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:41.624042 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-c0ddf54d-5246-4b77-94c8-5770ddf1261c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:41.631674 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 707/1414] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:33:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:33:41.670904 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d61cd0-247a-47df-8efb-335f73983e21 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:41.681924 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d61cd0-247a-47df-8efb-335f73983e21 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:41.685270 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61acdd-d0d7-49f3-a0ed-8c75aaf0cb86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:41.685847 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61acdd-d0d7-49f3-a0ed-8c75aaf0cb86 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:41.686134 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61acdd-d0d7-49f3-a0ed-8c75aaf0cb86 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:41.686413 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61acdd-d0d7-49f3-a0ed-8c75aaf0cb86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:41.695591 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61acdd-d0d7-49f3-a0ed-8c75aaf0cb86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:41.697052 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61acdd-d0d7-49f3-a0ed-8c75aaf0cb86 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:41.705804 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 708/1415] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:33:41 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:33:43.908157 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020571e5-d7d9-49b4-b619-aa71897bba7e None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:43.908712 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020571e5-d7d9-49b4-b619-aa71897bba7e None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:43.908712 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020571e5-d7d9-49b4-b619-aa71897bba7e None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:43.910518 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 708/1416] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:33:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:33:43.916464 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fddcd-361c-44a2-bb33-3e8d887c08eb None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:43.916873 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fddcd-361c-44a2-bb33-3e8d887c08eb None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:43.917060 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fddcd-361c-44a2-bb33-3e8d887c08eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:43.939957 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-eb5fddcd-361c-44a2-bb33-3e8d887c08eb None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:43.941127 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-eb5fddcd-361c-44a2-bb33-3e8d887c08eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:43.948139 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 709/1417] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:33:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:33:43.988326 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020571e5-d7d9-49b4-b619-aa71897bba7e None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:43.998859 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020571e5-d7d9-49b4-b619-aa71897bba7e None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:44.002901 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1ff7b-f21f-4f9b-976b-1573848f74a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:44.003463 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1ff7b-f21f-4f9b-976b-1573848f74a3 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:44.003753 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1ff7b-f21f-4f9b-976b-1573848f74a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:44.004034 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1ff7b-f21f-4f9b-976b-1573848f74a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:44.012559 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1ff7b-f21f-4f9b-976b-1573848f74a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:44.014007 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1ff7b-f21f-4f9b-976b-1573848f74a3 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:44.022791 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 709/1418] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:33:43 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:33:46.231548 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24568ba-dfc9-4a32-a38c-c5c2b160fe4b None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:46.232138 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24568ba-dfc9-4a32-a38c-c5c2b160fe4b None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:46.232138 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24568ba-dfc9-4a32-a38c-c5c2b160fe4b None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:46.233824 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 710/1419] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:33:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:33:46.239650 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38d7a0-f8a1-499b-8778-8408fd57422d None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:46.240108 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38d7a0-f8a1-499b-8778-8408fd57422d None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:46.240211 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38d7a0-f8a1-499b-8778-8408fd57422d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:46.262754 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-4f38d7a0-f8a1-499b-8778-8408fd57422d None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:46.263906 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-4f38d7a0-f8a1-499b-8778-8408fd57422d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:46.271049 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 710/1420] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:33:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:33:46.309760 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24568ba-dfc9-4a32-a38c-c5c2b160fe4b None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:46.320833 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24568ba-dfc9-4a32-a38c-c5c2b160fe4b None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:46.324177 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27925dc1-7116-4a4e-b9a1-4006f7e7bad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:46.324748 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27925dc1-7116-4a4e-b9a1-4006f7e7bad7 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:46.325067 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27925dc1-7116-4a4e-b9a1-4006f7e7bad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:46.325351 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27925dc1-7116-4a4e-b9a1-4006f7e7bad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:46.334563 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27925dc1-7116-4a4e-b9a1-4006f7e7bad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:46.335998 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27925dc1-7116-4a4e-b9a1-4006f7e7bad7 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:46.345659 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 711/1421] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:33:46 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:33:48.568956 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3633b3-7400-475f-b7da-b3aa70771b2e None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:48.569556 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3633b3-7400-475f-b7da-b3aa70771b2e None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:48.569556 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3633b3-7400-475f-b7da-b3aa70771b2e None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:48.571249 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 711/1422] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:33:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:33:48.576707 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877527db-a8bf-42ae-8483-d28979df5b82 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:48.577164 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877527db-a8bf-42ae-8483-d28979df5b82 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:48.577333 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877527db-a8bf-42ae-8483-d28979df5b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:48.600467 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-877527db-a8bf-42ae-8483-d28979df5b82 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:48.601640 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-877527db-a8bf-42ae-8483-d28979df5b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:48.608728 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 712/1423] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:33:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:33:48.648198 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3633b3-7400-475f-b7da-b3aa70771b2e None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:48.658857 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3633b3-7400-475f-b7da-b3aa70771b2e None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:48.662232 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a211ee-d1a6-48c7-b238-31f053637663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:48.662803 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a211ee-d1a6-48c7-b238-31f053637663 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:48.663088 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a211ee-d1a6-48c7-b238-31f053637663 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:48.663366 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a211ee-d1a6-48c7-b238-31f053637663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:48.673497 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a211ee-d1a6-48c7-b238-31f053637663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:48.674917 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a211ee-d1a6-48c7-b238-31f053637663 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:48.683987 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 712/1424] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:33:48 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:33:50.916110 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e1859-c70f-408a-9abf-e8e5562b9974 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:50.916645 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e1859-c70f-408a-9abf-e8e5562b9974 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:50.916810 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e1859-c70f-408a-9abf-e8e5562b9974 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:50.918382 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 713/1425] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:33:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:33:50.923784 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2940d9-5aba-44ef-a3ce-6a56f41b8ef1 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:50.924238 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2940d9-5aba-44ef-a3ce-6a56f41b8ef1 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:50.924352 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2940d9-5aba-44ef-a3ce-6a56f41b8ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:50.946655 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-3a2940d9-5aba-44ef-a3ce-6a56f41b8ef1 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:50.947803 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-3a2940d9-5aba-44ef-a3ce-6a56f41b8ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:50.955602 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 713/1426] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:33:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:33:50.992145 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e1859-c70f-408a-9abf-e8e5562b9974 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:51.003123 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e1859-c70f-408a-9abf-e8e5562b9974 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:51.006452 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c45b39-5539-449d-9760-13c6f9cb0d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:51.007024 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c45b39-5539-449d-9760-13c6f9cb0d1a service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:51.007315 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c45b39-5539-449d-9760-13c6f9cb0d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:51.007598 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c45b39-5539-449d-9760-13c6f9cb0d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:51.017151 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c45b39-5539-449d-9760-13c6f9cb0d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:51.018580 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c45b39-5539-449d-9760-13c6f9cb0d1a service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:51.027411 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 714/1427] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:33:50 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:33:53.169131 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263b3d1-3350-4bba-850a-7778cf0c3794 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:53.169660 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263b3d1-3350-4bba-850a-7778cf0c3794 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:53.169660 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263b3d1-3350-4bba-850a-7778cf0c3794 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:53.171286 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 714/1428] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:33:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:33:53.176582 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cb623-29c2-4115-b81b-4a06a49fb441 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:53.177120 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cb623-29c2-4115-b81b-4a06a49fb441 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:53.177237 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cb623-29c2-4115-b81b-4a06a49fb441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:53.199800 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-993cb623-29c2-4115-b81b-4a06a49fb441 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:53.200994 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-993cb623-29c2-4115-b81b-4a06a49fb441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:53.208754 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 715/1429] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:33:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:33:53.245436 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263b3d1-3350-4bba-850a-7778cf0c3794 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:53.256445 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263b3d1-3350-4bba-850a-7778cf0c3794 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:53.259810 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc98739-3eed-41db-92d5-c89fa2b84dd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:53.260381 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc98739-3eed-41db-92d5-c89fa2b84dd1 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:53.260679 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc98739-3eed-41db-92d5-c89fa2b84dd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:53.260998 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc98739-3eed-41db-92d5-c89fa2b84dd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:53.270415 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc98739-3eed-41db-92d5-c89fa2b84dd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:53.271832 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc98739-3eed-41db-92d5-c89fa2b84dd1 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:53.280623 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 715/1430] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:33:53 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:33:55.415158 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dcec3-e1ac-4d89-a22c-921ebf163730 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:55.416000 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dcec3-e1ac-4d89-a22c-921ebf163730 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:55.416000 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dcec3-e1ac-4d89-a22c-921ebf163730 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:55.417663 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 716/1431] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:33:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:33:55.422850 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566a273-5919-4258-b96b-1890b878964e None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:55.423297 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566a273-5919-4258-b96b-1890b878964e None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:55.423427 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566a273-5919-4258-b96b-1890b878964e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:55.448051 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-a566a273-5919-4258-b96b-1890b878964e None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:55.449246 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-a566a273-5919-4258-b96b-1890b878964e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:55.457578 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 716/1432] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:33:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:33:55.493623 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dcec3-e1ac-4d89-a22c-921ebf163730 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:55.504395 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dcec3-e1ac-4d89-a22c-921ebf163730 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:55.507679 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4721ac-8a9e-45c7-8408-0fc677e9a54f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:55.508245 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4721ac-8a9e-45c7-8408-0fc677e9a54f service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:55.508528 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4721ac-8a9e-45c7-8408-0fc677e9a54f service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:55.508915 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4721ac-8a9e-45c7-8408-0fc677e9a54f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:55.518015 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4721ac-8a9e-45c7-8408-0fc677e9a54f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:55.519433 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4721ac-8a9e-45c7-8408-0fc677e9a54f service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:55.528380 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 717/1433] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:33:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:33:57.680959 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43299b-0da1-4928-9ddb-51ad8373fba7 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:57.681593 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43299b-0da1-4928-9ddb-51ad8373fba7 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:57.681593 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43299b-0da1-4928-9ddb-51ad8373fba7 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:57.683285 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 717/1434] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:33:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:33:57.689289 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49506e-2707-4244-a9c9-929cbf6220b6 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:57.690135 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49506e-2707-4244-a9c9-929cbf6220b6 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:57.690135 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49506e-2707-4244-a9c9-929cbf6220b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:57.719310 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-ec49506e-2707-4244-a9c9-929cbf6220b6 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:33:57.720509 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-ec49506e-2707-4244-a9c9-929cbf6220b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:33:57.728420 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 718/1435] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:33:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:33:57.766199 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43299b-0da1-4928-9ddb-51ad8373fba7 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:33:57.777287 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43299b-0da1-4928-9ddb-51ad8373fba7 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:33:57.781667 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c033b3b-f844-4af8-8b7e-49922074bb0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:33:57.782244 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c033b3b-f844-4af8-8b7e-49922074bb0e service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:33:57.782533 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c033b3b-f844-4af8-8b7e-49922074bb0e service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:33:57.782814 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c033b3b-f844-4af8-8b7e-49922074bb0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:33:57.792847 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c033b3b-f844-4af8-8b7e-49922074bb0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:33:57.794292 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c033b3b-f844-4af8-8b7e-49922074bb0e service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:33:57.805394 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 718/1436] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:33:57 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:34:14.633019 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9c35a-ff9a-488d-b5a9-fba51ebbeb38 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:14.633588 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9c35a-ff9a-488d-b5a9-fba51ebbeb38 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:14.633588 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9c35a-ff9a-488d-b5a9-fba51ebbeb38 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:14.635282 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 719/1437] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:34:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:34:14.640719 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c48a7-c428-4c11-a6c2-13c8e363f235 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:14.641189 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c48a7-c428-4c11-a6c2-13c8e363f235 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:14.641633 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c48a7-c428-4c11-a6c2-13c8e363f235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:14.663044 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-a41c48a7-c428-4c11-a6c2-13c8e363f235 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:34:14.664817 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-a41c48a7-c428-4c11-a6c2-13c8e363f235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:34:14.672724 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 719/1438] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:34:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:34:14.718017 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cfdba-21f3-4b9e-9431-329a01685c5c None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:14.718314 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cfdba-21f3-4b9e-9431-329a01685c5c None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:14.718600 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cfdba-21f3-4b9e-9431-329a01685c5c None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:14.720254 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 720/1439] 10.222.0.64 () {54 vars in 956 bytes} [Thu Dec 16 14:34:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:34:14.724986 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de80d0c-ddcb-4996-9c99-85df92b9220a None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:14.725285 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de80d0c-ddcb-4996-9c99-85df92b9220a None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:14.725573 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de80d0c-ddcb-4996-9c99-85df92b9220a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:14.748000 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-9de80d0c-ddcb-4996-9c99-85df92b9220a None None] MFA Rules not processed for user `2ccebf28ac494f608c33437fc34139be`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:34:14.749773 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-9de80d0c-ddcb-4996-9c99-85df92b9220a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:34:14.755719 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 720/1440] 10.222.0.64 () {58 vars in 1053 bytes} [Thu Dec 16 14:34:14 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:34:14.762963 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cfdba-21f3-4b9e-9431-329a01685c5c None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:34:14.773935 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cfdba-21f3-4b9e-9431-329a01685c5c None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:34:14.777309 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cfa0e-81c3-4819-b582-0a0f7cafc03a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ccebf28ac494f608c33437fc34139be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:34:14.777872 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cfa0e-81c3-4819-b582-0a0f7cafc03a service glance] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:14.778160 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cfa0e-81c3-4819-b582-0a0f7cafc03a service glance] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:14.778443 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cfa0e-81c3-4819-b582-0a0f7cafc03a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:14.787679 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77cfa0e-81c3-4819-b582-0a0f7cafc03a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:34:14.789164 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77cfa0e-81c3-4819-b582-0a0f7cafc03a service glance] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:34:14.799123 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 721/1441] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:34:14 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:34:17.010967 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750d6b7-2af0-42ef-90f4-1ccac90c5190 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:17.011559 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750d6b7-2af0-42ef-90f4-1ccac90c5190 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:17.011559 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750d6b7-2af0-42ef-90f4-1ccac90c5190 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:17.013342 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 721/1442] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:34:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:34:17.019501 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83cf52-ccdc-41af-8823-98ec7f73f56d None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:17.019979 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83cf52-ccdc-41af-8823-98ec7f73f56d None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:17.020113 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83cf52-ccdc-41af-8823-98ec7f73f56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:17.043011 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-2c83cf52-ccdc-41af-8823-98ec7f73f56d None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:34:17.044224 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-2c83cf52-ccdc-41af-8823-98ec7f73f56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:34:17.052304 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 722/1443] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:34:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:34:17.075919 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750d6b7-2af0-42ef-90f4-1ccac90c5190 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:34:17.088516 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750d6b7-2af0-42ef-90f4-1ccac90c5190 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:34:17.093542 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b897b-c2c6-412d-bf93-8ed06c67dc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:34:17.094137 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b897b-c2c6-412d-bf93-8ed06c67dc06 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:17.094439 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b897b-c2c6-412d-bf93-8ed06c67dc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:17.094719 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b897b-c2c6-412d-bf93-8ed06c67dc06 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:17.095431 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b897b-c2c6-412d-bf93-8ed06c67dc06 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:34:17.097331 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b897b-c2c6-412d-bf93-8ed06c67dc06 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:34:17.113329 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 722/1444] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Dec 16 14:34:17 2021] GET /identity/v3/projects => generated 2553 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:34:18.658513 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2badb9e-1e94-410e-8b02-15b79583b89b None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:18.659065 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2badb9e-1e94-410e-8b02-15b79583b89b None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:18.659178 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2badb9e-1e94-410e-8b02-15b79583b89b None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:18.660834 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 723/1445] 10.222.0.64 () {54 vars in 911 bytes} [Thu Dec 16 14:34:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:34:18.666082 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a9c68-bf43-43ea-a3a0-ce7c075e5cfa None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:18.666500 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a9c68-bf43-43ea-a3a0-ce7c075e5cfa None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:18.666653 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a9c68-bf43-43ea-a3a0-ce7c075e5cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:18.689122 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-277a9c68-bf43-43ea-a3a0-ce7c075e5cfa None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:34:18.690205 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-277a9c68-bf43-43ea-a3a0-ce7c075e5cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:34:18.697425 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 723/1446] 10.222.0.64 () {58 vars in 1008 bytes} [Thu Dec 16 14:34:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:34:18.854197 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2badb9e-1e94-410e-8b02-15b79583b89b None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:34:18.868191 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2badb9e-1e94-410e-8b02-15b79583b89b None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:34:18.874121 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f697b4-d69e-45db-9d18-416ab765ed89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:34:18.874702 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f697b4-d69e-45db-9d18-416ab765ed89 service nova] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:18.874994 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f697b4-d69e-45db-9d18-416ab765ed89 service nova] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:18.875281 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f697b4-d69e-45db-9d18-416ab765ed89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:18.883663 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f697b4-d69e-45db-9d18-416ab765ed89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:34:18.885295 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f697b4-d69e-45db-9d18-416ab765ed89 service nova] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:34:18.894864 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 724/1447] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:34:18 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:34:21.026625 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7885d-3246-4cf8-95cc-96b31e56e7b2 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:21.027221 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7885d-3246-4cf8-95cc-96b31e56e7b2 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:21.027221 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7885d-3246-4cf8-95cc-96b31e56e7b2 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:21.028915 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 724/1448] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:34:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:34:21.034860 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9ad00-65af-4d8f-a86c-c75d9d827d84 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:21.035342 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9ad00-65af-4d8f-a86c-c75d9d827d84 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:21.035580 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9ad00-65af-4d8f-a86c-c75d9d827d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:21.058265 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-0ae9ad00-65af-4d8f-a86c-c75d9d827d84 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:34:21.059495 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-0ae9ad00-65af-4d8f-a86c-c75d9d827d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:34:21.066759 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 725/1449] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:34:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:34:21.102731 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7885d-3246-4cf8-95cc-96b31e56e7b2 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:34:21.114435 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7885d-3246-4cf8-95cc-96b31e56e7b2 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:34:21.117852 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea1822-1bd8-4938-9308-9b559ec7dfd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:34:21.118425 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea1822-1bd8-4938-9308-9b559ec7dfd2 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:21.118715 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea1822-1bd8-4938-9308-9b559ec7dfd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:21.119001 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea1822-1bd8-4938-9308-9b559ec7dfd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:21.127711 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea1822-1bd8-4938-9308-9b559ec7dfd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:34:21.129104 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea1822-1bd8-4938-9308-9b559ec7dfd2 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:34:21.137925 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 725/1450] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:34:21 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:34:23.276457 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675ca4b-9636-468e-b08c-a276a0929659 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:23.277026 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675ca4b-9636-468e-b08c-a276a0929659 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:23.277142 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675ca4b-9636-468e-b08c-a276a0929659 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:23.278754 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 726/1451] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:34:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:34:23.284176 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84667123-f494-4632-938b-072195ea87bc None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:23.284692 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84667123-f494-4632-938b-072195ea87bc None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:23.284876 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84667123-f494-4632-938b-072195ea87bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:23.307044 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-84667123-f494-4632-938b-072195ea87bc None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:34:23.308190 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-84667123-f494-4632-938b-072195ea87bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:34:23.316181 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 726/1452] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:34:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:34:23.354650 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675ca4b-9636-468e-b08c-a276a0929659 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:34:23.365823 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675ca4b-9636-468e-b08c-a276a0929659 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:34:23.369256 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856577f-965f-45ea-bbf5-39d5752ced40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:34:23.369826 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856577f-965f-45ea-bbf5-39d5752ced40 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:23.370119 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856577f-965f-45ea-bbf5-39d5752ced40 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:23.370418 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856577f-965f-45ea-bbf5-39d5752ced40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:23.379054 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856577f-965f-45ea-bbf5-39d5752ced40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:34:23.380482 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856577f-965f-45ea-bbf5-39d5752ced40 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:34:23.389571 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 727/1453] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:34:23 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:34:25.613489 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99739ba3-6834-4799-9eef-dd89e0475cb5 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:25.614029 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99739ba3-6834-4799-9eef-dd89e0475cb5 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:25.614139 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99739ba3-6834-4799-9eef-dd89e0475cb5 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:25.615814 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 727/1454] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:34:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:34:25.621121 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac98281-1cf7-4ed2-875a-15481edcfdd9 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:25.621562 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac98281-1cf7-4ed2-875a-15481edcfdd9 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:25.621724 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac98281-1cf7-4ed2-875a-15481edcfdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:25.645040 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-4ac98281-1cf7-4ed2-875a-15481edcfdd9 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:34:25.646215 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-4ac98281-1cf7-4ed2-875a-15481edcfdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:34:25.653326 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 728/1455] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:34:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:34:25.693774 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99739ba3-6834-4799-9eef-dd89e0475cb5 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:34:25.704888 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99739ba3-6834-4799-9eef-dd89e0475cb5 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:34:25.708213 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f6fdc-e607-47bf-ace8-87f5803dee34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:34:25.708799 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f6fdc-e607-47bf-ace8-87f5803dee34 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:25.709106 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f6fdc-e607-47bf-ace8-87f5803dee34 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:25.709391 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f6fdc-e607-47bf-ace8-87f5803dee34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:25.718153 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f6fdc-e607-47bf-ace8-87f5803dee34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:34:25.719598 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f6fdc-e607-47bf-ace8-87f5803dee34 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:34:25.728346 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 728/1456] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:34:25 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:34:28.128020 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e94a9-1105-40ce-8e80-b9670658d388 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:28.128551 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e94a9-1105-40ce-8e80-b9670658d388 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:28.128551 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e94a9-1105-40ce-8e80-b9670658d388 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:28.130256 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 729/1457] 10.222.0.64 () {54 vars in 926 bytes} [Thu Dec 16 14:34:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:34:28.135501 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663e701-adae-486f-a160-c8a0dbe1df5c None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:28.135932 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663e701-adae-486f-a160-c8a0dbe1df5c None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:28.136120 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663e701-adae-486f-a160-c8a0dbe1df5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:28.159305 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-8663e701-adae-486f-a160-c8a0dbe1df5c None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:34:28.160523 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-8663e701-adae-486f-a160-c8a0dbe1df5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:34:28.167946 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 729/1458] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Dec 16 14:34:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:34:28.207230 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e94a9-1105-40ce-8e80-b9670658d388 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:34:28.219413 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e94a9-1105-40ce-8e80-b9670658d388 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:34:28.222956 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2a024-5ee8-49cc-a5c3-3634448b1f3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:34:28.223540 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2a024-5ee8-49cc-a5c3-3634448b1f3d service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:28.223825 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2a024-5ee8-49cc-a5c3-3634448b1f3d service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:28.224116 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2a024-5ee8-49cc-a5c3-3634448b1f3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:28.233267 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2a024-5ee8-49cc-a5c3-3634448b1f3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:34:28.234729 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2a024-5ee8-49cc-a5c3-3634448b1f3d service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:34:28.243804 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 730/1459] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:34:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:35:38.134893 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da666e-ec3b-4937-952d-c75bc38bca0b None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:38.135459 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da666e-ec3b-4937-952d-c75bc38bca0b None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:38.135459 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da666e-ec3b-4937-952d-c75bc38bca0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:38.157563 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-44da666e-ec3b-4937-952d-c75bc38bca0b None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:35:38.158707 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-44da666e-ec3b-4937-952d-c75bc38bca0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:35:38.166433 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 730/1460] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:35:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:35:38.174361 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2939d-8fb9-4360-ac57-46daabf755fc None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:38.174858 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2939d-8fb9-4360-ac57-46daabf755fc None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:38.174963 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2939d-8fb9-4360-ac57-46daabf755fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:38.198540 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-48f2939d-8fb9-4360-ac57-46daabf755fc None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:35:38.199699 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-48f2939d-8fb9-4360-ac57-46daabf755fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:35:38.207060 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 731/1461] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:35:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:35:38.211879 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da666e-ec3b-4937-952d-c75bc38bca0b None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:35:38.221455 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da666e-ec3b-4937-952d-c75bc38bca0b None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:35:38.226520 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d03f8a-9f9a-4468-a9a0-200877113ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:35:38.227138 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d03f8a-9f9a-4468-a9a0-200877113ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:38.227429 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d03f8a-9f9a-4468-a9a0-200877113ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:38.227714 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d03f8a-9f9a-4468-a9a0-200877113ab0 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:38.228409 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d03f8a-9f9a-4468-a9a0-200877113ab0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:35:38.228719 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d03f8a-9f9a-4468-a9a0-200877113ab0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:35:38.230345 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d03f8a-9f9a-4468-a9a0-200877113ab0 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:35:38.244216 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 731/1462] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:35:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:35:38.253080 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2939d-8fb9-4360-ac57-46daabf755fc None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:35:38.262467 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2939d-8fb9-4360-ac57-46daabf755fc None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:35:38.266854 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cae0c-89f9-44d0-b4c3-6946f90d12ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:35:38.267447 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cae0c-89f9-44d0-b4c3-6946f90d12ae admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:38.267743 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cae0c-89f9-44d0-b4c3-6946f90d12ae admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:38.268026 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cae0c-89f9-44d0-b4c3-6946f90d12ae admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:38.268661 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cae0c-89f9-44d0-b4c3-6946f90d12ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:35:38.270601 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cae0c-89f9-44d0-b4c3-6946f90d12ae admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:35:38.308310 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 732/1463] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:35:38 2021] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:35:38.312504 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d03f8a-9f9a-4468-a9a0-200877113ab0 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:35:38.322633 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d03f8a-9f9a-4468-a9a0-200877113ab0 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:35:38.385500 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da26e6e-81a5-4a9a-98eb-efaa779211f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:35:38.386023 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da26e6e-81a5-4a9a-98eb-efaa779211f2 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:38.386309 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da26e6e-81a5-4a9a-98eb-efaa779211f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:38.386588 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da26e6e-81a5-4a9a-98eb-efaa779211f2 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:38.387230 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da26e6e-81a5-4a9a-98eb-efaa779211f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:35:38.389261 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da26e6e-81a5-4a9a-98eb-efaa779211f2 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:35:38.407805 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 732/1464] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:35:38 2021] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:35:38.412536 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cae0c-89f9-44d0-b4c3-6946f90d12ae admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:35:38.422585 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cae0c-89f9-44d0-b4c3-6946f90d12ae admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:35:38.427245 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e7c2e-476c-4aa6-8008-800d26be6afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:35:38.427866 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e7c2e-476c-4aa6-8008-800d26be6afd admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:38.428159 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e7c2e-476c-4aa6-8008-800d26be6afd admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:38.428446 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e7c2e-476c-4aa6-8008-800d26be6afd admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:38.429197 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e7c2e-476c-4aa6-8008-800d26be6afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:35:38.431326 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e7c2e-476c-4aa6-8008-800d26be6afd admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:35:38.442466 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 733/1465] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:35:38 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:35:38.447412 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da26e6e-81a5-4a9a-98eb-efaa779211f2 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:35:38.457245 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da26e6e-81a5-4a9a-98eb-efaa779211f2 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:35:38.461619 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602588b8-6fc0-4f5b-8a84-080458d8004c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:35:38.462234 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602588b8-6fc0-4f5b-8a84-080458d8004c admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:38.462525 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602588b8-6fc0-4f5b-8a84-080458d8004c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:38.462798 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602588b8-6fc0-4f5b-8a84-080458d8004c admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:38.463497 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602588b8-6fc0-4f5b-8a84-080458d8004c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:35:38.465138 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602588b8-6fc0-4f5b-8a84-080458d8004c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:35:38.479219 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 733/1466] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:35:38 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:35:38.483827 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e7c2e-476c-4aa6-8008-800d26be6afd admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:35:38.494489 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e7c2e-476c-4aa6-8008-800d26be6afd admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:35:38.499069 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b686493-314f-4659-8eaf-f2486a0927f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:35:38.499904 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b686493-314f-4659-8eaf-f2486a0927f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:38.500197 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b686493-314f-4659-8eaf-f2486a0927f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:38.500482 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b686493-314f-4659-8eaf-f2486a0927f9 admin admin] PATH_INFO: `/v3/projects/100e1d3642c44b59abcca6d0b8f99eb7/users/1986d81da9b3445396d04b7bb3a8e21e/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:38.520911 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b686493-314f-4659-8eaf-f2486a0927f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=100e1d3642c44b59abcca6d0b8f99eb7, user_id=1986d81da9b3445396d04b7bb3a8e21e, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:35:38.523872 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b686493-314f-4659-8eaf-f2486a0927f9 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:35:38.537050 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 734/1467] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:35:38 2021] PUT /identity/v3/projects/100e1d3642c44b59abcca6d0b8f99eb7/users/1986d81da9b3445396d04b7bb3a8e21e/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:35:38.548687 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afe4cd-db91-4619-b678-940fde065fdd None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:38.549099 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afe4cd-db91-4619-b678-940fde065fdd None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:38.549392 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afe4cd-db91-4619-b678-940fde065fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:38.588708 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-e0afe4cd-db91-4619-b678-940fde065fdd None None] MFA Rules not processed for user `1986d81da9b3445396d04b7bb3a8e21e`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:35:38.589910 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e0afe4cd-db91-4619-b678-940fde065fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:35:38.661464 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 734/1468] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:35:38 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:35:38.672319 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b686493-314f-4659-8eaf-f2486a0927f9 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:35:38.750552 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b686493-314f-4659-8eaf-f2486a0927f9 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:35:38.755622 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087f60c-39b5-4b1a-a005-54e529854909 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:35:38.756212 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087f60c-39b5-4b1a-a005-54e529854909 service nova] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:38.756500 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087f60c-39b5-4b1a-a005-54e529854909 service nova] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:38.756802 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087f60c-39b5-4b1a-a005-54e529854909 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:38.765852 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087f60c-39b5-4b1a-a005-54e529854909 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:35:38.767457 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087f60c-39b5-4b1a-a005-54e529854909 service nova] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:35:38.776448 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 735/1469] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:35:38 2021] GET /identity/v3/auth/tokens => generated 3686 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:35:38.847408 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff1389-a3e5-4257-b4fd-1e2fa60b8fa3 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:38.847713 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff1389-a3e5-4257-b4fd-1e2fa60b8fa3 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:38.847996 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff1389-a3e5-4257-b4fd-1e2fa60b8fa3 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:38.849642 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 735/1470] 10.222.0.64 () {52 vars in 829 bytes} [Thu Dec 16 14:35:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:35:38.853288 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087f60c-39b5-4b1a-a005-54e529854909 service nova] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:35:38.921806 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087f60c-39b5-4b1a-a005-54e529854909 service nova] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:35:38.926416 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a6d05-a038-435a-9818-341fb06706cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:35:38.927206 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a6d05-a038-435a-9818-341fb06706cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:38.927494 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a6d05-a038-435a-9818-341fb06706cb admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:38.927778 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a6d05-a038-435a-9818-341fb06706cb admin admin] PATH_INFO: `/v3/users/1986d81da9b3445396d04b7bb3a8e21e` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:38.928912 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a6d05-a038-435a-9818-341fb06706cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1986d81da9b3445396d04b7bb3a8e21e)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:35:38.929926 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING py.warnings [None req-946a6d05-a038-435a-9818-341fb06706cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:35:38.929926 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: warnings.warn(msg) Dec 16 14:35:38.929926 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: Dec 16 14:35:38.931658 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a6d05-a038-435a-9818-341fb06706cb admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:35:38.994717 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-946a6d05-a038-435a-9818-341fb06706cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1986d81da9b3445396d04b7bb3a8e21e'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:35:38.995474 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-946a6d05-a038-435a-9818-341fb06706cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1986d81da9b3445396d04b7bb3a8e21e'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:35:39.012123 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-946a6d05-a038-435a-9818-341fb06706cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1986d81da9b3445396d04b7bb3a8e21e'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:35:39.022358 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-946a6d05-a038-435a-9818-341fb06706cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1986d81da9b3445396d04b7bb3a8e21e'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:35:39.031247 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-946a6d05-a038-435a-9818-341fb06706cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1986d81da9b3445396d04b7bb3a8e21e'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:35:39.038203 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 736/1471] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:35:38 2021] DELETE /identity/v3/users/1986d81da9b3445396d04b7bb3a8e21e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:35:39.042662 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5a56a-7cf8-4dee-a2e6-c2e87bcf444f None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:39.042959 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5a56a-7cf8-4dee-a2e6-c2e87bcf444f None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:39.043250 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5a56a-7cf8-4dee-a2e6-c2e87bcf444f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:39.065206 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-a1a5a56a-7cf8-4dee-a2e6-c2e87bcf444f None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:35:39.066348 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-a1a5a56a-7cf8-4dee-a2e6-c2e87bcf444f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:35:39.131970 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 736/1472] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:35:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:35:39.143032 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a6d05-a038-435a-9818-341fb06706cb admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:35:39.144433 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-946a6d05-a038-435a-9818-341fb06706cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:35:39.210466 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a6d05-a038-435a-9818-341fb06706cb admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:35:39.214656 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f25d5e-790a-4ec9-bb2c-fafbfa141c53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:35:39.215268 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f25d5e-790a-4ec9-bb2c-fafbfa141c53 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:39.215568 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f25d5e-790a-4ec9-bb2c-fafbfa141c53 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:39.215857 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f25d5e-790a-4ec9-bb2c-fafbfa141c53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:39.234582 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f25d5e-790a-4ec9-bb2c-fafbfa141c53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:35:39.236054 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f25d5e-790a-4ec9-bb2c-fafbfa141c53 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:35:39.247123 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 737/1473] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:35:39 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:35:39.677540 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5a56a-7cf8-4dee-a2e6-c2e87bcf444f None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:35:39.678952 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-a1a5a56a-7cf8-4dee-a2e6-c2e87bcf444f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:35:39.690176 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5a56a-7cf8-4dee-a2e6-c2e87bcf444f None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:35:39.694579 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ea5dd-dd41-4b8b-815b-2ab57c7981b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:35:39.695528 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ea5dd-dd41-4b8b-815b-2ab57c7981b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:39.695628 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ea5dd-dd41-4b8b-815b-2ab57c7981b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:39.695958 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ea5dd-dd41-4b8b-815b-2ab57c7981b3 admin admin] PATH_INFO: `/v3/projects/100e1d3642c44b59abcca6d0b8f99eb7` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:39.697090 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ea5dd-dd41-4b8b-815b-2ab57c7981b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=100e1d3642c44b59abcca6d0b8f99eb7)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:35:39.698096 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING py.warnings [None req-432ea5dd-dd41-4b8b-815b-2ab57c7981b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:35:39.698096 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: warnings.warn(msg) Dec 16 14:35:39.698096 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: Dec 16 14:35:39.699323 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ea5dd-dd41-4b8b-815b-2ab57c7981b3 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:35:39.753261 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-432ea5dd-dd41-4b8b-815b-2ab57c7981b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '100e1d3642c44b59abcca6d0b8f99eb7', 'request_id': 'req-432ea5dd-dd41-4b8b-815b-2ab57c7981b3'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:35:39.764706 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-432ea5dd-dd41-4b8b-815b-2ab57c7981b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '100e1d3642c44b59abcca6d0b8f99eb7', 'request_id': 'req-432ea5dd-dd41-4b8b-815b-2ab57c7981b3'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:35:39.769745 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-432ea5dd-dd41-4b8b-815b-2ab57c7981b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '100e1d3642c44b59abcca6d0b8f99eb7', 'request_id': 'req-432ea5dd-dd41-4b8b-815b-2ab57c7981b3'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:35:39.782774 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-432ea5dd-dd41-4b8b-815b-2ab57c7981b3 admin admin] The token cache is being invalidate because project 100e1d3642c44b59abcca6d0b8f99eb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:35:39.783053 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-432ea5dd-dd41-4b8b-815b-2ab57c7981b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:35:39.783823 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-432ea5dd-dd41-4b8b-815b-2ab57c7981b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:35:39.785376 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 737/1474] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:35:39 2021] DELETE /identity/v3/projects/100e1d3642c44b59abcca6d0b8f99eb7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:37:10.916859 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ca613-f951-4d5c-9c1a-8875086e9c5f None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:10.917413 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ca613-f951-4d5c-9c1a-8875086e9c5f None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:10.917413 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ca613-f951-4d5c-9c1a-8875086e9c5f None None] PATH_INFO: `/v3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:10.918638 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 738/1475] 10.222.0.66 () {54 vars in 925 bytes} [Thu Dec 16 14:37:10 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:37:10.948408 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2047af-46a1-4208-902d-935a3872e0e2 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:10.948906 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2047af-46a1-4208-902d-935a3872e0e2 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:10.949024 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2047af-46a1-4208-902d-935a3872e0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:10.971950 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-5f2047af-46a1-4208-902d-935a3872e0e2 None None] MFA Rules not processed for user `0e9a2114d29c4edeb20f394140d390bb`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:10.973142 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-5f2047af-46a1-4208-902d-935a3872e0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:10.984326 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc378ef-fc3f-452a-aced-049d2d6a5fa5 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:10.984629 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc378ef-fc3f-452a-aced-049d2d6a5fa5 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:10.984971 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc378ef-fc3f-452a-aced-049d2d6a5fa5 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:10.986642 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 739/1476] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 16 14:37:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 16 14:37:10.991214 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997861a4-170e-4e7b-a642-1cce01184b49 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:10.991513 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997861a4-170e-4e7b-a642-1cce01184b49 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:10.991803 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997861a4-170e-4e7b-a642-1cce01184b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:11.013985 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-997861a4-170e-4e7b-a642-1cce01184b49 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:11.015198 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-997861a4-170e-4e7b-a642-1cce01184b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:11.042333 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 738/1477] 10.222.0.66 () {58 vars in 1015 bytes} [Thu Dec 16 14:37:10 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:11.079285 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 740/1478] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 16 14:37:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:37:11.232119 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2047af-46a1-4208-902d-935a3872e0e2 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:11.233518 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-5f2047af-46a1-4208-902d-935a3872e0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:11.314301 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2047af-46a1-4208-902d-935a3872e0e2 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:11.320467 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9275d-e1ed-4458-b1e4-ef1e8572b930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:11.321089 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9275d-e1ed-4458-b1e4-ef1e8572b930 service nova] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:11.321378 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9275d-e1ed-4458-b1e4-ef1e8572b930 service nova] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:11.321734 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9275d-e1ed-4458-b1e4-ef1e8572b930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:11.330711 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a9275d-e1ed-4458-b1e4-ef1e8572b930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:11.332182 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a9275d-e1ed-4458-b1e4-ef1e8572b930 service nova] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:37:11.341995 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 739/1479] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:37:12.674983 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a06a48-09e3-49ff-b45f-abec5843cf9e None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:12.675522 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a06a48-09e3-49ff-b45f-abec5843cf9e None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:12.675522 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a06a48-09e3-49ff-b45f-abec5843cf9e None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:12.677272 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 741/1480] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 16 14:37:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:37:12.682278 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cba0f-9336-415a-be20-2224f7a5a1e3 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:12.682716 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cba0f-9336-415a-be20-2224f7a5a1e3 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:12.682858 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cba0f-9336-415a-be20-2224f7a5a1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:12.705008 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-242cba0f-9336-415a-be20-2224f7a5a1e3 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:12.706207 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-242cba0f-9336-415a-be20-2224f7a5a1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:12.713828 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 740/1481] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 16 14:37:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:12.864389 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a06a48-09e3-49ff-b45f-abec5843cf9e None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:12.878580 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a06a48-09e3-49ff-b45f-abec5843cf9e None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:12.883906 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d0302-e4f9-4beb-bda3-5a3981229493 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:12.884493 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d0302-e4f9-4beb-bda3-5a3981229493 service nova] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:12.884801 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d0302-e4f9-4beb-bda3-5a3981229493 service nova] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:12.885098 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d0302-e4f9-4beb-bda3-5a3981229493 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:12.893553 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d0302-e4f9-4beb-bda3-5a3981229493 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:12.895993 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d0302-e4f9-4beb-bda3-5a3981229493 service nova] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:37:12.905466 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 742/1482] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:12 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:37:19.245658 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a62c8-033f-4044-bbde-4c17817acd22 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:19.246203 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a62c8-033f-4044-bbde-4c17817acd22 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:19.246203 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a62c8-033f-4044-bbde-4c17817acd22 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:19.247933 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 741/1483] 10.222.0.64 () {54 vars in 960 bytes} [Thu Dec 16 14:37:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:37:19.253318 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33d445-7714-45cf-8214-bb0b0b450547 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:19.254708 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33d445-7714-45cf-8214-bb0b0b450547 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:19.254708 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33d445-7714-45cf-8214-bb0b0b450547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:19.277715 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-fb33d445-7714-45cf-8214-bb0b0b450547 None None] MFA Rules not processed for user `0e9a2114d29c4edeb20f394140d390bb`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:19.278917 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-fb33d445-7714-45cf-8214-bb0b0b450547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:19.287381 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 743/1484] 10.222.0.64 () {58 vars in 1057 bytes} [Thu Dec 16 14:37:19 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:19.294907 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a62c8-033f-4044-bbde-4c17817acd22 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:19.307780 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a62c8-033f-4044-bbde-4c17817acd22 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:19.312499 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8e3fb-5578-4091-ae3f-45c5004485e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9a2114d29c4edeb20f394140d390bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:19.313105 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8e3fb-5578-4091-ae3f-45c5004485e2 service placement] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:19.313394 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8e3fb-5578-4091-ae3f-45c5004485e2 service placement] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:19.313705 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8e3fb-5578-4091-ae3f-45c5004485e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:19.322451 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8e3fb-5578-4091-ae3f-45c5004485e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:19.324244 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8e3fb-5578-4091-ae3f-45c5004485e2 service placement] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:37:19.333900 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 742/1485] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:19 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:37:24.679997 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e59413-4488-42f1-b7ad-ca6b5f245a09 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:24.680581 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e59413-4488-42f1-b7ad-ca6b5f245a09 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:24.680581 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e59413-4488-42f1-b7ad-ca6b5f245a09 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:24.682219 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 744/1486] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 16 14:37:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:37:24.687047 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9bb02-e9ab-493e-8e13-c7d3974be34d None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:24.687481 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9bb02-e9ab-493e-8e13-c7d3974be34d None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:24.687618 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9bb02-e9ab-493e-8e13-c7d3974be34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:24.710476 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-b4d9bb02-e9ab-493e-8e13-c7d3974be34d None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:24.711721 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-b4d9bb02-e9ab-493e-8e13-c7d3974be34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:24.718951 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 743/1487] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 16 14:37:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:24.872749 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e59413-4488-42f1-b7ad-ca6b5f245a09 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:24.887239 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e59413-4488-42f1-b7ad-ca6b5f245a09 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:24.892389 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd818b-f9c4-4ce2-9c56-960b238ae64b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:24.893006 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd818b-f9c4-4ce2-9c56-960b238ae64b service nova] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:24.893301 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd818b-f9c4-4ce2-9c56-960b238ae64b service nova] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:24.894100 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd818b-f9c4-4ce2-9c56-960b238ae64b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:24.902514 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd818b-f9c4-4ce2-9c56-960b238ae64b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:24.904117 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd818b-f9c4-4ce2-9c56-960b238ae64b service nova] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:37:24.914185 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 745/1488] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:24 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:37:26.245707 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee9355-0249-409d-83b5-5d4f1bad5948 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:26.246133 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee9355-0249-409d-83b5-5d4f1bad5948 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:26.246287 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee9355-0249-409d-83b5-5d4f1bad5948 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:26.248007 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 744/1489] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 16 14:37:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:37:26.253648 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97bf4a-b14f-459a-93e2-9f2e12558ed4 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:26.254075 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97bf4a-b14f-459a-93e2-9f2e12558ed4 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:26.254234 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97bf4a-b14f-459a-93e2-9f2e12558ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:26.276318 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-1a97bf4a-b14f-459a-93e2-9f2e12558ed4 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:26.277498 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-1a97bf4a-b14f-459a-93e2-9f2e12558ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:26.284982 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 746/1490] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 16 14:37:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:26.436593 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee9355-0249-409d-83b5-5d4f1bad5948 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:26.451565 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee9355-0249-409d-83b5-5d4f1bad5948 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:26.456891 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aea249-267b-409f-b2d0-c073ec187556 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:26.457472 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aea249-267b-409f-b2d0-c073ec187556 service nova] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:26.457772 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aea249-267b-409f-b2d0-c073ec187556 service nova] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:26.458061 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aea249-267b-409f-b2d0-c073ec187556 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:26.466557 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aea249-267b-409f-b2d0-c073ec187556 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:26.468158 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aea249-267b-409f-b2d0-c073ec187556 service nova] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:37:26.478160 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 745/1491] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:26 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:37:30.699312 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5845da0-326c-4db8-a1fa-a08396b4cd17 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:30.700167 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5845da0-326c-4db8-a1fa-a08396b4cd17 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:30.700167 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5845da0-326c-4db8-a1fa-a08396b4cd17 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:30.701624 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 747/1492] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:37:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:37:30.706852 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591dcee-8561-4b96-b7cb-286ec4ea0fe5 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:30.707340 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591dcee-8561-4b96-b7cb-286ec4ea0fe5 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:30.707448 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591dcee-8561-4b96-b7cb-286ec4ea0fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:30.730691 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-5591dcee-8561-4b96-b7cb-286ec4ea0fe5 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:30.731842 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-5591dcee-8561-4b96-b7cb-286ec4ea0fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:30.739488 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 746/1493] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:37:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:30.775584 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5845da0-326c-4db8-a1fa-a08396b4cd17 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:30.777230 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-b5845da0-326c-4db8-a1fa-a08396b4cd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:30.844664 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5845da0-326c-4db8-a1fa-a08396b4cd17 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:30.848799 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641ae76-6eb9-4150-8e0f-8e51a3ef80ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:30.849392 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641ae76-6eb9-4150-8e0f-8e51a3ef80ef service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:30.849685 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641ae76-6eb9-4150-8e0f-8e51a3ef80ef service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:30.849975 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641ae76-6eb9-4150-8e0f-8e51a3ef80ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:30.858900 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641ae76-6eb9-4150-8e0f-8e51a3ef80ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:30.860386 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641ae76-6eb9-4150-8e0f-8e51a3ef80ef service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:37:30.869419 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 748/1494] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:30 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:37:33.005978 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bde99b-2837-4a28-b946-c2f48179d15f None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:33.006535 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bde99b-2837-4a28-b946-c2f48179d15f None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:33.006535 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bde99b-2837-4a28-b946-c2f48179d15f None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:33.008325 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 747/1495] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:37:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:37:33.014370 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b38be-6a73-4cee-bf2a-8154633487df None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:33.014913 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b38be-6a73-4cee-bf2a-8154633487df None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:33.015007 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b38be-6a73-4cee-bf2a-8154633487df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:33.039481 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-b38b38be-6a73-4cee-bf2a-8154633487df None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:33.040718 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-b38b38be-6a73-4cee-bf2a-8154633487df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:33.048352 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 749/1496] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:37:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:33.084989 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bde99b-2837-4a28-b946-c2f48179d15f None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:33.095533 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bde99b-2837-4a28-b946-c2f48179d15f None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:33.098966 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c3b48-99e4-49cd-8262-1204de30c152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:33.099616 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c3b48-99e4-49cd-8262-1204de30c152 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:33.099904 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c3b48-99e4-49cd-8262-1204de30c152 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:33.100189 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c3b48-99e4-49cd-8262-1204de30c152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:33.109207 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c3b48-99e4-49cd-8262-1204de30c152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:33.110620 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c3b48-99e4-49cd-8262-1204de30c152 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:37:33.120171 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 748/1497] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:33 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:37:36.726438 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4524a-3d15-4a08-a275-cd79ba335ab9 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:36.727018 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4524a-3d15-4a08-a275-cd79ba335ab9 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:36.727018 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4524a-3d15-4a08-a275-cd79ba335ab9 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:36.728734 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 750/1498] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:37:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:37:36.735380 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b3e34-de62-42a7-a793-592b6fd2c57a None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:36.735892 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b3e34-de62-42a7-a793-592b6fd2c57a None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:36.736007 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b3e34-de62-42a7-a793-592b6fd2c57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:36.759712 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-cd4b3e34-de62-42a7-a793-592b6fd2c57a None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:36.760926 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-cd4b3e34-de62-42a7-a793-592b6fd2c57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:36.768713 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 749/1499] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:37:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:36.828364 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4524a-3d15-4a08-a275-cd79ba335ab9 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:36.830450 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-10f4524a-3d15-4a08-a275-cd79ba335ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:36.903759 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4524a-3d15-4a08-a275-cd79ba335ab9 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:36.907655 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bb45f-11d9-48b7-a193-ae6aef2a752a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:36.908245 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bb45f-11d9-48b7-a193-ae6aef2a752a service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:36.908603 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bb45f-11d9-48b7-a193-ae6aef2a752a service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:36.908903 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bb45f-11d9-48b7-a193-ae6aef2a752a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:36.918382 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bb45f-11d9-48b7-a193-ae6aef2a752a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:36.919833 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bb45f-11d9-48b7-a193-ae6aef2a752a service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:37:36.930127 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 751/1500] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:36 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:37:39.101782 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175e09d-6865-410b-9511-8bf1e8a6ffb1 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:39.102338 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175e09d-6865-410b-9511-8bf1e8a6ffb1 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:39.102461 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175e09d-6865-410b-9511-8bf1e8a6ffb1 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:39.104708 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 750/1501] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:37:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:37:39.113839 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf4567-81b7-4252-8556-7ebb3a7e80b6 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:39.114418 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf4567-81b7-4252-8556-7ebb3a7e80b6 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:39.114523 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf4567-81b7-4252-8556-7ebb3a7e80b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:39.139375 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-36cf4567-81b7-4252-8556-7ebb3a7e80b6 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:39.140468 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-36cf4567-81b7-4252-8556-7ebb3a7e80b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:39.148457 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 752/1502] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:37:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:39.207886 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e0852-9e06-4357-872b-97141fdc07c0 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:39.208178 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e0852-9e06-4357-872b-97141fdc07c0 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:39.208471 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e0852-9e06-4357-872b-97141fdc07c0 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:39.210241 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 751/1503] 10.222.0.64 () {54 vars in 962 bytes} [Thu Dec 16 14:37:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:37:39.215884 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da1353-49ad-44ce-9caa-3cb3da147d73 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:39.216181 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da1353-49ad-44ce-9caa-3cb3da147d73 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:39.216475 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da1353-49ad-44ce-9caa-3cb3da147d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:39.239592 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-52da1353-49ad-44ce-9caa-3cb3da147d73 None None] MFA Rules not processed for user `0050dc5fdd5641318319ff698112188c`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:39.240807 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-52da1353-49ad-44ce-9caa-3cb3da147d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:39.248591 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 753/1504] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Dec 16 14:37:39 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:37:39.257294 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e0852-9e06-4357-872b-97141fdc07c0 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:39.268705 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e0852-9e06-4357-872b-97141fdc07c0 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:39.272255 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27534c3-e06b-4545-ba19-459bb75d3806 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:39.272871 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27534c3-e06b-4545-ba19-459bb75d3806 service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:39.273165 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27534c3-e06b-4545-ba19-459bb75d3806 service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:39.273527 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27534c3-e06b-4545-ba19-459bb75d3806 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:39.283602 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27534c3-e06b-4545-ba19-459bb75d3806 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:39.285079 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27534c3-e06b-4545-ba19-459bb75d3806 service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:37:39.294917 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 752/1505] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:39 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:10.935112 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58f6bd-0a53-4f1d-8704-2344187bcf08 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:10.935729 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58f6bd-0a53-4f1d-8704-2344187bcf08 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:10.935729 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58f6bd-0a53-4f1d-8704-2344187bcf08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:10.936689 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87feb3-deca-4ff4-bc0b-148c60ca3e17 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:10.937142 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87feb3-deca-4ff4-bc0b-148c60ca3e17 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:10.937291 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87feb3-deca-4ff4-bc0b-148c60ca3e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:10.970858 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-ed58f6bd-0a53-4f1d-8704-2344187bcf08 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:10.972157 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-ed58f6bd-0a53-4f1d-8704-2344187bcf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:10.977879 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-4b87feb3-deca-4ff4-bc0b-148c60ca3e17 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:10.979212 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-4b87feb3-deca-4ff4-bc0b-148c60ca3e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:10.984604 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 754/1506] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:10.986236 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd7978-4093-4ba5-ade6-070e35120376 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:10.986541 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd7978-4093-4ba5-ade6-070e35120376 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:10.986833 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd7978-4093-4ba5-ade6-070e35120376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:10.995488 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 753/1507] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:11.000436 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41561b9-730d-440d-85aa-85c51cb4569c None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.000739 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41561b9-730d-440d-85aa-85c51cb4569c None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.001065 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41561b9-730d-440d-85aa-85c51cb4569c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.020986 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-02cd7978-4093-4ba5-ade6-070e35120376 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:11.022172 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-02cd7978-4093-4ba5-ade6-070e35120376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:11.045510 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-b41561b9-730d-440d-85aa-85c51cb4569c None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:11.046656 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-b41561b9-730d-440d-85aa-85c51cb4569c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:11.049515 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 755/1508] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:11.051002 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afb1e9-06e5-43e8-a455-da559fc60a08 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.051306 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afb1e9-06e5-43e8-a455-da559fc60a08 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.051666 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afb1e9-06e5-43e8-a455-da559fc60a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.058977 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 754/1509] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:11.060948 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1762a8-b69d-402b-bf98-3dca40222b82 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.061251 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1762a8-b69d-402b-bf98-3dca40222b82 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.061541 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1762a8-b69d-402b-bf98-3dca40222b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.089938 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-79afb1e9-06e5-43e8-a455-da559fc60a08 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:11.090174 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-9f1762a8-b69d-402b-bf98-3dca40222b82 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:11.091203 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-9f1762a8-b69d-402b-bf98-3dca40222b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:11.091333 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-79afb1e9-06e5-43e8-a455-da559fc60a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:11.102053 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 755/1510] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:11.104375 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 756/1511] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:11.105863 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d236a9-7133-42df-8f47-56e57ab7225e None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.106695 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d236a9-7133-42df-8f47-56e57ab7225e None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.106991 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d236a9-7133-42df-8f47-56e57ab7225e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.109089 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afb1e9-06e5-43e8-a455-da559fc60a08 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:11.128635 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afb1e9-06e5-43e8-a455-da559fc60a08 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:11.137686 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25646730-c4aa-46d8-9f20-44b72378efa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:11.138311 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25646730-c4aa-46d8-9f20-44b72378efa2 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.138764 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25646730-c4aa-46d8-9f20-44b72378efa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.139056 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25646730-c4aa-46d8-9f20-44b72378efa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.139761 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25646730-c4aa-46d8-9f20-44b72378efa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:39:11.140069 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25646730-c4aa-46d8-9f20-44b72378efa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:11.141725 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25646730-c4aa-46d8-9f20-44b72378efa2 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:11.162992 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 757/1512] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:39:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:39:11.163913 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d61ff-84f8-4d2a-8aea-10ba5e38fd1d None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.164205 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d61ff-84f8-4d2a-8aea-10ba5e38fd1d None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.164481 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-c4d236a9-7133-42df-8f47-56e57ab7225e None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:11.164673 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d61ff-84f8-4d2a-8aea-10ba5e38fd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.167844 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-c4d236a9-7133-42df-8f47-56e57ab7225e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:11.183631 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 756/1513] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:11.187350 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d236a9-7133-42df-8f47-56e57ab7225e None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:11.195012 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-0c3d61ff-84f8-4d2a-8aea-10ba5e38fd1d None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:11.196191 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-0c3d61ff-84f8-4d2a-8aea-10ba5e38fd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:11.208381 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d236a9-7133-42df-8f47-56e57ab7225e None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:11.216603 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 758/1514] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:11.217595 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d61ff-84f8-4d2a-8aea-10ba5e38fd1d None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:11.218517 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6e875-0c78-41f5-a08d-e6f1ddd01d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:11.219130 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6e875-0c78-41f5-a08d-e6f1ddd01d36 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.219412 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6e875-0c78-41f5-a08d-e6f1ddd01d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.219692 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6e875-0c78-41f5-a08d-e6f1ddd01d36 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.220647 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6e875-0c78-41f5-a08d-e6f1ddd01d36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:39:11.220647 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6e875-0c78-41f5-a08d-e6f1ddd01d36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:11.225180 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6e875-0c78-41f5-a08d-e6f1ddd01d36 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:11.230381 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d61ff-84f8-4d2a-8aea-10ba5e38fd1d None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:11.235738 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a784d-e3fe-45f1-b852-ff21db71b847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:11.236667 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a784d-e3fe-45f1-b852-ff21db71b847 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.236667 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a784d-e3fe-45f1-b852-ff21db71b847 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.237024 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a784d-e3fe-45f1-b852-ff21db71b847 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.237621 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a784d-e3fe-45f1-b852-ff21db71b847 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:39:11.237934 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a784d-e3fe-45f1-b852-ff21db71b847 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:11.239405 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 757/1515] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:39:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:39:11.239585 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a784d-e3fe-45f1-b852-ff21db71b847 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:11.240736 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5b98f-b1b8-4f19-b700-ba9f0012e607 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.241087 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5b98f-b1b8-4f19-b700-ba9f0012e607 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.241377 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5b98f-b1b8-4f19-b700-ba9f0012e607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.259260 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 759/1516] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:39:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:39:11.266672 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a784d-e3fe-45f1-b852-ff21db71b847 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:11.266808 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-4ac5b98f-b1b8-4f19-b700-ba9f0012e607 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:11.266808 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-4ac5b98f-b1b8-4f19-b700-ba9f0012e607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:11.272932 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 758/1517] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:11.275455 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77dee8-d228-4d83-b433-557cb0cefc34 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.275455 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77dee8-d228-4d83-b433-557cb0cefc34 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.275455 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77dee8-d228-4d83-b433-557cb0cefc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.276681 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a784d-e3fe-45f1-b852-ff21db71b847 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:11.281473 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50f16d-837a-4a77-87c4-2cdb7c609cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:11.282067 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50f16d-837a-4a77-87c4-2cdb7c609cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.282355 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50f16d-837a-4a77-87c4-2cdb7c609cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.282636 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50f16d-837a-4a77-87c4-2cdb7c609cc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.283269 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50f16d-837a-4a77-87c4-2cdb7c609cc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:11.285220 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50f16d-837a-4a77-87c4-2cdb7c609cc9 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:11.299782 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-9c77dee8-d228-4d83-b433-557cb0cefc34 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:11.301246 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-9c77dee8-d228-4d83-b433-557cb0cefc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:11.309110 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 759/1518] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:11.311130 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86302fd-fbb7-4d0f-9410-567ef2e93423 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.311436 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86302fd-fbb7-4d0f-9410-567ef2e93423 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.311694 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86302fd-fbb7-4d0f-9410-567ef2e93423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.321603 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 760/1519] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:11 2021] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:11.321603 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117757b-0c72-485d-a88d-834afc2852f4 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.321603 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117757b-0c72-485d-a88d-834afc2852f4 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.321603 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117757b-0c72-485d-a88d-834afc2852f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.336075 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-b86302fd-fbb7-4d0f-9410-567ef2e93423 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:11.337274 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-b86302fd-fbb7-4d0f-9410-567ef2e93423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:11.342210 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-f117757b-0c72-485d-a88d-834afc2852f4 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:11.343362 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-f117757b-0c72-485d-a88d-834afc2852f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:11.404589 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 760/1520] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:11.405710 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143193cb-5f73-4358-b4c1-3bebc732bb0d None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.405982 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143193cb-5f73-4358-b4c1-3bebc732bb0d None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.406268 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143193cb-5f73-4358-b4c1-3bebc732bb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.414722 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 761/1521] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:11.415554 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117757b-0c72-485d-a88d-834afc2852f4 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:11.425670 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117757b-0c72-485d-a88d-834afc2852f4 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:11.429983 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe326937-7356-47c0-bddd-6aa4eede8853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:11.430602 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe326937-7356-47c0-bddd-6aa4eede8853 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.430889 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe326937-7356-47c0-bddd-6aa4eede8853 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.431174 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe326937-7356-47c0-bddd-6aa4eede8853 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.431808 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe326937-7356-47c0-bddd-6aa4eede8853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:11.433767 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe326937-7356-47c0-bddd-6aa4eede8853 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:11.436358 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-143193cb-5f73-4358-b4c1-3bebc732bb0d None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:11.437662 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-143193cb-5f73-4358-b4c1-3bebc732bb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:11.445165 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 761/1522] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:11.448869 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143193cb-5f73-4358-b4c1-3bebc732bb0d None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:11.458867 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143193cb-5f73-4358-b4c1-3bebc732bb0d None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:11.461624 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 762/1523] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:11 2021] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:11.462875 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff42e4-766e-48ff-9e83-c0dea33e6dba None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.463173 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff42e4-766e-48ff-9e83-c0dea33e6dba None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.463632 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff42e4-766e-48ff-9e83-c0dea33e6dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.467068 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d62357-89f4-4ec8-8aff-b10bb4eb98f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:11.467669 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d62357-89f4-4ec8-8aff-b10bb4eb98f0 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.467964 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d62357-89f4-4ec8-8aff-b10bb4eb98f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.468247 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d62357-89f4-4ec8-8aff-b10bb4eb98f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.468925 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d62357-89f4-4ec8-8aff-b10bb4eb98f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:11.470836 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d62357-89f4-4ec8-8aff-b10bb4eb98f0 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:11.487175 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-d9ff42e4-766e-48ff-9e83-c0dea33e6dba None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:11.488660 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-d9ff42e4-766e-48ff-9e83-c0dea33e6dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:11.498640 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 762/1524] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:11 2021] POST /identity/v3/projects => generated 403 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:11.499636 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d62357-89f4-4ec8-8aff-b10bb4eb98f0 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:11.559160 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 763/1525] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:11.559972 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff42e4-766e-48ff-9e83-c0dea33e6dba None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:11.568899 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff42e4-766e-48ff-9e83-c0dea33e6dba None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:11.570237 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d62357-89f4-4ec8-8aff-b10bb4eb98f0 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:11.573171 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1a540-a630-4d7f-9002-244ea478f755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:11.573770 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1a540-a630-4d7f-9002-244ea478f755 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.574052 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1a540-a630-4d7f-9002-244ea478f755 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.574331 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1a540-a630-4d7f-9002-244ea478f755 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.574586 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e973d41-4a6f-4ad8-958a-3c42a777c07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:11.574999 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1a540-a630-4d7f-9002-244ea478f755 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:11.575184 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e973d41-4a6f-4ad8-958a-3c42a777c07c admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.575477 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e973d41-4a6f-4ad8-958a-3c42a777c07c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.575768 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e973d41-4a6f-4ad8-958a-3c42a777c07c admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.576464 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e973d41-4a6f-4ad8-958a-3c42a777c07c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:39:11.576767 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e973d41-4a6f-4ad8-958a-3c42a777c07c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:11.576934 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1a540-a630-4d7f-9002-244ea478f755 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:11.578371 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e973d41-4a6f-4ad8-958a-3c42a777c07c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:11.592524 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 763/1526] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:39:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:39:11.593881 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5216a19-9577-4aaf-a0b5-9bf5bfc9578a None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.594183 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5216a19-9577-4aaf-a0b5-9bf5bfc9578a None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.594513 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5216a19-9577-4aaf-a0b5-9bf5bfc9578a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.609949 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 764/1527] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:11 2021] POST /identity/v3/users => generated 288 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:11.609949 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1a540-a630-4d7f-9002-244ea478f755 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:11.619826 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1a540-a630-4d7f-9002-244ea478f755 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:11.624801 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c848b-d4ee-4b0c-9545-c957ca987bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:11.625424 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c848b-d4ee-4b0c-9545-c957ca987bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.625719 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c848b-d4ee-4b0c-9545-c957ca987bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.626038 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c848b-d4ee-4b0c-9545-c957ca987bf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.626751 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c848b-d4ee-4b0c-9545-c957ca987bf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:39:11.626884 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-e5216a19-9577-4aaf-a0b5-9bf5bfc9578a None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:11.627059 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c848b-d4ee-4b0c-9545-c957ca987bf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:11.627977 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e5216a19-9577-4aaf-a0b5-9bf5bfc9578a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:11.628687 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c848b-d4ee-4b0c-9545-c957ca987bf8 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:11.635868 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 764/1528] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:11.637411 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd22582-0a21-481d-b963-b99aafe06b4b None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.637716 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd22582-0a21-481d-b963-b99aafe06b4b None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.638060 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd22582-0a21-481d-b963-b99aafe06b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.645670 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 765/1529] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:39:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:39:11.647349 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c848b-d4ee-4b0c-9545-c957ca987bf8 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:11.663509 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c848b-d4ee-4b0c-9545-c957ca987bf8 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:11.670673 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307540d1-3c4f-41f1-b4b2-949c9c48a10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:11.671491 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307540d1-3c4f-41f1-b4b2-949c9c48a10a admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.671952 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307540d1-3c4f-41f1-b4b2-949c9c48a10a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.672356 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307540d1-3c4f-41f1-b4b2-949c9c48a10a admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.673305 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307540d1-3c4f-41f1-b4b2-949c9c48a10a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:11.675639 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-ebd22582-0a21-481d-b963-b99aafe06b4b None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:11.676619 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307540d1-3c4f-41f1-b4b2-949c9c48a10a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:11.677466 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-ebd22582-0a21-481d-b963-b99aafe06b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:11.688404 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 765/1530] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:11.689716 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd22582-0a21-481d-b963-b99aafe06b4b None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:11.702638 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd22582-0a21-481d-b963-b99aafe06b4b None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:11.706279 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 766/1531] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:11 2021] POST /identity/v3/users => generated 297 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:11.707294 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb44c33-64c2-496a-875a-921f9b9523ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:11.707902 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb44c33-64c2-496a-875a-921f9b9523ba admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.708199 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb44c33-64c2-496a-875a-921f9b9523ba admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.708482 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb44c33-64c2-496a-875a-921f9b9523ba admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.709185 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb44c33-64c2-496a-875a-921f9b9523ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:11.709902 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307540d1-3c4f-41f1-b4b2-949c9c48a10a admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:11.711068 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb44c33-64c2-496a-875a-921f9b9523ba admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:11.720183 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307540d1-3c4f-41f1-b4b2-949c9c48a10a admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:11.726105 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed6876-78b5-4bbd-93da-af7bb21abdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:11.726710 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed6876-78b5-4bbd-93da-af7bb21abdb3 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.727005 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed6876-78b5-4bbd-93da-af7bb21abdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.727292 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed6876-78b5-4bbd-93da-af7bb21abdb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.727992 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed6876-78b5-4bbd-93da-af7bb21abdb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:39:11.728300 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed6876-78b5-4bbd-93da-af7bb21abdb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:11.729939 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed6876-78b5-4bbd-93da-af7bb21abdb3 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:11.732521 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 766/1532] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:11 2021] POST /identity/v3/users => generated 302 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:11.736875 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb44c33-64c2-496a-875a-921f9b9523ba admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:11.745591 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb44c33-64c2-496a-875a-921f9b9523ba admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:11.749930 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4dbcf7-0a93-4f99-a578-2388e1e10b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:11.750513 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dbcf7-0a93-4f99-a578-2388e1e10b61 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.750628 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 767/1533] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:39:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:39:11.750802 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dbcf7-0a93-4f99-a578-2388e1e10b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.751082 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dbcf7-0a93-4f99-a578-2388e1e10b61 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.751549 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed6876-78b5-4bbd-93da-af7bb21abdb3 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:11.751788 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4dbcf7-0a93-4f99-a578-2388e1e10b61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:11.753702 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4dbcf7-0a93-4f99-a578-2388e1e10b61 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:11.761481 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed6876-78b5-4bbd-93da-af7bb21abdb3 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:11.765782 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458ea2d-1041-4d18-937c-4b900dfbd8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:11.766376 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458ea2d-1041-4d18-937c-4b900dfbd8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.766670 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458ea2d-1041-4d18-937c-4b900dfbd8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.766955 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458ea2d-1041-4d18-937c-4b900dfbd8f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.767646 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458ea2d-1041-4d18-937c-4b900dfbd8f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:11.769462 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458ea2d-1041-4d18-937c-4b900dfbd8f2 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:11.781635 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 768/1534] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:11 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:11.782569 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458ea2d-1041-4d18-937c-4b900dfbd8f2 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:11.786831 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 767/1535] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:11 2021] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:11.787728 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4dbcf7-0a93-4f99-a578-2388e1e10b61 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:11.801016 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458ea2d-1041-4d18-937c-4b900dfbd8f2 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:11.878838 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4dbcf7-0a93-4f99-a578-2388e1e10b61 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:11.883126 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f72f4-c051-4142-841a-1a7edd3388fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:11.883510 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bd7ab-ff93-4a83-9e15-7a6f0e3cd8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:11.883730 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f72f4-c051-4142-841a-1a7edd3388fa admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.884018 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f72f4-c051-4142-841a-1a7edd3388fa admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.884296 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f72f4-c051-4142-841a-1a7edd3388fa admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.884410 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bd7ab-ff93-4a83-9e15-7a6f0e3cd8eb admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.884651 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bd7ab-ff93-4a83-9e15-7a6f0e3cd8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.885038 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bd7ab-ff93-4a83-9e15-7a6f0e3cd8eb admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.885143 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f72f4-c051-4142-841a-1a7edd3388fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:39:11.885335 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f72f4-c051-4142-841a-1a7edd3388fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:11.885823 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765bd7ab-ff93-4a83-9e15-7a6f0e3cd8eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:11.886949 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f72f4-c051-4142-841a-1a7edd3388fa admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:11.888633 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765bd7ab-ff93-4a83-9e15-7a6f0e3cd8eb admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:11.900276 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 769/1536] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:39:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:39:11.904637 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f72f4-c051-4142-841a-1a7edd3388fa admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:11.915225 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f72f4-c051-4142-841a-1a7edd3388fa admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:11.919545 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 768/1537] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:11 2021] POST /identity/v3/projects => generated 387 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:11.920387 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bd7ab-ff93-4a83-9e15-7a6f0e3cd8eb admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:11.923133 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e5c14-c7d6-49f9-b866-6e9b3c748ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:11.923694 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e5c14-c7d6-49f9-b866-6e9b3c748ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.923989 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e5c14-c7d6-49f9-b866-6e9b3c748ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.924275 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e5c14-c7d6-49f9-b866-6e9b3c748ad7 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.925015 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e5c14-c7d6-49f9-b866-6e9b3c748ad7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:39:11.925318 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e5c14-c7d6-49f9-b866-6e9b3c748ad7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:11.927156 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e5c14-c7d6-49f9-b866-6e9b3c748ad7 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:11.940544 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 770/1538] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:39:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:39:11.941352 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e5c14-c7d6-49f9-b866-6e9b3c748ad7 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:11.951408 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e5c14-c7d6-49f9-b866-6e9b3c748ad7 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:11.991134 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bd7ab-ff93-4a83-9e15-7a6f0e3cd8eb admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:11.995675 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5530f6e-2f4e-44c5-a8f3-515633b8b27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:11.996271 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5530f6e-2f4e-44c5-a8f3-515633b8b27a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.996558 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5530f6e-2f4e-44c5-a8f3-515633b8b27a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.996875 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5530f6e-2f4e-44c5-a8f3-515633b8b27a admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.997577 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5530f6e-2f4e-44c5-a8f3-515633b8b27a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:11.999162 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5530f6e-2f4e-44c5-a8f3-515633b8b27a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:12.016145 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 769/1539] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:11 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:12.016145 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5530f6e-2f4e-44c5-a8f3-515633b8b27a admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:12.021504 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6df4b-4c1b-4fc1-82f9-bb999aac7e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.022289 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6df4b-4c1b-4fc1-82f9-bb999aac7e87 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.022580 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6df4b-4c1b-4fc1-82f9-bb999aac7e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.022869 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6df4b-4c1b-4fc1-82f9-bb999aac7e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.023597 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6df4b-4c1b-4fc1-82f9-bb999aac7e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.025432 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5530f6e-2f4e-44c5-a8f3-515633b8b27a admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:12.025909 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6df4b-4c1b-4fc1-82f9-bb999aac7e87 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:12.030948 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce98b2-39e3-4407-9fd6-68e1ec683587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.031550 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce98b2-39e3-4407-9fd6-68e1ec683587 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.031834 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce98b2-39e3-4407-9fd6-68e1ec683587 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.032116 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce98b2-39e3-4407-9fd6-68e1ec683587 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.032759 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce98b2-39e3-4407-9fd6-68e1ec683587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.034738 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce98b2-39e3-4407-9fd6-68e1ec683587 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:12.040002 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 771/1540] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:11 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:12.040672 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6df4b-4c1b-4fc1-82f9-bb999aac7e87 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:12.051754 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6df4b-4c1b-4fc1-82f9-bb999aac7e87 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:12.057249 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e9ae7-7566-4b28-a53b-58536a5e4979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.058474 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e9ae7-7566-4b28-a53b-58536a5e4979 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.058940 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e9ae7-7566-4b28-a53b-58536a5e4979 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.059514 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e9ae7-7566-4b28-a53b-58536a5e4979 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.060516 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e9ae7-7566-4b28-a53b-58536a5e4979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.063429 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e9ae7-7566-4b28-a53b-58536a5e4979 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:12.075556 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 770/1541] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:12 2021] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:12.075556 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce98b2-39e3-4407-9fd6-68e1ec683587 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:12.087446 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 772/1542] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:12 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:12.087446 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e9ae7-7566-4b28-a53b-58536a5e4979 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:12.100895 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e9ae7-7566-4b28-a53b-58536a5e4979 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:12.159025 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce98b2-39e3-4407-9fd6-68e1ec683587 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:12.163913 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0151409-d388-43f6-b04a-de4ec6c890d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.164534 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0151409-d388-43f6-b04a-de4ec6c890d5 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.164855 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0151409-d388-43f6-b04a-de4ec6c890d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.165144 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0151409-d388-43f6-b04a-de4ec6c890d5 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.165825 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0151409-d388-43f6-b04a-de4ec6c890d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.167771 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0151409-d388-43f6-b04a-de4ec6c890d5 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:12.185461 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce98ac1-3907-4680-ae12-d2cdf85afe1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.186131 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce98ac1-3907-4680-ae12-d2cdf85afe1e admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.186430 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce98ac1-3907-4680-ae12-d2cdf85afe1e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.186725 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce98ac1-3907-4680-ae12-d2cdf85afe1e admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.187622 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce98ac1-3907-4680-ae12-d2cdf85afe1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.189813 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce98ac1-3907-4680-ae12-d2cdf85afe1e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:12.194723 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 771/1543] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:12 2021] POST /identity/v3/users => generated 283 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:12.194723 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0151409-d388-43f6-b04a-de4ec6c890d5 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:12.214256 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0151409-d388-43f6-b04a-de4ec6c890d5 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:12.219968 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894b793-a38a-4dd9-9eab-ba2749b43d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.220722 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894b793-a38a-4dd9-9eab-ba2749b43d4b admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.221202 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894b793-a38a-4dd9-9eab-ba2749b43d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.221490 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894b793-a38a-4dd9-9eab-ba2749b43d4b admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.222153 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894b793-a38a-4dd9-9eab-ba2749b43d4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.224412 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894b793-a38a-4dd9-9eab-ba2749b43d4b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:12.228289 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 773/1544] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:12 2021] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:12.229376 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce98ac1-3907-4680-ae12-d2cdf85afe1e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:12.252602 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 772/1545] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:12 2021] POST /identity/v3/users => generated 294 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:12.252602 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894b793-a38a-4dd9-9eab-ba2749b43d4b admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:12.263023 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894b793-a38a-4dd9-9eab-ba2749b43d4b admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:12.322509 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce98ac1-3907-4680-ae12-d2cdf85afe1e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:12.329291 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3a3e5-4fee-40af-acc3-9a4cc88278c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.329902 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3a3e5-4fee-40af-acc3-9a4cc88278c4 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.330240 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3a3e5-4fee-40af-acc3-9a4cc88278c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.330500 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3a3e5-4fee-40af-acc3-9a4cc88278c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.331147 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee3a3e5-4fee-40af-acc3-9a4cc88278c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.333181 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee3a3e5-4fee-40af-acc3-9a4cc88278c4 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:12.333548 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e914755-eb9c-4b99-9ab1-e22e9bc4a7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.334217 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e914755-eb9c-4b99-9ab1-e22e9bc4a7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.334509 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e914755-eb9c-4b99-9ab1-e22e9bc4a7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.334786 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e914755-eb9c-4b99-9ab1-e22e9bc4a7f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.335490 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e914755-eb9c-4b99-9ab1-e22e9bc4a7f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.337094 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e914755-eb9c-4b99-9ab1-e22e9bc4a7f5 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:12.352898 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 773/1546] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:12 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:12.352898 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e914755-eb9c-4b99-9ab1-e22e9bc4a7f5 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:12.363502 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e914755-eb9c-4b99-9ab1-e22e9bc4a7f5 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:12.367812 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 774/1547] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:12 2021] POST /identity/v3/projects => generated 367 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:12.368028 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb71d50-b1e2-4de2-ac74-47aee68b70a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.368586 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb71d50-b1e2-4de2-ac74-47aee68b70a2 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.368909 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb71d50-b1e2-4de2-ac74-47aee68b70a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.369194 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb71d50-b1e2-4de2-ac74-47aee68b70a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.369319 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3a3e5-4fee-40af-acc3-9a4cc88278c4 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:12.369927 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb71d50-b1e2-4de2-ac74-47aee68b70a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.371582 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb71d50-b1e2-4de2-ac74-47aee68b70a2 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:12.382801 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 774/1548] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:12 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:12.387210 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb71d50-b1e2-4de2-ac74-47aee68b70a2 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:12.397413 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb71d50-b1e2-4de2-ac74-47aee68b70a2 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:12.445280 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3a3e5-4fee-40af-acc3-9a4cc88278c4 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:12.450500 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ff103-b0af-4d57-8b07-fe3fa58038ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.451130 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ff103-b0af-4d57-8b07-fe3fa58038ee admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.451415 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ff103-b0af-4d57-8b07-fe3fa58038ee admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.451696 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ff103-b0af-4d57-8b07-fe3fa58038ee admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.452334 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ff103-b0af-4d57-8b07-fe3fa58038ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.454304 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ff103-b0af-4d57-8b07-fe3fa58038ee admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:12.466509 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2943ca-741e-43aa-ae1e-c75bf43439a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.467306 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2943ca-741e-43aa-ae1e-c75bf43439a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.467693 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2943ca-741e-43aa-ae1e-c75bf43439a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.468146 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2943ca-741e-43aa-ae1e-c75bf43439a2 admin admin] PATH_INFO: `/v3/projects/240e1d9727694fafaabfa278fbe4cfd0/users/5f2371d05fb84fe5b77001e2caf9e26c/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.480419 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 775/1549] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:12 2021] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:12.480419 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ff103-b0af-4d57-8b07-fe3fa58038ee admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:12.487797 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ff103-b0af-4d57-8b07-fe3fa58038ee admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:12.492291 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0e899-6db8-41a1-a5c3-7d80434640d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.492516 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2943ca-741e-43aa-ae1e-c75bf43439a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=240e1d9727694fafaabfa278fbe4cfd0, user_id=5f2371d05fb84fe5b77001e2caf9e26c, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.492910 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0e899-6db8-41a1-a5c3-7d80434640d7 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.493197 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0e899-6db8-41a1-a5c3-7d80434640d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.493489 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0e899-6db8-41a1-a5c3-7d80434640d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.494226 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0e899-6db8-41a1-a5c3-7d80434640d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.495253 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2943ca-741e-43aa-ae1e-c75bf43439a2 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:12.495825 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0e899-6db8-41a1-a5c3-7d80434640d7 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:12.507475 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 776/1550] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:12 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:12.508270 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0e899-6db8-41a1-a5c3-7d80434640d7 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:12.520897 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 775/1551] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:12 2021] PUT /identity/v3/projects/240e1d9727694fafaabfa278fbe4cfd0/users/5f2371d05fb84fe5b77001e2caf9e26c/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:12.520897 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2943ca-741e-43aa-ae1e-c75bf43439a2 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:12.521231 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0e899-6db8-41a1-a5c3-7d80434640d7 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:12.584537 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4edc5a-07fd-48ce-b956-d5cf54ff24a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.585178 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4edc5a-07fd-48ce-b956-d5cf54ff24a5 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.585468 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4edc5a-07fd-48ce-b956-d5cf54ff24a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.585751 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4edc5a-07fd-48ce-b956-d5cf54ff24a5 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.586393 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4edc5a-07fd-48ce-b956-d5cf54ff24a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.588336 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4edc5a-07fd-48ce-b956-d5cf54ff24a5 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:12.588577 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2943ca-741e-43aa-ae1e-c75bf43439a2 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:12.593159 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ca3f0-8b41-4361-8ed5-7b61d69f8071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.593774 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ca3f0-8b41-4361-8ed5-7b61d69f8071 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.594067 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ca3f0-8b41-4361-8ed5-7b61d69f8071 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.594350 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ca3f0-8b41-4361-8ed5-7b61d69f8071 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.595163 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ca3f0-8b41-4361-8ed5-7b61d69f8071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.596759 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ca3f0-8b41-4361-8ed5-7b61d69f8071 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:12.608835 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 777/1552] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:12 2021] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:12.613555 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 776/1553] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:12 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:12.613804 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4edc5a-07fd-48ce-b956-d5cf54ff24a5 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:12.613901 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ca3f0-8b41-4361-8ed5-7b61d69f8071 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:12.621035 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4edc5a-07fd-48ce-b956-d5cf54ff24a5 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:12.621421 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ca3f0-8b41-4361-8ed5-7b61d69f8071 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:12.626114 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d367eba-4205-4db8-a417-cc6a93c6dcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.626669 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5debc7-c276-4a15-91f0-61345f85a43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.626940 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d367eba-4205-4db8-a417-cc6a93c6dcfb admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.627233 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d367eba-4205-4db8-a417-cc6a93c6dcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.627342 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5debc7-c276-4a15-91f0-61345f85a43c admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.627513 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d367eba-4205-4db8-a417-cc6a93c6dcfb admin admin] PATH_INFO: `/v3/projects/ceb0da71791f4f9889daab33c73ac572/users/4166133ac04844d491662feab2bd2d21/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.627619 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5debc7-c276-4a15-91f0-61345f85a43c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.627845 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5debc7-c276-4a15-91f0-61345f85a43c admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.628519 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5debc7-c276-4a15-91f0-61345f85a43c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.630505 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5debc7-c276-4a15-91f0-61345f85a43c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:12.650219 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d367eba-4205-4db8-a417-cc6a93c6dcfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceb0da71791f4f9889daab33c73ac572, user_id=4166133ac04844d491662feab2bd2d21, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.650721 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 777/1554] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:12 2021] POST /identity/v3/users => generated 284 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:12.651539 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5debc7-c276-4a15-91f0-61345f85a43c admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:12.653682 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d367eba-4205-4db8-a417-cc6a93c6dcfb admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:12.663222 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5debc7-c276-4a15-91f0-61345f85a43c admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:12.667291 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 778/1555] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:12 2021] PUT /identity/v3/projects/ceb0da71791f4f9889daab33c73ac572/users/4166133ac04844d491662feab2bd2d21/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:12.668117 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d367eba-4205-4db8-a417-cc6a93c6dcfb admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:12.729548 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c5e44-108c-4582-b0cb-58dd8e706d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.730320 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c5e44-108c-4582-b0cb-58dd8e706d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.730633 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c5e44-108c-4582-b0cb-58dd8e706d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.730900 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c5e44-108c-4582-b0cb-58dd8e706d43 admin admin] PATH_INFO: `/v3/projects/5a786fd41c4a47a5a1d7a4b84ee4d572/users/f627542b5c7c4fb78a361f648cc9de4b/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.735656 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d367eba-4205-4db8-a417-cc6a93c6dcfb admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:12.740182 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8425c-05b4-45af-8d63-3d181e868124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.740794 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8425c-05b4-45af-8d63-3d181e868124 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.741107 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8425c-05b4-45af-8d63-3d181e868124 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.741387 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8425c-05b4-45af-8d63-3d181e868124 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.742086 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8425c-05b4-45af-8d63-3d181e868124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.743683 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8425c-05b4-45af-8d63-3d181e868124 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:12.751971 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c5e44-108c-4582-b0cb-58dd8e706d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a786fd41c4a47a5a1d7a4b84ee4d572, user_id=f627542b5c7c4fb78a361f648cc9de4b, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.757662 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 779/1556] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:12 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:12.757823 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c5e44-108c-4582-b0cb-58dd8e706d43 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:12.757918 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8425c-05b4-45af-8d63-3d181e868124 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:12.765209 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8425c-05b4-45af-8d63-3d181e868124 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:12.767986 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 778/1557] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:12 2021] PUT /identity/v3/projects/5a786fd41c4a47a5a1d7a4b84ee4d572/users/f627542b5c7c4fb78a361f648cc9de4b/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:12.769260 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fad9b-6d68-458e-a34d-78d0615d51c6 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.769581 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fad9b-6d68-458e-a34d-78d0615d51c6 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.769863 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fad9b-6d68-458e-a34d-78d0615d51c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.808139 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-db7fad9b-6d68-458e-a34d-78d0615d51c6 None None] MFA Rules not processed for user `5f2371d05fb84fe5b77001e2caf9e26c`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:12.810016 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-db7fad9b-6d68-458e-a34d-78d0615d51c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:12.834236 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600dfd7-9b9f-44e5-aa5c-b4c4bf0485a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.834855 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600dfd7-9b9f-44e5-aa5c-b4c4bf0485a6 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.835148 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600dfd7-9b9f-44e5-aa5c-b4c4bf0485a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.835435 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600dfd7-9b9f-44e5-aa5c-b4c4bf0485a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.836138 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600dfd7-9b9f-44e5-aa5c-b4c4bf0485a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.837785 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600dfd7-9b9f-44e5-aa5c-b4c4bf0485a6 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:12.848247 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 780/1558] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:12 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:12.850173 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600dfd7-9b9f-44e5-aa5c-b4c4bf0485a6 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:12.862117 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600dfd7-9b9f-44e5-aa5c-b4c4bf0485a6 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:12.866984 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f52806-82dd-45f9-8ad4-129e68889407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.867642 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f52806-82dd-45f9-8ad4-129e68889407 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.867947 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f52806-82dd-45f9-8ad4-129e68889407 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.868234 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f52806-82dd-45f9-8ad4-129e68889407 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.868997 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f52806-82dd-45f9-8ad4-129e68889407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.870688 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f52806-82dd-45f9-8ad4-129e68889407 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:12.882395 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 781/1559] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:12 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:12.883648 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f52806-82dd-45f9-8ad4-129e68889407 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:12.887248 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 779/1560] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:12 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:12.888120 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fad9b-6d68-458e-a34d-78d0615d51c6 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:12.895486 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f52806-82dd-45f9-8ad4-129e68889407 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:12.900121 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af7369-10df-4940-bc3f-c9442abbde7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.900260 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fad9b-6d68-458e-a34d-78d0615d51c6 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:12.901012 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af7369-10df-4940-bc3f-c9442abbde7e admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.901308 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af7369-10df-4940-bc3f-c9442abbde7e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.901594 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af7369-10df-4940-bc3f-c9442abbde7e admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.902292 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af7369-10df-4940-bc3f-c9442abbde7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.903922 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af7369-10df-4940-bc3f-c9442abbde7e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:12.904996 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f329076-8ff8-460d-b909-75f2e869a80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.905598 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f329076-8ff8-460d-b909-75f2e869a80a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.905893 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f329076-8ff8-460d-b909-75f2e869a80a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.906172 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f329076-8ff8-460d-b909-75f2e869a80a admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.906895 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f329076-8ff8-460d-b909-75f2e869a80a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.908481 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f329076-8ff8-460d-b909-75f2e869a80a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:12.914732 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 782/1561] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:12 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:12.915973 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef50aa-463c-41f6-ad90-9b9141ae0334 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.916267 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef50aa-463c-41f6-ad90-9b9141ae0334 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.916554 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef50aa-463c-41f6-ad90-9b9141ae0334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.920836 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 780/1562] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:12 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:12.921919 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f329076-8ff8-460d-b909-75f2e869a80a admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:12.931602 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f329076-8ff8-460d-b909-75f2e869a80a admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:12.936835 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007659c-27aa-41fe-9ffc-d99919666cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.937432 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007659c-27aa-41fe-9ffc-d99919666cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.937724 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007659c-27aa-41fe-9ffc-d99919666cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.938003 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007659c-27aa-41fe-9ffc-d99919666cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.938687 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007659c-27aa-41fe-9ffc-d99919666cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.939188 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-a7ef50aa-463c-41f6-ad90-9b9141ae0334 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:12.940257 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007659c-27aa-41fe-9ffc-d99919666cd4 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:12.940377 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-a7ef50aa-463c-41f6-ad90-9b9141ae0334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:12.947423 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 783/1563] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:12.949424 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747952e-ea27-48d6-aece-4422fd2ff1d4 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.949831 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747952e-ea27-48d6-aece-4422fd2ff1d4 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.950225 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747952e-ea27-48d6-aece-4422fd2ff1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.954603 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 781/1564] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:12 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:12.954603 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007659c-27aa-41fe-9ffc-d99919666cd4 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:12.961799 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007659c-27aa-41fe-9ffc-d99919666cd4 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:12.966960 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa158aa-e6ee-4c95-b74d-413b03d0cf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.967781 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa158aa-e6ee-4c95-b74d-413b03d0cf98 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.968069 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa158aa-e6ee-4c95-b74d-413b03d0cf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.968369 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa158aa-e6ee-4c95-b74d-413b03d0cf98 admin admin] PATH_INFO: `/v3/projects/ad86e0e40b274e87ab64017d0cfef538/users/849f342dd3d84a44b9e35bd3fc4d0e89/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.988437 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-b747952e-ea27-48d6-aece-4422fd2ff1d4 None None] MFA Rules not processed for user `f627542b5c7c4fb78a361f648cc9de4b`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:12.988802 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa158aa-e6ee-4c95-b74d-413b03d0cf98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad86e0e40b274e87ab64017d0cfef538, user_id=849f342dd3d84a44b9e35bd3fc4d0e89, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.989543 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-b747952e-ea27-48d6-aece-4422fd2ff1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:12.991488 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa158aa-e6ee-4c95-b74d-413b03d0cf98 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:13.016197 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 782/1565] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:12 2021] PUT /identity/v3/projects/ad86e0e40b274e87ab64017d0cfef538/users/849f342dd3d84a44b9e35bd3fc4d0e89/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:13.016197 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa158aa-e6ee-4c95-b74d-413b03d0cf98 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:13.065732 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 784/1566] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:12 2021] POST /identity/v3/auth/tokens => generated 3710 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:13.066848 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747952e-ea27-48d6-aece-4422fd2ff1d4 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:13.078908 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747952e-ea27-48d6-aece-4422fd2ff1d4 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:13.083316 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52d24c-e4d6-43fe-8a2d-0980c83af936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:13.083906 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52d24c-e4d6-43fe-8a2d-0980c83af936 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:13.084198 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52d24c-e4d6-43fe-8a2d-0980c83af936 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:13.084482 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52d24c-e4d6-43fe-8a2d-0980c83af936 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:13.084579 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa158aa-e6ee-4c95-b74d-413b03d0cf98 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:13.085159 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea52d24c-e4d6-43fe-8a2d-0980c83af936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:13.087082 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea52d24c-e4d6-43fe-8a2d-0980c83af936 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:13.089068 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b0352-8975-43a4-8a22-6343f2336fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:13.089916 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b0352-8975-43a4-8a22-6343f2336fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:13.090207 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b0352-8975-43a4-8a22-6343f2336fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:13.091108 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b0352-8975-43a4-8a22-6343f2336fbc admin admin] PATH_INFO: `/v3/projects/431320546381414684830eb2bc36deef/users/18d85bcc0aeb413aa2ade769fd10e431/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:13.114266 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b0352-8975-43a4-8a22-6343f2336fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=431320546381414684830eb2bc36deef, user_id=18d85bcc0aeb413aa2ade769fd10e431, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:13.115088 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 785/1567] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:13 2021] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:13.115752 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52d24c-e4d6-43fe-8a2d-0980c83af936 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:13.117288 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b0352-8975-43a4-8a22-6343f2336fbc admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:13.130603 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 783/1568] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:13 2021] PUT /identity/v3/projects/431320546381414684830eb2bc36deef/users/18d85bcc0aeb413aa2ade769fd10e431/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:13.134989 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b0352-8975-43a4-8a22-6343f2336fbc admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:13.186626 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52d24c-e4d6-43fe-8a2d-0980c83af936 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:13.205038 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b0352-8975-43a4-8a22-6343f2336fbc admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:13.209681 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91cd7a-c4a7-4ed0-af3c-cd0b04c6c87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:13.210301 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91cd7a-c4a7-4ed0-af3c-cd0b04c6c87a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:13.210589 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91cd7a-c4a7-4ed0-af3c-cd0b04c6c87a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:13.210873 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91cd7a-c4a7-4ed0-af3c-cd0b04c6c87a admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:13.211582 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91cd7a-c4a7-4ed0-af3c-cd0b04c6c87a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:13.213240 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91cd7a-c4a7-4ed0-af3c-cd0b04c6c87a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:13.224535 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 784/1569] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:13 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:13.226163 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91cd7a-c4a7-4ed0-af3c-cd0b04c6c87a admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:13.238725 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91cd7a-c4a7-4ed0-af3c-cd0b04c6c87a admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:13.248528 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990e0c4-48c9-472f-ae68-122a8703d633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:13.249601 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990e0c4-48c9-472f-ae68-122a8703d633 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:13.249989 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990e0c4-48c9-472f-ae68-122a8703d633 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:13.250327 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990e0c4-48c9-472f-ae68-122a8703d633 admin admin] PATH_INFO: `/v3/projects/6ff98b579b504435a2894902e8739880/users/383fca1615944dee97b5fab5f3c6c2eb/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:13.264385 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f00a0c-501f-4165-94f1-d113dbd17d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:13.265019 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f00a0c-501f-4165-94f1-d113dbd17d5e admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:13.265337 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f00a0c-501f-4165-94f1-d113dbd17d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:13.265617 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f00a0c-501f-4165-94f1-d113dbd17d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:13.266314 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f00a0c-501f-4165-94f1-d113dbd17d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:13.268112 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f00a0c-501f-4165-94f1-d113dbd17d5e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:13.274114 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990e0c4-48c9-472f-ae68-122a8703d633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ff98b579b504435a2894902e8739880, user_id=383fca1615944dee97b5fab5f3c6c2eb, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:13.277022 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990e0c4-48c9-472f-ae68-122a8703d633 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:13.279135 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 786/1570] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:13 2021] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:13.279938 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f00a0c-501f-4165-94f1-d113dbd17d5e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:13.281599 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-f3f00a0c-501f-4165-94f1-d113dbd17d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:13.293551 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 785/1571] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:13 2021] PUT /identity/v3/projects/6ff98b579b504435a2894902e8739880/users/383fca1615944dee97b5fab5f3c6c2eb/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:13.295673 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de712f5f-8771-4551-b961-3454b93baec0 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:13.296040 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de712f5f-8771-4551-b961-3454b93baec0 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:13.296392 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de712f5f-8771-4551-b961-3454b93baec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:13.332314 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-de712f5f-8771-4551-b961-3454b93baec0 None None] MFA Rules not processed for user `849f342dd3d84a44b9e35bd3fc4d0e89`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:13.333511 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-de712f5f-8771-4551-b961-3454b93baec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:13.349019 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f00a0c-501f-4165-94f1-d113dbd17d5e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:13.405144 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb30afe-58d3-4585-9d51-59ae45db1839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:13.405908 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 786/1572] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:13 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:13.406029 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb30afe-58d3-4585-9d51-59ae45db1839 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:13.406029 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb30afe-58d3-4585-9d51-59ae45db1839 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:13.406317 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb30afe-58d3-4585-9d51-59ae45db1839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:13.406685 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de712f5f-8771-4551-b961-3454b93baec0 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:13.475155 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb30afe-58d3-4585-9d51-59ae45db1839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:13.476212 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de712f5f-8771-4551-b961-3454b93baec0 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:13.476658 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb30afe-58d3-4585-9d51-59ae45db1839 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:13.480658 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323910f3-acb4-46eb-8820-ca6b6960ce72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:13.481309 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323910f3-acb4-46eb-8820-ca6b6960ce72 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:13.481604 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323910f3-acb4-46eb-8820-ca6b6960ce72 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:13.481890 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323910f3-acb4-46eb-8820-ca6b6960ce72 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:13.482538 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323910f3-acb4-46eb-8820-ca6b6960ce72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:13.484455 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323910f3-acb4-46eb-8820-ca6b6960ce72 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:13.485967 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 787/1573] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:13.486783 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb30afe-58d3-4585-9d51-59ae45db1839 service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:13.496494 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb30afe-58d3-4585-9d51-59ae45db1839 service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:13.501061 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd815012-ca29-45f0-9111-b4257e0e6807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:13.501561 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd815012-ca29-45f0-9111-b4257e0e6807 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:13.501826 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd815012-ca29-45f0-9111-b4257e0e6807 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:13.502142 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd815012-ca29-45f0-9111-b4257e0e6807 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:13.502732 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd815012-ca29-45f0-9111-b4257e0e6807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:13.504886 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd815012-ca29-45f0-9111-b4257e0e6807 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:13.521321 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 787/1574] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:13 2021] POST /identity/v3/projects => generated 405 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:13.522844 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad71d16-5862-4bda-8804-72a290f5958a None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:13.523196 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad71d16-5862-4bda-8804-72a290f5958a None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:13.523896 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad71d16-5862-4bda-8804-72a290f5958a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:13.537157 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 788/1575] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:13 2021] POST /identity/v3/users => generated 295 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:13.537157 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd815012-ca29-45f0-9111-b4257e0e6807 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:13.546130 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd815012-ca29-45f0-9111-b4257e0e6807 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:13.553656 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-1ad71d16-5862-4bda-8804-72a290f5958a None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:13.555072 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-1ad71d16-5862-4bda-8804-72a290f5958a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:13.622644 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd44a1-45f5-4711-8848-da614bef16a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:13.624527 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd44a1-45f5-4711-8848-da614bef16a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:13.625096 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd44a1-45f5-4711-8848-da614bef16a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:13.625724 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd44a1-45f5-4711-8848-da614bef16a0 admin admin] PATH_INFO: `/v3/projects/8c614704dc5a42dbb79b9df13eb2460c/users/88b4fd8f81224e489507503f213b80d1/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:13.637151 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 788/1576] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:13.638325 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad71d16-5862-4bda-8804-72a290f5958a None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:13.649126 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad71d16-5862-4bda-8804-72a290f5958a None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:13.655016 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb149e52-7ef9-4726-bf17-ff7283481391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:13.655938 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb149e52-7ef9-4726-bf17-ff7283481391 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:13.656223 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb149e52-7ef9-4726-bf17-ff7283481391 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:13.656510 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb149e52-7ef9-4726-bf17-ff7283481391 admin admin] PATH_INFO: `/v3/projects/6906ddb7ea8b4cde8dabbec416e0f996/users/c8d3e42caae84fedb52ba42d8763ee91/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:13.660237 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd44a1-45f5-4711-8848-da614bef16a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c614704dc5a42dbb79b9df13eb2460c, user_id=88b4fd8f81224e489507503f213b80d1, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:13.663342 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd44a1-45f5-4711-8848-da614bef16a0 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:13.677505 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb149e52-7ef9-4726-bf17-ff7283481391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6906ddb7ea8b4cde8dabbec416e0f996, user_id=c8d3e42caae84fedb52ba42d8763ee91, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:13.680177 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb149e52-7ef9-4726-bf17-ff7283481391 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:13.680731 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 789/1577] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:13 2021] PUT /identity/v3/projects/8c614704dc5a42dbb79b9df13eb2460c/users/88b4fd8f81224e489507503f213b80d1/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:13.686260 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91af06-8954-4a98-8508-ef20516d2e4d None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:13.686497 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91af06-8954-4a98-8508-ef20516d2e4d None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:13.686766 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91af06-8954-4a98-8508-ef20516d2e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:13.707804 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 789/1578] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:13 2021] PUT /identity/v3/projects/6906ddb7ea8b4cde8dabbec416e0f996/users/c8d3e42caae84fedb52ba42d8763ee91/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:13.707804 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb149e52-7ef9-4726-bf17-ff7283481391 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:13.734256 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-3b91af06-8954-4a98-8508-ef20516d2e4d None None] MFA Rules not processed for user `383fca1615944dee97b5fab5f3c6c2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:13.735500 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-3b91af06-8954-4a98-8508-ef20516d2e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:13.786403 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb149e52-7ef9-4726-bf17-ff7283481391 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:13.792066 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a669325-5b39-49db-89c0-785f3e2ab2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:13.792744 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a669325-5b39-49db-89c0-785f3e2ab2a7 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:13.793140 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a669325-5b39-49db-89c0-785f3e2ab2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:13.793561 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a669325-5b39-49db-89c0-785f3e2ab2a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:13.794276 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a669325-5b39-49db-89c0-785f3e2ab2a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:13.796393 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a669325-5b39-49db-89c0-785f3e2ab2a7 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:13.829052 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 790/1579] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:13 2021] POST /identity/v3/projects => generated 365 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:13.829427 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 790/1580] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:13 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:13.829935 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a669325-5b39-49db-89c0-785f3e2ab2a7 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:13.830818 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91af06-8954-4a98-8508-ef20516d2e4d None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:13.842946 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91af06-8954-4a98-8508-ef20516d2e4d None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:13.918356 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a669325-5b39-49db-89c0-785f3e2ab2a7 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:13.919819 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83cea1-ab69-40ba-9038-4282cac3784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:13.920540 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83cea1-ab69-40ba-9038-4282cac3784c admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:13.921054 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83cea1-ab69-40ba-9038-4282cac3784c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:13.921710 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83cea1-ab69-40ba-9038-4282cac3784c admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:13.922512 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83cea1-ab69-40ba-9038-4282cac3784c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:13.923650 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cfd79-b66e-44b8-b1d4-916c89b7aa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:13.924255 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cfd79-b66e-44b8-b1d4-916c89b7aa29 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:13.924548 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cfd79-b66e-44b8-b1d4-916c89b7aa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:13.924835 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83cea1-ab69-40ba-9038-4282cac3784c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:13.924948 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cfd79-b66e-44b8-b1d4-916c89b7aa29 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:13.925498 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381cfd79-b66e-44b8-b1d4-916c89b7aa29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:13.927566 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381cfd79-b66e-44b8-b1d4-916c89b7aa29 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:13.939463 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 791/1581] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:13 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:13.940531 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83cea1-ab69-40ba-9038-4282cac3784c admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:13.958771 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 791/1582] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:13 2021] POST /identity/v3/users => generated 309 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:13.960678 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5691e-eb65-4504-b572-b5315e8d554d None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:13.961294 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5691e-eb65-4504-b572-b5315e8d554d None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:13.961820 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5691e-eb65-4504-b572-b5315e8d554d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:14.015970 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-64f5691e-eb65-4504-b572-b5315e8d554d None None] MFA Rules not processed for user `88b4fd8f81224e489507503f213b80d1`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:14.017991 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-64f5691e-eb65-4504-b572-b5315e8d554d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:14.020503 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83cea1-ab69-40ba-9038-4282cac3784c admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:14.024639 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb0589-e3e9-4294-b448-2612daf777d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:14.025107 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb0589-e3e9-4294-b448-2612daf777d4 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:14.025740 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb0589-e3e9-4294-b448-2612daf777d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:14.026125 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb0589-e3e9-4294-b448-2612daf777d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:14.035935 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb0589-e3e9-4294-b448-2612daf777d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:14.037591 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb0589-e3e9-4294-b448-2612daf777d4 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:14.048549 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 792/1583] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:14.049916 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a4f41-6076-4bfc-91e8-a89504ff1299 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:14.050318 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a4f41-6076-4bfc-91e8-a89504ff1299 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:14.050695 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a4f41-6076-4bfc-91e8-a89504ff1299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:14.099175 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-ea0a4f41-6076-4bfc-91e8-a89504ff1299 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:14.100602 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-ea0a4f41-6076-4bfc-91e8-a89504ff1299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:14.125207 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 792/1584] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:13 2021] POST /identity/v3/auth/tokens => generated 3674 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:14.126159 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 793/1585] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:14.126431 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5691e-eb65-4504-b572-b5315e8d554d None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:14.128003 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798b2b2-fa4f-4106-bb75-359f61fec78e None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:14.128544 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798b2b2-fa4f-4106-bb75-359f61fec78e None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:14.129023 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798b2b2-fa4f-4106-bb75-359f61fec78e None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:14.136053 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 794/1586] 10.222.0.64 () {54 vars in 959 bytes} [Thu Dec 16 14:39:14 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:39:14.137522 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798b2b2-fa4f-4106-bb75-359f61fec78e None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:14.138323 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5691e-eb65-4504-b572-b5315e8d554d None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:14.143452 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac56e3-cd9d-46b6-b8c4-773fd669bb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:14.144174 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac56e3-cd9d-46b6-b8c4-773fd669bb07 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:14.144654 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac56e3-cd9d-46b6-b8c4-773fd669bb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:14.145102 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac56e3-cd9d-46b6-b8c4-773fd669bb07 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:14.145989 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac56e3-cd9d-46b6-b8c4-773fd669bb07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:14.147993 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac56e3-cd9d-46b6-b8c4-773fd669bb07 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:14.153691 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798b2b2-fa4f-4106-bb75-359f61fec78e None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:14.159986 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe5bdf-13ff-450e-8a69-d78dea6fd2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:14.161356 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe5bdf-13ff-450e-8a69-d78dea6fd2b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:14.161845 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe5bdf-13ff-450e-8a69-d78dea6fd2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:14.162867 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe5bdf-13ff-450e-8a69-d78dea6fd2b4 admin admin] PATH_INFO: `/v3/projects/a9df4f468c1740dba748fa30cc0cff0a/users/f6d65180799d4a7184cdc1593e14f066/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:14.172606 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 793/1587] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:14 2021] POST /identity/v3/users => generated 289 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:14.173635 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac56e3-cd9d-46b6-b8c4-773fd669bb07 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:14.188209 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe5bdf-13ff-450e-8a69-d78dea6fd2b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9df4f468c1740dba748fa30cc0cff0a, user_id=f6d65180799d4a7184cdc1593e14f066, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:14.188457 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac56e3-cd9d-46b6-b8c4-773fd669bb07 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:14.191314 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe5bdf-13ff-450e-8a69-d78dea6fd2b4 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:14.193438 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25207011-ac92-4d83-9a27-079bb01763eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:14.194168 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25207011-ac92-4d83-9a27-079bb01763eb admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:14.194529 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25207011-ac92-4d83-9a27-079bb01763eb admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:14.195409 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25207011-ac92-4d83-9a27-079bb01763eb admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:14.196256 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25207011-ac92-4d83-9a27-079bb01763eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:14.197992 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25207011-ac92-4d83-9a27-079bb01763eb admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:14.210198 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 795/1588] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:14 2021] PUT /identity/v3/projects/a9df4f468c1740dba748fa30cc0cff0a/users/f6d65180799d4a7184cdc1593e14f066/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:14.211718 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe5bdf-13ff-450e-8a69-d78dea6fd2b4 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:14.214587 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 794/1589] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:14 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:14.219549 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f820ab-6462-4005-97fd-c5928d5b2066 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:14.219863 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f820ab-6462-4005-97fd-c5928d5b2066 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:14.220133 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f820ab-6462-4005-97fd-c5928d5b2066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:14.253464 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-99f820ab-6462-4005-97fd-c5928d5b2066 None None] MFA Rules not processed for user `8e416527de444ef1b744da062ee1e7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:14.254621 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-99f820ab-6462-4005-97fd-c5928d5b2066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:14.313973 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe5bdf-13ff-450e-8a69-d78dea6fd2b4 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:14.320402 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea55a86-bb8a-4a9f-85a5-9d3cb9ab65b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:14.321311 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea55a86-bb8a-4a9f-85a5-9d3cb9ab65b3 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:14.321672 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea55a86-bb8a-4a9f-85a5-9d3cb9ab65b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:14.322340 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea55a86-bb8a-4a9f-85a5-9d3cb9ab65b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:14.323379 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea55a86-bb8a-4a9f-85a5-9d3cb9ab65b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:14.326504 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea55a86-bb8a-4a9f-85a5-9d3cb9ab65b3 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:14.346204 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 795/1590] 10.222.0.64 () {58 vars in 1056 bytes} [Thu Dec 16 14:39:14 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:14.346512 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f820ab-6462-4005-97fd-c5928d5b2066 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:14.380239 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 796/1591] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:14 2021] POST /identity/v3/projects => generated 369 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:14.380239 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea55a86-bb8a-4a9f-85a5-9d3cb9ab65b3 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:14.474638 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea55a86-bb8a-4a9f-85a5-9d3cb9ab65b3 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:14.480731 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192437fa-fa9e-473c-883d-261c93a6fc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:14.481488 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192437fa-fa9e-473c-883d-261c93a6fc4e admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:14.481778 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192437fa-fa9e-473c-883d-261c93a6fc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:14.482116 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192437fa-fa9e-473c-883d-261c93a6fc4e admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:14.482532 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f820ab-6462-4005-97fd-c5928d5b2066 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:14.483721 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192437fa-fa9e-473c-883d-261c93a6fc4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:14.485793 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192437fa-fa9e-473c-883d-261c93a6fc4e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:14.511538 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 797/1592] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:14 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:14.511538 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192437fa-fa9e-473c-883d-261c93a6fc4e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:14.536459 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192437fa-fa9e-473c-883d-261c93a6fc4e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:14.548376 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5624d-0d67-4426-b1d9-867492387127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:14.549177 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5624d-0d67-4426-b1d9-867492387127 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:14.549474 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5624d-0d67-4426-b1d9-867492387127 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:14.550101 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5624d-0d67-4426-b1d9-867492387127 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:14.550525 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5624d-0d67-4426-b1d9-867492387127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:14.552476 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5624d-0d67-4426-b1d9-867492387127 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:14.568864 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 798/1593] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:14 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:14.570547 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5624d-0d67-4426-b1d9-867492387127 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:14.575798 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303729f-96c4-4a87-aaab-d8759c081ab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:14.576403 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303729f-96c4-4a87-aaab-d8759c081ab2 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:14.576869 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303729f-96c4-4a87-aaab-d8759c081ab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:14.577163 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303729f-96c4-4a87-aaab-d8759c081ab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:14.595395 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5624d-0d67-4426-b1d9-867492387127 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:14.599091 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303729f-96c4-4a87-aaab-d8759c081ab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:14.602382 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303729f-96c4-4a87-aaab-d8759c081ab2 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:14.608998 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c442a6-3aaa-4eed-98c9-c8c6f1955898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:14.610034 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c442a6-3aaa-4eed-98c9-c8c6f1955898 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:14.610268 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c442a6-3aaa-4eed-98c9-c8c6f1955898 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:14.610551 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c442a6-3aaa-4eed-98c9-c8c6f1955898 admin admin] PATH_INFO: `/v3/projects/f2426559b48445779bd47b88e3d34c6b/users/c97d164a91bf477fba79b45df9b4815d/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:14.626959 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 796/1594] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:14 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:14.627807 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303729f-96c4-4a87-aaab-d8759c081ab2 service neutron] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:14.649653 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c442a6-3aaa-4eed-98c9-c8c6f1955898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2426559b48445779bd47b88e3d34c6b, user_id=c97d164a91bf477fba79b45df9b4815d, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:14.654371 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c442a6-3aaa-4eed-98c9-c8c6f1955898 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:14.677263 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 799/1595] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:14 2021] PUT /identity/v3/projects/f2426559b48445779bd47b88e3d34c6b/users/c97d164a91bf477fba79b45df9b4815d/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:14.679660 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c442a6-3aaa-4eed-98c9-c8c6f1955898 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:14.800807 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303729f-96c4-4a87-aaab-d8759c081ab2 service neutron] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:14.845232 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c442a6-3aaa-4eed-98c9-c8c6f1955898 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:14.861894 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740f2e5-8899-4f09-980e-35faeb29425c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:14.862543 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740f2e5-8899-4f09-980e-35faeb29425c admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:14.862844 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740f2e5-8899-4f09-980e-35faeb29425c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:14.863120 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740f2e5-8899-4f09-980e-35faeb29425c admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:14.864410 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6740f2e5-8899-4f09-980e-35faeb29425c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:14.866556 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6740f2e5-8899-4f09-980e-35faeb29425c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:14.929758 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 800/1596] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:14 2021] POST /identity/v3/users => generated 291 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:14.931856 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740f2e5-8899-4f09-980e-35faeb29425c admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:14.962912 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740f2e5-8899-4f09-980e-35faeb29425c admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:14.972436 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fdc4d-7cbf-497e-9749-74e9b6d27334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:14.974224 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fdc4d-7cbf-497e-9749-74e9b6d27334 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:14.976686 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fdc4d-7cbf-497e-9749-74e9b6d27334 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:14.978544 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fdc4d-7cbf-497e-9749-74e9b6d27334 admin admin] PATH_INFO: `/v3/projects/f8788e65564f4cb08f1c828b1b947597/users/d8fac945f56a4b0a9da5db88283201fd/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:15.020582 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1fdc4d-7cbf-497e-9749-74e9b6d27334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8788e65564f4cb08f1c828b1b947597, user_id=d8fac945f56a4b0a9da5db88283201fd, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:15.024230 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1fdc4d-7cbf-497e-9749-74e9b6d27334 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:15.051260 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 801/1597] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:14 2021] PUT /identity/v3/projects/f8788e65564f4cb08f1c828b1b947597/users/d8fac945f56a4b0a9da5db88283201fd/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:15.054968 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fdc4d-7cbf-497e-9749-74e9b6d27334 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:15.075524 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c3c2d-de37-4c02-b846-fb6c647e9445 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:15.076692 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c3c2d-de37-4c02-b846-fb6c647e9445 service nova] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:15.079647 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c3c2d-de37-4c02-b846-fb6c647e9445 service nova] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:15.080077 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c3c2d-de37-4c02-b846-fb6c647e9445 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:15.140512 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fdc4d-7cbf-497e-9749-74e9b6d27334 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:15.147530 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ee07a-f1ca-45b7-b0ac-957098e4d4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:15.148574 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ee07a-f1ca-45b7-b0ac-957098e4d4f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:15.149006 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ee07a-f1ca-45b7-b0ac-957098e4d4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:15.149440 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ee07a-f1ca-45b7-b0ac-957098e4d4f5 admin admin] PATH_INFO: `/v3/projects/a9df4f468c1740dba748fa30cc0cff0a/users/f6d65180799d4a7184cdc1593e14f066/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:15.152082 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ee07a-f1ca-45b7-b0ac-957098e4d4f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9df4f468c1740dba748fa30cc0cff0a, user_id=f6d65180799d4a7184cdc1593e14f066, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:15.155666 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ee07a-f1ca-45b7-b0ac-957098e4d4f5 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:15.178113 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 802/1598] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:15 2021] PUT /identity/v3/projects/a9df4f468c1740dba748fa30cc0cff0a/users/f6d65180799d4a7184cdc1593e14f066/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:15.178113 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ee07a-f1ca-45b7-b0ac-957098e4d4f5 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:15.208617 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c3c2d-de37-4c02-b846-fb6c647e9445 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:15.210481 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c3c2d-de37-4c02-b846-fb6c647e9445 service nova] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:15.234263 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 797/1599] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:14 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:15.235279 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c3c2d-de37-4c02-b846-fb6c647e9445 service nova] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:15.258993 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c3c2d-de37-4c02-b846-fb6c647e9445 service nova] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:15.269121 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905aac64-dfaf-4d1b-9f29-9f945dcb0788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:15.270252 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905aac64-dfaf-4d1b-9f29-9f945dcb0788 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:15.270646 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ee07a-f1ca-45b7-b0ac-957098e4d4f5 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:15.271047 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905aac64-dfaf-4d1b-9f29-9f945dcb0788 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:15.271533 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905aac64-dfaf-4d1b-9f29-9f945dcb0788 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:15.272451 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905aac64-dfaf-4d1b-9f29-9f945dcb0788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:15.275745 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20553e45-7a7a-4b07-ad79-184a48a952b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:15.276497 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20553e45-7a7a-4b07-ad79-184a48a952b5 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:15.276802 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20553e45-7a7a-4b07-ad79-184a48a952b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:15.277134 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20553e45-7a7a-4b07-ad79-184a48a952b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:15.277959 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20553e45-7a7a-4b07-ad79-184a48a952b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:15.279249 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905aac64-dfaf-4d1b-9f29-9f945dcb0788 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:15.280263 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20553e45-7a7a-4b07-ad79-184a48a952b5 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:15.295612 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 803/1600] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:15 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:15.296641 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20553e45-7a7a-4b07-ad79-184a48a952b5 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:15.308301 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20553e45-7a7a-4b07-ad79-184a48a952b5 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:15.313272 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 798/1601] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:15 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:15.314987 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f4ffb-07a5-42cd-9d3e-66f79342ead0 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:15.319417 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f4ffb-07a5-42cd-9d3e-66f79342ead0 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:15.319860 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fafdae-dd0f-407f-ba7f-78a2b158c356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:15.320462 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fafdae-dd0f-407f-ba7f-78a2b158c356 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:15.320822 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f4ffb-07a5-42cd-9d3e-66f79342ead0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:15.321045 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fafdae-dd0f-407f-ba7f-78a2b158c356 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:15.321152 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fafdae-dd0f-407f-ba7f-78a2b158c356 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:15.321995 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fafdae-dd0f-407f-ba7f-78a2b158c356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:15.323744 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fafdae-dd0f-407f-ba7f-78a2b158c356 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:15.341365 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 804/1602] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:15 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:15.341365 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fafdae-dd0f-407f-ba7f-78a2b158c356 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:15.349931 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fafdae-dd0f-407f-ba7f-78a2b158c356 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:15.354460 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460c70d-4a9b-49d3-ab8a-48e39d76084a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:15.355476 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460c70d-4a9b-49d3-ab8a-48e39d76084a admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:15.356153 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460c70d-4a9b-49d3-ab8a-48e39d76084a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:15.356448 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460c70d-4a9b-49d3-ab8a-48e39d76084a admin admin] PATH_INFO: `/v3/projects/f2426559b48445779bd47b88e3d34c6b/users/c97d164a91bf477fba79b45df9b4815d/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:15.358427 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460c70d-4a9b-49d3-ab8a-48e39d76084a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2426559b48445779bd47b88e3d34c6b, user_id=c97d164a91bf477fba79b45df9b4815d, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:15.361410 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460c70d-4a9b-49d3-ab8a-48e39d76084a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:15.374349 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 805/1603] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:15 2021] PUT /identity/v3/projects/f2426559b48445779bd47b88e3d34c6b/users/c97d164a91bf477fba79b45df9b4815d/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:15.375356 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460c70d-4a9b-49d3-ab8a-48e39d76084a admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:15.429183 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-774f4ffb-07a5-42cd-9d3e-66f79342ead0 None None] MFA Rules not processed for user `f6d65180799d4a7184cdc1593e14f066`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:15.430857 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-774f4ffb-07a5-42cd-9d3e-66f79342ead0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:15.480467 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460c70d-4a9b-49d3-ab8a-48e39d76084a admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:15.485837 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdb688-a739-43ee-a473-30da5139e854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:15.486820 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdb688-a739-43ee-a473-30da5139e854 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:15.487221 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdb688-a739-43ee-a473-30da5139e854 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:15.487405 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdb688-a739-43ee-a473-30da5139e854 admin admin] PATH_INFO: `/v3/projects/2591113b3964487b97d4124db6e36a39/users/142023598c53476e9afa773db40dab8e/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:15.511602 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bdb688-a739-43ee-a473-30da5139e854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2591113b3964487b97d4124db6e36a39, user_id=142023598c53476e9afa773db40dab8e, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:15.515046 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bdb688-a739-43ee-a473-30da5139e854 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:15.535968 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 806/1604] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:15 2021] PUT /identity/v3/projects/2591113b3964487b97d4124db6e36a39/users/142023598c53476e9afa773db40dab8e/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:15.537382 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdb688-a739-43ee-a473-30da5139e854 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:15.624588 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 799/1605] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:15 2021] POST /identity/v3/auth/tokens => generated 3751 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:15.626356 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed1cf0-53c1-4ae1-be24-db2a8be19bee None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:15.626868 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed1cf0-53c1-4ae1-be24-db2a8be19bee None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:15.627505 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed1cf0-53c1-4ae1-be24-db2a8be19bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:15.654454 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdb688-a739-43ee-a473-30da5139e854 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:15.662393 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec5820-b748-4318-84db-e2f92f0c8bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:15.663422 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec5820-b748-4318-84db-e2f92f0c8bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:15.663864 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec5820-b748-4318-84db-e2f92f0c8bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:15.664218 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec5820-b748-4318-84db-e2f92f0c8bfe admin admin] PATH_INFO: `/v3/projects/f8788e65564f4cb08f1c828b1b947597/users/d8fac945f56a4b0a9da5db88283201fd/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:15.666383 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec5820-b748-4318-84db-e2f92f0c8bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8788e65564f4cb08f1c828b1b947597, user_id=d8fac945f56a4b0a9da5db88283201fd, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:15.669377 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec5820-b748-4318-84db-e2f92f0c8bfe admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:15.680718 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 807/1606] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:15 2021] PUT /identity/v3/projects/f8788e65564f4cb08f1c828b1b947597/users/d8fac945f56a4b0a9da5db88283201fd/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:15.690291 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec5820-b748-4318-84db-e2f92f0c8bfe admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:15.690708 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-3aed1cf0-53c1-4ae1-be24-db2a8be19bee None None] MFA Rules not processed for user `c97d164a91bf477fba79b45df9b4815d`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:15.692889 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-3aed1cf0-53c1-4ae1-be24-db2a8be19bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:15.767888 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec5820-b748-4318-84db-e2f92f0c8bfe admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:15.772886 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543819e7-b6ef-4ded-8983-13a385644c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:15.773579 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543819e7-b6ef-4ded-8983-13a385644c7a admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:15.774027 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543819e7-b6ef-4ded-8983-13a385644c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:15.774289 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543819e7-b6ef-4ded-8983-13a385644c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:15.775072 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543819e7-b6ef-4ded-8983-13a385644c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:15.777075 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543819e7-b6ef-4ded-8983-13a385644c7a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:15.793760 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 808/1607] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:15 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:15.793760 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543819e7-b6ef-4ded-8983-13a385644c7a admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:15.805066 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 800/1608] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:15 2021] POST /identity/v3/auth/tokens => generated 3779 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:15.805066 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c585146-1672-4abc-8a0c-21b844d2430c None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:15.805066 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c585146-1672-4abc-8a0c-21b844d2430c None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:15.805066 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c585146-1672-4abc-8a0c-21b844d2430c None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:15.807405 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 801/1609] 10.222.0.64 () {54 vars in 912 bytes} [Thu Dec 16 14:39:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:39:15.809567 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a01e3c-0923-40b8-a468-cc6fe6959624 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:15.809970 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a01e3c-0923-40b8-a468-cc6fe6959624 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:15.810202 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a01e3c-0923-40b8-a468-cc6fe6959624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:15.853905 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-10a01e3c-0923-40b8-a468-cc6fe6959624 None None] MFA Rules not processed for user `d8fac945f56a4b0a9da5db88283201fd`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:15.855789 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-10a01e3c-0923-40b8-a468-cc6fe6959624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:15.926254 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543819e7-b6ef-4ded-8983-13a385644c7a admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:15.935794 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479e653-c11c-450d-a4c7-db50b7c3867b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:15.939447 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479e653-c11c-450d-a4c7-db50b7c3867b service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:15.940489 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479e653-c11c-450d-a4c7-db50b7c3867b service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:15.941103 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479e653-c11c-450d-a4c7-db50b7c3867b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:16.047436 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 802/1610] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:15 2021] POST /identity/v3/auth/tokens => generated 3739 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:16.047436 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a01e3c-0923-40b8-a468-cc6fe6959624 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:16.063366 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479e653-c11c-450d-a4c7-db50b7c3867b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:16.064749 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479e653-c11c-450d-a4c7-db50b7c3867b service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:16.069096 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a01e3c-0923-40b8-a468-cc6fe6959624 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:16.077905 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed63c48-92b9-4c3b-b2ed-8bcc40cddebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:16.078885 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed63c48-92b9-4c3b-b2ed-8bcc40cddebe admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:16.079171 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed63c48-92b9-4c3b-b2ed-8bcc40cddebe admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:16.079450 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed63c48-92b9-4c3b-b2ed-8bcc40cddebe admin admin] PATH_INFO: `/v3/projects/2591113b3964487b97d4124db6e36a39/users/142023598c53476e9afa773db40dab8e/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:16.082811 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed63c48-92b9-4c3b-b2ed-8bcc40cddebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=2591113b3964487b97d4124db6e36a39, user_id=142023598c53476e9afa773db40dab8e, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:16.087278 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 809/1611] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:15 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:16.088730 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ec2df-178d-44f3-ac76-e2c2ac78cc40 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:16.089049 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ec2df-178d-44f3-ac76-e2c2ac78cc40 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:16.089333 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ec2df-178d-44f3-ac76-e2c2ac78cc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:16.091445 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed63c48-92b9-4c3b-b2ed-8bcc40cddebe admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:16.115116 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 803/1612] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:16 2021] PUT /identity/v3/projects/2591113b3964487b97d4124db6e36a39/users/142023598c53476e9afa773db40dab8e/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:16.115977 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed63c48-92b9-4c3b-b2ed-8bcc40cddebe admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:16.143735 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-9c5ec2df-178d-44f3-ac76-e2c2ac78cc40 None None] MFA Rules not processed for user `8e416527de444ef1b744da062ee1e7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:16.144977 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-9c5ec2df-178d-44f3-ac76-e2c2ac78cc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:16.285538 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed63c48-92b9-4c3b-b2ed-8bcc40cddebe admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:16.294659 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2fc30-49a4-4f0c-8d97-dcc2e972243c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:16.296161 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2fc30-49a4-4f0c-8d97-dcc2e972243c service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:16.296161 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2fc30-49a4-4f0c-8d97-dcc2e972243c service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:16.296161 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2fc30-49a4-4f0c-8d97-dcc2e972243c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:16.312853 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 810/1613] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Dec 16 14:39:16 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:16.315571 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc146b-4fb6-4210-aef4-6fb1b5623783 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:16.315773 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc146b-4fb6-4210-aef4-6fb1b5623783 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:16.316052 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc146b-4fb6-4210-aef4-6fb1b5623783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:16.431339 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-87cc146b-4fb6-4210-aef4-6fb1b5623783 None None] MFA Rules not processed for user `142023598c53476e9afa773db40dab8e`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:16.433295 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-87cc146b-4fb6-4210-aef4-6fb1b5623783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:16.453695 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2fc30-49a4-4f0c-8d97-dcc2e972243c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:16.455426 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2fc30-49a4-4f0c-8d97-dcc2e972243c service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:16.474221 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 804/1614] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:16 2021] GET /identity/v3/auth/tokens => generated 3779 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:16.614498 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2fc30-49a4-4f0c-8d97-dcc2e972243c service cinder] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:16.621259 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 811/1615] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:16 2021] POST /identity/v3/auth/tokens => generated 3743 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:16.627475 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2fc30-49a4-4f0c-8d97-dcc2e972243c service cinder] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:16.634951 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3afdc-1ee0-4aa3-8f42-f63790a59d0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:16.635734 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3afdc-1ee0-4aa3-8f42-f63790a59d0f service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:16.636134 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3afdc-1ee0-4aa3-8f42-f63790a59d0f service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:16.636923 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3afdc-1ee0-4aa3-8f42-f63790a59d0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:16.792284 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3afdc-1ee0-4aa3-8f42-f63790a59d0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:16.795874 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3afdc-1ee0-4aa3-8f42-f63790a59d0f service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:16.822324 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 805/1616] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:16 2021] GET /identity/v3/auth/tokens => generated 3739 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:39:16.928030 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc146b-4fb6-4210-aef4-6fb1b5623783 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:16.956266 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc146b-4fb6-4210-aef4-6fb1b5623783 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:16.961565 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b30aff-6b68-43fb-8543-12e14c685ad3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:16.963588 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b30aff-6b68-43fb-8543-12e14c685ad3 service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:16.964095 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b30aff-6b68-43fb-8543-12e14c685ad3 service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:16.964907 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b30aff-6b68-43fb-8543-12e14c685ad3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:16.983053 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b30aff-6b68-43fb-8543-12e14c685ad3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:16.985691 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b30aff-6b68-43fb-8543-12e14c685ad3 service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:17.021143 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 812/1617] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:16 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:17.377820 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3afdc-1ee0-4aa3-8f42-f63790a59d0f service cinder] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:17.403491 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3afdc-1ee0-4aa3-8f42-f63790a59d0f service cinder] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:17.417380 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3e1ae-9126-42a8-b784-fa39a6d584ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:17.419099 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3e1ae-9126-42a8-b784-fa39a6d584ba service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:17.419809 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3e1ae-9126-42a8-b784-fa39a6d584ba service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:17.420330 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3e1ae-9126-42a8-b784-fa39a6d584ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:17.454028 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3e1ae-9126-42a8-b784-fa39a6d584ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:17.455624 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3e1ae-9126-42a8-b784-fa39a6d584ba service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:17.470150 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 806/1618] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:17 2021] GET /identity/v3/auth/tokens => generated 3743 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:17.499458 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc5f0c-9f54-43da-b650-a77f6e40074d None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:17.501140 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc5f0c-9f54-43da-b650-a77f6e40074d None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:17.502550 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc5f0c-9f54-43da-b650-a77f6e40074d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:17.597782 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-75bc5f0c-9f54-43da-b650-a77f6e40074d None None] MFA Rules not processed for user `c8d3e42caae84fedb52ba42d8763ee91`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:17.600448 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-75bc5f0c-9f54-43da-b650-a77f6e40074d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:17.771266 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 813/1619] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:17 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:17.784805 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f252cd0-4176-4363-9d2a-41b5c31fab68 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:17.785397 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f252cd0-4176-4363-9d2a-41b5c31fab68 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:17.785854 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f252cd0-4176-4363-9d2a-41b5c31fab68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:17.842458 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-3f252cd0-4176-4363-9d2a-41b5c31fab68 None None] MFA Rules not processed for user `c8d3e42caae84fedb52ba42d8763ee91`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:17.844016 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-3f252cd0-4176-4363-9d2a-41b5c31fab68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:17.867889 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 807/1620] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:17 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:17.892224 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f98705-2062-4d21-b325-5d33aebb7e94 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:17.892706 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f98705-2062-4d21-b325-5d33aebb7e94 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:17.893038 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f98705-2062-4d21-b325-5d33aebb7e94 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:17.895965 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 814/1621] 10.222.0.64 () {54 vars in 959 bytes} [Thu Dec 16 14:39:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:39:17.908137 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5069cf-40b9-4b2b-b67c-6df040598c80 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:17.908433 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5069cf-40b9-4b2b-b67c-6df040598c80 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:17.908919 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5069cf-40b9-4b2b-b67c-6df040598c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:17.910197 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f98705-2062-4d21-b325-5d33aebb7e94 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:17.988308 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-9f5069cf-40b9-4b2b-b67c-6df040598c80 None None] MFA Rules not processed for user `8e416527de444ef1b744da062ee1e7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:17.994816 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-9f5069cf-40b9-4b2b-b67c-6df040598c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:18.031095 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 808/1622] 10.222.0.64 () {58 vars in 1056 bytes} [Thu Dec 16 14:39:17 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:18.042090 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5069cf-40b9-4b2b-b67c-6df040598c80 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:18.063790 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5069cf-40b9-4b2b-b67c-6df040598c80 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:18.096540 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63101149-125e-4c4e-8eac-10feb37bbc06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:18.099675 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63101149-125e-4c4e-8eac-10feb37bbc06 service nova] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:18.100175 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63101149-125e-4c4e-8eac-10feb37bbc06 service nova] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:18.100572 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63101149-125e-4c4e-8eac-10feb37bbc06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:18.132974 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63101149-125e-4c4e-8eac-10feb37bbc06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:18.135403 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63101149-125e-4c4e-8eac-10feb37bbc06 service nova] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:18.162528 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 809/1623] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:18 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:39:18.195213 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f98705-2062-4d21-b325-5d33aebb7e94 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:18.220192 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b6d6d-7a7f-48f3-9be3-ffc202f18f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:18.221052 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b6d6d-7a7f-48f3-9be3-ffc202f18f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:18.221345 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b6d6d-7a7f-48f3-9be3-ffc202f18f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:18.221626 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b6d6d-7a7f-48f3-9be3-ffc202f18f77 admin admin] PATH_INFO: `/v3/users/f627542b5c7c4fb78a361f648cc9de4b` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:18.222845 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b6d6d-7a7f-48f3-9be3-ffc202f18f77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f627542b5c7c4fb78a361f648cc9de4b)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:18.224818 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b6d6d-7a7f-48f3-9be3-ffc202f18f77 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:18.336969 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63101149-125e-4c4e-8eac-10feb37bbc06 service nova] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:18.359695 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63101149-125e-4c4e-8eac-10feb37bbc06 service nova] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:18.364541 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-843b6d6d-7a7f-48f3-9be3-ffc202f18f77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f627542b5c7c4fb78a361f648cc9de4b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:18.371313 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-843b6d6d-7a7f-48f3-9be3-ffc202f18f77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f627542b5c7c4fb78a361f648cc9de4b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:18.376553 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01582a-c8b1-47c0-8b02-c8613f650487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:18.377555 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01582a-c8b1-47c0-8b02-c8613f650487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:18.378944 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01582a-c8b1-47c0-8b02-c8613f650487 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:18.379573 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01582a-c8b1-47c0-8b02-c8613f650487 admin admin] PATH_INFO: `/v3/users/849f342dd3d84a44b9e35bd3fc4d0e89` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:18.385140 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01582a-c8b1-47c0-8b02-c8613f650487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=849f342dd3d84a44b9e35bd3fc4d0e89)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:18.386599 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: WARNING py.warnings [None req-6f01582a-c8b1-47c0-8b02-c8613f650487 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:39:18.386599 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: warnings.warn(msg) Dec 16 14:39:18.386599 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: Dec 16 14:39:18.389813 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01582a-c8b1-47c0-8b02-c8613f650487 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:18.402918 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-843b6d6d-7a7f-48f3-9be3-ffc202f18f77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f627542b5c7c4fb78a361f648cc9de4b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:18.415396 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-843b6d6d-7a7f-48f3-9be3-ffc202f18f77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f627542b5c7c4fb78a361f648cc9de4b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:18.442277 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-843b6d6d-7a7f-48f3-9be3-ffc202f18f77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f627542b5c7c4fb78a361f648cc9de4b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:18.450553 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 815/1624] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:17 2021] DELETE /identity/v3/users/f627542b5c7c4fb78a361f648cc9de4b => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:18.458440 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039bd75-0403-4cb7-aff8-43ea02b3c7f3 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:18.458733 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039bd75-0403-4cb7-aff8-43ea02b3c7f3 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:18.459041 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039bd75-0403-4cb7-aff8-43ea02b3c7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:18.545593 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-6039bd75-0403-4cb7-aff8-43ea02b3c7f3 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:18.547449 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-6039bd75-0403-4cb7-aff8-43ea02b3c7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:18.558724 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-6f01582a-c8b1-47c0-8b02-c8613f650487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '849f342dd3d84a44b9e35bd3fc4d0e89'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:18.562942 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-6f01582a-c8b1-47c0-8b02-c8613f650487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '849f342dd3d84a44b9e35bd3fc4d0e89'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:18.628394 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-6f01582a-c8b1-47c0-8b02-c8613f650487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '849f342dd3d84a44b9e35bd3fc4d0e89'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:18.660102 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-6f01582a-c8b1-47c0-8b02-c8613f650487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '849f342dd3d84a44b9e35bd3fc4d0e89'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:18.692669 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-6f01582a-c8b1-47c0-8b02-c8613f650487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '849f342dd3d84a44b9e35bd3fc4d0e89'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:18.705645 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 816/1625] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:18.727095 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 810/1626] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:18 2021] DELETE /identity/v3/users/849f342dd3d84a44b9e35bd3fc4d0e89 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:18.734268 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc92cf-2702-42d8-b00a-a434fe71d0f7 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:18.734944 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc92cf-2702-42d8-b00a-a434fe71d0f7 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:18.735245 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc92cf-2702-42d8-b00a-a434fe71d0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:18.737308 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01582a-c8b1-47c0-8b02-c8613f650487 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:18.739022 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-6f01582a-c8b1-47c0-8b02-c8613f650487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:18.850657 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-b5dc92cf-2702-42d8-b00a-a434fe71d0f7 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:18.858012 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-b5dc92cf-2702-42d8-b00a-a434fe71d0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:19.119095 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 817/1627] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:19.120434 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bd606-2eb1-4fca-ad98-c6ed48a1ccba None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:19.120731 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bd606-2eb1-4fca-ad98-c6ed48a1ccba None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:19.123051 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bd606-2eb1-4fca-ad98-c6ed48a1ccba None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:19.125127 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 818/1628] 10.222.0.64 () {54 vars in 912 bytes} [Thu Dec 16 14:39:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:39:19.133098 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235b498-f7c4-40bd-a58f-445af943fbe7 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:19.133485 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235b498-f7c4-40bd-a58f-445af943fbe7 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:19.134471 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235b498-f7c4-40bd-a58f-445af943fbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:19.175037 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-1235b498-f7c4-40bd-a58f-445af943fbe7 None None] MFA Rules not processed for user `8e416527de444ef1b744da062ee1e7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:19.176293 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-1235b498-f7c4-40bd-a58f-445af943fbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:19.194734 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01582a-c8b1-47c0-8b02-c8613f650487 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:19.206660 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92020f-bd3f-45ed-af5d-b85ca31d0502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:19.207277 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92020f-bd3f-45ed-af5d-b85ca31d0502 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:19.207569 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92020f-bd3f-45ed-af5d-b85ca31d0502 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:19.207852 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92020f-bd3f-45ed-af5d-b85ca31d0502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:19.246687 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92020f-bd3f-45ed-af5d-b85ca31d0502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:19.255190 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92020f-bd3f-45ed-af5d-b85ca31d0502 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:19.289146 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 811/1629] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:18 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:19.290184 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92020f-bd3f-45ed-af5d-b85ca31d0502 service neutron] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:19.326481 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92020f-bd3f-45ed-af5d-b85ca31d0502 service neutron] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:19.338211 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b853a0-9df8-4aa4-b31f-20346983ab34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:19.339136 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b853a0-9df8-4aa4-b31f-20346983ab34 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:19.339608 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b853a0-9df8-4aa4-b31f-20346983ab34 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:19.340900 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b853a0-9df8-4aa4-b31f-20346983ab34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:19.366580 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b853a0-9df8-4aa4-b31f-20346983ab34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:19.374744 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b853a0-9df8-4aa4-b31f-20346983ab34 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:19.397790 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 812/1630] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:19 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:19.428403 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 819/1631] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Dec 16 14:39:19 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:19.431386 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b853a0-9df8-4aa4-b31f-20346983ab34 service neutron] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:19.432940 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-c8b853a0-9df8-4aa4-b31f-20346983ab34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:19.587372 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b853a0-9df8-4aa4-b31f-20346983ab34 service neutron] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:19.592602 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9316c7-d0ab-4c46-ad58-2dd1323b7818 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ccebf28ac494f608c33437fc34139be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:19.593692 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9316c7-d0ab-4c46-ad58-2dd1323b7818 service glance] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:19.594171 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9316c7-d0ab-4c46-ad58-2dd1323b7818 service glance] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:19.594689 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9316c7-d0ab-4c46-ad58-2dd1323b7818 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:19.624313 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9316c7-d0ab-4c46-ad58-2dd1323b7818 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:19.625929 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9316c7-d0ab-4c46-ad58-2dd1323b7818 service glance] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:19.651340 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 813/1632] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:19 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:21.361610 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60a717-9b90-4c66-90d3-24bb344a14ec None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:21.362600 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60a717-9b90-4c66-90d3-24bb344a14ec None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:21.362600 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60a717-9b90-4c66-90d3-24bb344a14ec None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:21.364143 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 820/1633] 10.222.0.64 () {54 vars in 912 bytes} [Thu Dec 16 14:39:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:39:21.386082 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e63024-cd2e-43cd-9ead-33a30cb2a226 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:21.387176 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e63024-cd2e-43cd-9ead-33a30cb2a226 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:21.387706 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e63024-cd2e-43cd-9ead-33a30cb2a226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:21.526669 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60a717-9b90-4c66-90d3-24bb344a14ec None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:21.528594 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-0d60a717-9b90-4c66-90d3-24bb344a14ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:21.585989 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-68e63024-cd2e-43cd-9ead-33a30cb2a226 None None] MFA Rules not processed for user `34e25627f3384826b35caf92a804c6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:21.587211 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-68e63024-cd2e-43cd-9ead-33a30cb2a226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:21.590869 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60a717-9b90-4c66-90d3-24bb344a14ec None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:21.608170 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d59c97-244c-4f9d-9aa5-54465b7b1b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:21.617570 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d59c97-244c-4f9d-9aa5-54465b7b1b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:21.617901 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d59c97-244c-4f9d-9aa5-54465b7b1b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:21.621047 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d59c97-244c-4f9d-9aa5-54465b7b1b5b admin admin] PATH_INFO: `/v3/projects/5a786fd41c4a47a5a1d7a4b84ee4d572` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:21.628283 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 814/1634] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Dec 16 14:39:21 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:21.630567 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d59c97-244c-4f9d-9aa5-54465b7b1b5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a786fd41c4a47a5a1d7a4b84ee4d572)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:21.633010 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: WARNING py.warnings [None req-d4d59c97-244c-4f9d-9aa5-54465b7b1b5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:39:21.633010 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: warnings.warn(msg) Dec 16 14:39:21.633010 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: Dec 16 14:39:21.636958 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d59c97-244c-4f9d-9aa5-54465b7b1b5b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:21.662880 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e63024-cd2e-43cd-9ead-33a30cb2a226 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:21.665246 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-68e63024-cd2e-43cd-9ead-33a30cb2a226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:21.681973 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e63024-cd2e-43cd-9ead-33a30cb2a226 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:21.699369 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5c5c0-1c58-4fe0-a23d-aedd522b7409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:21.703187 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5c5c0-1c58-4fe0-a23d-aedd522b7409 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:21.703542 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5c5c0-1c58-4fe0-a23d-aedd522b7409 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:21.703762 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5c5c0-1c58-4fe0-a23d-aedd522b7409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:21.736962 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5c5c0-1c58-4fe0-a23d-aedd522b7409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:21.742823 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5c5c0-1c58-4fe0-a23d-aedd522b7409 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:21.770664 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 815/1635] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:21 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:21.820844 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-d4d59c97-244c-4f9d-9aa5-54465b7b1b5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a786fd41c4a47a5a1d7a4b84ee4d572', 'request_id': 'req-d4d59c97-244c-4f9d-9aa5-54465b7b1b5b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:21.825293 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5c5c0-1c58-4fe0-a23d-aedd522b7409 service neutron] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:21.826751 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-56a5c5c0-1c58-4fe0-a23d-aedd522b7409 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:21.849194 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-d4d59c97-244c-4f9d-9aa5-54465b7b1b5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a786fd41c4a47a5a1d7a4b84ee4d572', 'request_id': 'req-d4d59c97-244c-4f9d-9aa5-54465b7b1b5b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:21.857565 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5c5c0-1c58-4fe0-a23d-aedd522b7409 service neutron] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:21.867843 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-d4d59c97-244c-4f9d-9aa5-54465b7b1b5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a786fd41c4a47a5a1d7a4b84ee4d572', 'request_id': 'req-d4d59c97-244c-4f9d-9aa5-54465b7b1b5b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:21.920277 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-d4d59c97-244c-4f9d-9aa5-54465b7b1b5b admin admin] The token cache is being invalidate because project 5a786fd41c4a47a5a1d7a4b84ee4d572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:21.920616 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-d4d59c97-244c-4f9d-9aa5-54465b7b1b5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:21.921463 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-d4d59c97-244c-4f9d-9aa5-54465b7b1b5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:21.923696 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 821/1636] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:21 2021] DELETE /identity/v3/projects/5a786fd41c4a47a5a1d7a4b84ee4d572 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:39:21.926966 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d59c97-244c-4f9d-9aa5-54465b7b1b5b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:21.928482 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-d4d59c97-244c-4f9d-9aa5-54465b7b1b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:22.018860 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d59c97-244c-4f9d-9aa5-54465b7b1b5b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:22.027088 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3d14d-e5eb-41bb-9673-e7c72af360f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:22.028357 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3d14d-e5eb-41bb-9673-e7c72af360f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:22.028695 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3d14d-e5eb-41bb-9673-e7c72af360f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:22.029111 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3d14d-e5eb-41bb-9673-e7c72af360f1 admin admin] PATH_INFO: `/v3/users/c97d164a91bf477fba79b45df9b4815d` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:22.030526 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3d14d-e5eb-41bb-9673-e7c72af360f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c97d164a91bf477fba79b45df9b4815d)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:22.033568 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3d14d-e5eb-41bb-9673-e7c72af360f1 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:22.069171 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfec393-15df-4722-ae10-c42b026d8d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:22.070980 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfec393-15df-4722-ae10-c42b026d8d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:22.071504 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfec393-15df-4722-ae10-c42b026d8d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:22.072015 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfec393-15df-4722-ae10-c42b026d8d30 admin admin] PATH_INFO: `/v3/users/88b4fd8f81224e489507503f213b80d1` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:22.074799 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfec393-15df-4722-ae10-c42b026d8d30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88b4fd8f81224e489507503f213b80d1)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:22.079074 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfec393-15df-4722-ae10-c42b026d8d30 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:22.103658 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-eae3d14d-e5eb-41bb-9673-e7c72af360f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c97d164a91bf477fba79b45df9b4815d'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:22.104741 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-eae3d14d-e5eb-41bb-9673-e7c72af360f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c97d164a91bf477fba79b45df9b4815d'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:22.131479 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-eae3d14d-e5eb-41bb-9673-e7c72af360f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c97d164a91bf477fba79b45df9b4815d'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:22.142787 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-eae3d14d-e5eb-41bb-9673-e7c72af360f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c97d164a91bf477fba79b45df9b4815d'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:22.155172 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-eae3d14d-e5eb-41bb-9673-e7c72af360f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c97d164a91bf477fba79b45df9b4815d'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:22.168110 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 822/1637] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:21 2021] DELETE /identity/v3/users/c97d164a91bf477fba79b45df9b4815d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:22.177390 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-6dfec393-15df-4722-ae10-c42b026d8d30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88b4fd8f81224e489507503f213b80d1'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:22.178171 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-6dfec393-15df-4722-ae10-c42b026d8d30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88b4fd8f81224e489507503f213b80d1'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:22.193163 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-6dfec393-15df-4722-ae10-c42b026d8d30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88b4fd8f81224e489507503f213b80d1'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:22.203970 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-6dfec393-15df-4722-ae10-c42b026d8d30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88b4fd8f81224e489507503f213b80d1'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:22.216090 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-6dfec393-15df-4722-ae10-c42b026d8d30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88b4fd8f81224e489507503f213b80d1'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:22.223849 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 816/1638] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:21 2021] DELETE /identity/v3/users/88b4fd8f81224e489507503f213b80d1 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:39:22.228695 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9a429-6e6b-4a7b-b5d3-7da9de03510b None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:22.229168 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9a429-6e6b-4a7b-b5d3-7da9de03510b None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:22.229532 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9a429-6e6b-4a7b-b5d3-7da9de03510b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:22.256322 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-77f9a429-6e6b-4a7b-b5d3-7da9de03510b None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:22.257657 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-77f9a429-6e6b-4a7b-b5d3-7da9de03510b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:22.269516 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfec393-15df-4722-ae10-c42b026d8d30 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:22.272160 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-6dfec393-15df-4722-ae10-c42b026d8d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:22.429302 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfec393-15df-4722-ae10-c42b026d8d30 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:22.442110 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4bb33-ad25-4807-939d-a031ede3361c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:22.443192 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4bb33-ad25-4807-939d-a031ede3361c admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:22.443795 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4bb33-ad25-4807-939d-a031ede3361c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:22.444288 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4bb33-ad25-4807-939d-a031ede3361c admin admin] PATH_INFO: `/v3/projects/ad86e0e40b274e87ab64017d0cfef538` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:22.449407 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4bb33-ad25-4807-939d-a031ede3361c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad86e0e40b274e87ab64017d0cfef538)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:22.452042 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4bb33-ad25-4807-939d-a031ede3361c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:22.456483 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 823/1639] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:22.540569 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-02f4bb33-ad25-4807-939d-a031ede3361c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad86e0e40b274e87ab64017d0cfef538', 'request_id': 'req-02f4bb33-ad25-4807-939d-a031ede3361c'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:22.564222 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-02f4bb33-ad25-4807-939d-a031ede3361c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad86e0e40b274e87ab64017d0cfef538', 'request_id': 'req-02f4bb33-ad25-4807-939d-a031ede3361c'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:22.577435 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-02f4bb33-ad25-4807-939d-a031ede3361c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad86e0e40b274e87ab64017d0cfef538', 'request_id': 'req-02f4bb33-ad25-4807-939d-a031ede3361c'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:22.599377 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-02f4bb33-ad25-4807-939d-a031ede3361c admin admin] The token cache is being invalidate because project ad86e0e40b274e87ab64017d0cfef538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:22.599745 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-02f4bb33-ad25-4807-939d-a031ede3361c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:22.600621 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-02f4bb33-ad25-4807-939d-a031ede3361c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:22.604858 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 817/1640] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:22 2021] DELETE /identity/v3/projects/ad86e0e40b274e87ab64017d0cfef538 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:22.605043 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9a429-6e6b-4a7b-b5d3-7da9de03510b None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:22.605043 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-77f9a429-6e6b-4a7b-b5d3-7da9de03510b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:22.607065 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4bb33-ad25-4807-939d-a031ede3361c admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:22.609964 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-02f4bb33-ad25-4807-939d-a031ede3361c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:22.838917 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9a429-6e6b-4a7b-b5d3-7da9de03510b None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:22.840623 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4bb33-ad25-4807-939d-a031ede3361c admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:22.867664 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28979b63-639d-4df3-9d91-89f4e70c57de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:22.868587 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28979b63-639d-4df3-9d91-89f4e70c57de admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:22.868901 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28979b63-639d-4df3-9d91-89f4e70c57de admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:22.869187 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28979b63-639d-4df3-9d91-89f4e70c57de admin admin] PATH_INFO: `/v3/users/d8fac945f56a4b0a9da5db88283201fd` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:22.872467 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28979b63-639d-4df3-9d91-89f4e70c57de admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8fac945f56a4b0a9da5db88283201fd)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:22.874446 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28979b63-639d-4df3-9d91-89f4e70c57de admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:22.997383 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5773c3e-3038-46d5-990e-ad5216add6f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:22.998406 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5773c3e-3038-46d5-990e-ad5216add6f3 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:23.000173 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5773c3e-3038-46d5-990e-ad5216add6f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:23.000701 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5773c3e-3038-46d5-990e-ad5216add6f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:23.005510 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-d5773c3e-3038-46d5-990e-ad5216add6f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:23.019927 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-28979b63-639d-4df3-9d91-89f4e70c57de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8fac945f56a4b0a9da5db88283201fd'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:23.023230 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-28979b63-639d-4df3-9d91-89f4e70c57de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8fac945f56a4b0a9da5db88283201fd'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:23.035118 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5773c3e-3038-46d5-990e-ad5216add6f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:23.037297 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5773c3e-3038-46d5-990e-ad5216add6f3 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:23.049094 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-28979b63-639d-4df3-9d91-89f4e70c57de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8fac945f56a4b0a9da5db88283201fd'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:23.064182 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-28979b63-639d-4df3-9d91-89f4e70c57de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8fac945f56a4b0a9da5db88283201fd'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:23.095642 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 824/1641] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:22 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:23.096220 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-28979b63-639d-4df3-9d91-89f4e70c57de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8fac945f56a4b0a9da5db88283201fd'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:23.097428 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a471ed-f7eb-45db-9111-3d6c9a30fe12 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:23.105256 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a471ed-f7eb-45db-9111-3d6c9a30fe12 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:23.105676 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a471ed-f7eb-45db-9111-3d6c9a30fe12 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:23.106835 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 818/1642] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:22 2021] DELETE /identity/v3/users/d8fac945f56a4b0a9da5db88283201fd => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:23.118477 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c3867-d879-4268-9b9b-af376318e02b None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:23.119241 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c3867-d879-4268-9b9b-af376318e02b None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:23.119415 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 825/1643] 10.222.0.64 () {54 vars in 960 bytes} [Thu Dec 16 14:39:23 2021] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:39:23.119971 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c3867-d879-4268-9b9b-af376318e02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:23.168149 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-586c3867-d879-4268-9b9b-af376318e02b None None] MFA Rules not processed for user `0e9a2114d29c4edeb20f394140d390bb`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:23.169708 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-586c3867-d879-4268-9b9b-af376318e02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:23.338439 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 819/1644] 10.222.0.64 () {58 vars in 1057 bytes} [Thu Dec 16 14:39:23 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:23.357121 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a471ed-f7eb-45db-9111-3d6c9a30fe12 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:23.381632 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a471ed-f7eb-45db-9111-3d6c9a30fe12 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:23.396199 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f05a1-c414-44bd-a133-4fcc38060249 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9a2114d29c4edeb20f394140d390bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:23.397644 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f05a1-c414-44bd-a133-4fcc38060249 service placement] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:23.398018 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f05a1-c414-44bd-a133-4fcc38060249 service placement] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:23.398540 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f05a1-c414-44bd-a133-4fcc38060249 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:23.403585 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e50f05a1-c414-44bd-a133-4fcc38060249 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:23.428263 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f05a1-c414-44bd-a133-4fcc38060249 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:23.431708 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f05a1-c414-44bd-a133-4fcc38060249 service placement] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:23.459340 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 826/1645] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:23 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:23.848694 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c3867-d879-4268-9b9b-af376318e02b None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:23.850347 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-586c3867-d879-4268-9b9b-af376318e02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:23.874738 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c3867-d879-4268-9b9b-af376318e02b None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:23.891443 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d13070-31d5-4119-b2f0-1fbcb9711ff1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9a2114d29c4edeb20f394140d390bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:23.892056 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d13070-31d5-4119-b2f0-1fbcb9711ff1 service placement] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:23.892346 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d13070-31d5-4119-b2f0-1fbcb9711ff1 service placement] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:23.892629 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d13070-31d5-4119-b2f0-1fbcb9711ff1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:23.900407 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-33d13070-31d5-4119-b2f0-1fbcb9711ff1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:23.930117 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d13070-31d5-4119-b2f0-1fbcb9711ff1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:23.932064 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d13070-31d5-4119-b2f0-1fbcb9711ff1 service placement] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:23.947189 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 820/1646] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:23 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:24.196410 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f05a1-c414-44bd-a133-4fcc38060249 service placement] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:24.199168 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e50f05a1-c414-44bd-a133-4fcc38060249 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:24.229590 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d13070-31d5-4119-b2f0-1fbcb9711ff1 service placement] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:24.231867 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-33d13070-31d5-4119-b2f0-1fbcb9711ff1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:24.385739 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d13070-31d5-4119-b2f0-1fbcb9711ff1 service placement] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:24.395768 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8314b-5a21-43fe-9635-8284dfd22ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:24.396816 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8314b-5a21-43fe-9635-8284dfd22ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:24.397157 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8314b-5a21-43fe-9635-8284dfd22ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:24.397444 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8314b-5a21-43fe-9635-8284dfd22ff6 admin admin] PATH_INFO: `/v3/users/383fca1615944dee97b5fab5f3c6c2eb` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:24.398885 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8314b-5a21-43fe-9635-8284dfd22ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=383fca1615944dee97b5fab5f3c6c2eb)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:24.401611 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8314b-5a21-43fe-9635-8284dfd22ff6 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:24.416670 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f05a1-c414-44bd-a133-4fcc38060249 service placement] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:24.425639 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62102a-f85a-42df-b16a-616db5518eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:24.427909 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62102a-f85a-42df-b16a-616db5518eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:24.428756 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62102a-f85a-42df-b16a-616db5518eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:24.429941 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62102a-f85a-42df-b16a-616db5518eb5 admin admin] PATH_INFO: `/v3/projects/f2426559b48445779bd47b88e3d34c6b` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:24.432760 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62102a-f85a-42df-b16a-616db5518eb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2426559b48445779bd47b88e3d34c6b)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:24.437447 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62102a-f85a-42df-b16a-616db5518eb5 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:24.505703 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-1bd8314b-5a21-43fe-9635-8284dfd22ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '383fca1615944dee97b5fab5f3c6c2eb'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:24.507353 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-1bd8314b-5a21-43fe-9635-8284dfd22ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '383fca1615944dee97b5fab5f3c6c2eb'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:24.538277 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-1bd8314b-5a21-43fe-9635-8284dfd22ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '383fca1615944dee97b5fab5f3c6c2eb'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:24.551314 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-1bd8314b-5a21-43fe-9635-8284dfd22ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '383fca1615944dee97b5fab5f3c6c2eb'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:24.591615 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-1bd8314b-5a21-43fe-9635-8284dfd22ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '383fca1615944dee97b5fab5f3c6c2eb'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:24.617809 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 821/1647] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:24 2021] DELETE /identity/v3/users/383fca1615944dee97b5fab5f3c6c2eb => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:24.619193 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8314b-5a21-43fe-9635-8284dfd22ff6 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:24.622961 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-1bd8314b-5a21-43fe-9635-8284dfd22ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:24.760591 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-8f62102a-f85a-42df-b16a-616db5518eb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2426559b48445779bd47b88e3d34c6b', 'request_id': 'req-8f62102a-f85a-42df-b16a-616db5518eb5'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:24.776620 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-8f62102a-f85a-42df-b16a-616db5518eb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2426559b48445779bd47b88e3d34c6b', 'request_id': 'req-8f62102a-f85a-42df-b16a-616db5518eb5'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:24.789087 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-8f62102a-f85a-42df-b16a-616db5518eb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2426559b48445779bd47b88e3d34c6b', 'request_id': 'req-8f62102a-f85a-42df-b16a-616db5518eb5'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:24.810203 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-8f62102a-f85a-42df-b16a-616db5518eb5 admin admin] The token cache is being invalidate because project f2426559b48445779bd47b88e3d34c6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:24.810488 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-8f62102a-f85a-42df-b16a-616db5518eb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:24.811121 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-8f62102a-f85a-42df-b16a-616db5518eb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:24.812714 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 827/1648] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:24 2021] DELETE /identity/v3/projects/f2426559b48445779bd47b88e3d34c6b => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:24.818384 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c950e-ddc5-4880-a2f5-786d524698c9 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:24.818681 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c950e-ddc5-4880-a2f5-786d524698c9 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:24.818970 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c950e-ddc5-4880-a2f5-786d524698c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:24.858655 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8314b-5a21-43fe-9635-8284dfd22ff6 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:24.870607 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-ff4c950e-ddc5-4880-a2f5-786d524698c9 None None] MFA Rules not processed for user `4166133ac04844d491662feab2bd2d21`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:24.872398 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-ff4c950e-ddc5-4880-a2f5-786d524698c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:24.980500 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 828/1649] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:24 2021] POST /identity/v3/auth/tokens => generated 3700 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:24.984618 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7d0e0-a3dc-4cc0-87df-22bd644e14d8 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:24.985319 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7d0e0-a3dc-4cc0-87df-22bd644e14d8 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:24.986045 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7d0e0-a3dc-4cc0-87df-22bd644e14d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:25.054424 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-a1b7d0e0-a3dc-4cc0-87df-22bd644e14d8 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:25.055306 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-a1b7d0e0-a3dc-4cc0-87df-22bd644e14d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:25.118915 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9b0da-9203-4b8a-889b-e5cd7458525b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:25.119533 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9b0da-9203-4b8a-889b-e5cd7458525b service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:25.119827 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9b0da-9203-4b8a-889b-e5cd7458525b service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:25.120112 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9b0da-9203-4b8a-889b-e5cd7458525b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:25.123768 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-b2f9b0da-9203-4b8a-889b-e5cd7458525b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:25.225285 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 829/1650] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:25.229519 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa66dc-815c-4bfd-b583-27b625e3bbde None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:25.232152 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa66dc-815c-4bfd-b583-27b625e3bbde None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:25.233392 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa66dc-815c-4bfd-b583-27b625e3bbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:25.284303 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-bafa66dc-815c-4bfd-b583-27b625e3bbde None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:25.286083 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-bafa66dc-815c-4bfd-b583-27b625e3bbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:25.287452 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9b0da-9203-4b8a-889b-e5cd7458525b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:25.294468 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9b0da-9203-4b8a-889b-e5cd7458525b service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:25.301549 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 830/1651] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:25.304769 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdc917-fd97-4650-bae3-8aa3244dfa01 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:25.305845 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdc917-fd97-4650-bae3-8aa3244dfa01 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:25.306547 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdc917-fd97-4650-bae3-8aa3244dfa01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:25.319335 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 822/1652] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:24 2021] GET /identity/v3/auth/tokens => generated 3751 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:25.332267 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9b0da-9203-4b8a-889b-e5cd7458525b service cinder] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:25.335320 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-b2f9b0da-9203-4b8a-889b-e5cd7458525b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:25.394464 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-1acdc917-fd97-4650-bae3-8aa3244dfa01 None None] MFA Rules not processed for user `4166133ac04844d491662feab2bd2d21`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:25.396069 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-1acdc917-fd97-4650-bae3-8aa3244dfa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:25.404032 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 831/1653] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:25 2021] POST /identity/v3/auth/tokens => generated 3700 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:25.422529 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24f4fe-243a-49df-ab2b-50a66d10279a None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:25.422831 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24f4fe-243a-49df-ab2b-50a66d10279a None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:25.425277 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24f4fe-243a-49df-ab2b-50a66d10279a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:25.477084 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-5e24f4fe-243a-49df-ab2b-50a66d10279a None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:25.478555 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-5e24f4fe-243a-49df-ab2b-50a66d10279a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:25.486075 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9b0da-9203-4b8a-889b-e5cd7458525b service cinder] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:25.492258 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7b1c9-5216-46de-afd0-5278d7ffb25f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:25.492929 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7b1c9-5216-46de-afd0-5278d7ffb25f service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:25.493335 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7b1c9-5216-46de-afd0-5278d7ffb25f service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:25.493925 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7b1c9-5216-46de-afd0-5278d7ffb25f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:25.500769 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 832/1654] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:25.502042 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24f4fe-243a-49df-ab2b-50a66d10279a None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:25.503636 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-5e24f4fe-243a-49df-ab2b-50a66d10279a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:25.523457 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7b1c9-5216-46de-afd0-5278d7ffb25f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:25.525218 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7b1c9-5216-46de-afd0-5278d7ffb25f service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:25.560070 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 823/1655] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:25 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:25.562031 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7b1c9-5216-46de-afd0-5278d7ffb25f service neutron] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:25.583139 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7b1c9-5216-46de-afd0-5278d7ffb25f service neutron] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:25.597334 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1da11f-12c9-4882-8b5b-aaf7e16bdd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:25.598867 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1da11f-12c9-4882-8b5b-aaf7e16bdd0d admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:25.599152 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1da11f-12c9-4882-8b5b-aaf7e16bdd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:25.601077 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1da11f-12c9-4882-8b5b-aaf7e16bdd0d admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:25.601961 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1da11f-12c9-4882-8b5b-aaf7e16bdd0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:39:25.602271 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1da11f-12c9-4882-8b5b-aaf7e16bdd0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:25.609328 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1da11f-12c9-4882-8b5b-aaf7e16bdd0d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:25.641776 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 824/1656] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:39:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:39:25.645162 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1da11f-12c9-4882-8b5b-aaf7e16bdd0d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:25.665735 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1da11f-12c9-4882-8b5b-aaf7e16bdd0d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:25.695185 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3dab2-3274-4aa2-b3e3-0df4f9783717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:25.695935 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3dab2-3274-4aa2-b3e3-0df4f9783717 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:25.696251 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3dab2-3274-4aa2-b3e3-0df4f9783717 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:25.696540 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3dab2-3274-4aa2-b3e3-0df4f9783717 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:25.697332 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3dab2-3274-4aa2-b3e3-0df4f9783717 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:25.710076 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3dab2-3274-4aa2-b3e3-0df4f9783717 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:25.727072 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24f4fe-243a-49df-ab2b-50a66d10279a None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:25.745221 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c51c22-d05e-4797-85bb-d2add2605d48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:25.745866 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c51c22-d05e-4797-85bb-d2add2605d48 service nova] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:25.746341 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c51c22-d05e-4797-85bb-d2add2605d48 service nova] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:25.746471 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c51c22-d05e-4797-85bb-d2add2605d48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:25.766279 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c51c22-d05e-4797-85bb-d2add2605d48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:25.768360 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c51c22-d05e-4797-85bb-d2add2605d48 service nova] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:25.772255 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 825/1657] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:25 2021] POST /identity/v3/projects => generated 355 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:25.778228 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3dab2-3274-4aa2-b3e3-0df4f9783717 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:25.799206 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 833/1658] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:25 2021] GET /identity/v3/auth/tokens => generated 3700 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:26.029820 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3dab2-3274-4aa2-b3e3-0df4f9783717 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:26.054221 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7596952-02a0-45af-88a8-3a70c648580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:26.054850 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7596952-02a0-45af-88a8-3a70c648580d admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:26.055148 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7596952-02a0-45af-88a8-3a70c648580d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:26.055440 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7596952-02a0-45af-88a8-3a70c648580d admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:26.056114 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7596952-02a0-45af-88a8-3a70c648580d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:26.058108 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7596952-02a0-45af-88a8-3a70c648580d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:26.112119 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 826/1659] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:25 2021] POST /identity/v3/users => generated 278 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:26.113488 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c51c22-d05e-4797-85bb-d2add2605d48 service nova] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:26.128485 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c51c22-d05e-4797-85bb-d2add2605d48 service nova] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:26.142308 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925f419-b964-40c6-afd2-8068f0b12c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:26.143128 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925f419-b964-40c6-afd2-8068f0b12c05 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:26.143509 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925f419-b964-40c6-afd2-8068f0b12c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:26.143704 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925f419-b964-40c6-afd2-8068f0b12c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:26.144422 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925f419-b964-40c6-afd2-8068f0b12c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:26.146110 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925f419-b964-40c6-afd2-8068f0b12c05 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:26.173730 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7596952-02a0-45af-88a8-3a70c648580d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:26.175640 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-a7596952-02a0-45af-88a8-3a70c648580d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:26.189763 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 834/1660] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:26 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:26.192719 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925f419-b964-40c6-afd2-8068f0b12c05 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:26.207073 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7596952-02a0-45af-88a8-3a70c648580d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:26.229553 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259535e0-6451-4053-bb0c-49e022fe8cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:26.230450 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259535e0-6451-4053-bb0c-49e022fe8cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:26.230747 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259535e0-6451-4053-bb0c-49e022fe8cda admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:26.231041 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259535e0-6451-4053-bb0c-49e022fe8cda admin admin] PATH_INFO: `/v3/projects/8c614704dc5a42dbb79b9df13eb2460c` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:26.231786 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925f419-b964-40c6-afd2-8068f0b12c05 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:26.233292 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259535e0-6451-4053-bb0c-49e022fe8cda admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c614704dc5a42dbb79b9df13eb2460c)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:26.240279 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259535e0-6451-4053-bb0c-49e022fe8cda admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:26.249775 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3db16-2df5-438a-8c39-3455ed515515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:26.250402 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3db16-2df5-438a-8c39-3455ed515515 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:26.250698 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3db16-2df5-438a-8c39-3455ed515515 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:26.251053 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3db16-2df5-438a-8c39-3455ed515515 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:26.251772 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3db16-2df5-438a-8c39-3455ed515515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:26.253483 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3db16-2df5-438a-8c39-3455ed515515 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:26.280361 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 835/1661] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:26 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:26.281350 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3db16-2df5-438a-8c39-3455ed515515 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:26.289424 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-05d3db16-2df5-438a-8c39-3455ed515515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:26.334843 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3db16-2df5-438a-8c39-3455ed515515 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:26.358074 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190f9ed-6d13-4ec5-b967-57dbefd8af85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:26.358916 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190f9ed-6d13-4ec5-b967-57dbefd8af85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:26.359215 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190f9ed-6d13-4ec5-b967-57dbefd8af85 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:26.359506 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190f9ed-6d13-4ec5-b967-57dbefd8af85 admin admin] PATH_INFO: `/v3/projects/f8788e65564f4cb08f1c828b1b947597` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:26.361792 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190f9ed-6d13-4ec5-b967-57dbefd8af85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8788e65564f4cb08f1c828b1b947597)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:26.363792 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190f9ed-6d13-4ec5-b967-57dbefd8af85 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:26.404743 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-259535e0-6451-4053-bb0c-49e022fe8cda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c614704dc5a42dbb79b9df13eb2460c', 'request_id': 'req-259535e0-6451-4053-bb0c-49e022fe8cda'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:26.439202 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-259535e0-6451-4053-bb0c-49e022fe8cda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c614704dc5a42dbb79b9df13eb2460c', 'request_id': 'req-259535e0-6451-4053-bb0c-49e022fe8cda'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:26.471703 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-259535e0-6451-4053-bb0c-49e022fe8cda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c614704dc5a42dbb79b9df13eb2460c', 'request_id': 'req-259535e0-6451-4053-bb0c-49e022fe8cda'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:26.513893 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-259535e0-6451-4053-bb0c-49e022fe8cda admin admin] The token cache is being invalidate because project 8c614704dc5a42dbb79b9df13eb2460c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:26.516438 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-259535e0-6451-4053-bb0c-49e022fe8cda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:26.518972 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-259535e0-6451-4053-bb0c-49e022fe8cda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:26.527379 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 827/1662] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:26 2021] DELETE /identity/v3/projects/8c614704dc5a42dbb79b9df13eb2460c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:26.529545 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259535e0-6451-4053-bb0c-49e022fe8cda admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:26.534271 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-259535e0-6451-4053-bb0c-49e022fe8cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:26.549540 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-2190f9ed-6d13-4ec5-b967-57dbefd8af85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8788e65564f4cb08f1c828b1b947597', 'request_id': 'req-2190f9ed-6d13-4ec5-b967-57dbefd8af85'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:26.564057 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-2190f9ed-6d13-4ec5-b967-57dbefd8af85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8788e65564f4cb08f1c828b1b947597', 'request_id': 'req-2190f9ed-6d13-4ec5-b967-57dbefd8af85'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:26.576606 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-2190f9ed-6d13-4ec5-b967-57dbefd8af85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8788e65564f4cb08f1c828b1b947597', 'request_id': 'req-2190f9ed-6d13-4ec5-b967-57dbefd8af85'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:26.608435 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-2190f9ed-6d13-4ec5-b967-57dbefd8af85 admin admin] The token cache is being invalidate because project f8788e65564f4cb08f1c828b1b947597 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:26.608996 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-2190f9ed-6d13-4ec5-b967-57dbefd8af85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:26.611142 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-2190f9ed-6d13-4ec5-b967-57dbefd8af85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:26.614362 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 836/1663] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:26 2021] DELETE /identity/v3/projects/f8788e65564f4cb08f1c828b1b947597 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:26.618814 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190f9ed-6d13-4ec5-b967-57dbefd8af85 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:26.620765 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-2190f9ed-6d13-4ec5-b967-57dbefd8af85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:26.697429 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259535e0-6451-4053-bb0c-49e022fe8cda admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:26.795559 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190f9ed-6d13-4ec5-b967-57dbefd8af85 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:26.807641 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f21e4-a5d4-4c9f-8efe-1244bf2d35df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:26.809742 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f21e4-a5d4-4c9f-8efe-1244bf2d35df admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:26.810071 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f21e4-a5d4-4c9f-8efe-1244bf2d35df admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:26.810366 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f21e4-a5d4-4c9f-8efe-1244bf2d35df admin admin] PATH_INFO: `/v3/users/142023598c53476e9afa773db40dab8e` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:26.813099 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f21e4-a5d4-4c9f-8efe-1244bf2d35df admin admin] RBAC: Authorizing `identity:delete_user(user_id=142023598c53476e9afa773db40dab8e)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:26.817468 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f21e4-a5d4-4c9f-8efe-1244bf2d35df admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:26.856134 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d556ff-768b-4a01-b7e4-d985c8a26fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:26.857177 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d556ff-768b-4a01-b7e4-d985c8a26fb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:26.857472 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d556ff-768b-4a01-b7e4-d985c8a26fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:26.857761 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d556ff-768b-4a01-b7e4-d985c8a26fb1 admin admin] PATH_INFO: `/v3/projects/34c82c7bffc34edcb45ea448ef76b027/users/ef4d60cf2c664439a90c7834e7357ed4/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:26.905920 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d556ff-768b-4a01-b7e4-d985c8a26fb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34c82c7bffc34edcb45ea448ef76b027, user_id=ef4d60cf2c664439a90c7834e7357ed4, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:26.914160 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d556ff-768b-4a01-b7e4-d985c8a26fb1 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:26.921527 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-846f21e4-a5d4-4c9f-8efe-1244bf2d35df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '142023598c53476e9afa773db40dab8e'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:26.922717 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-846f21e4-a5d4-4c9f-8efe-1244bf2d35df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '142023598c53476e9afa773db40dab8e'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:26.944958 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 828/1664] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:26 2021] PUT /identity/v3/projects/34c82c7bffc34edcb45ea448ef76b027/users/ef4d60cf2c664439a90c7834e7357ed4/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:26.946630 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68fa32-f1c9-4d7f-8b13-ea6abe71bc1f None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:26.949901 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68fa32-f1c9-4d7f-8b13-ea6abe71bc1f None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:26.950367 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68fa32-f1c9-4d7f-8b13-ea6abe71bc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:26.955440 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-846f21e4-a5d4-4c9f-8efe-1244bf2d35df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '142023598c53476e9afa773db40dab8e'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:26.977215 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-846f21e4-a5d4-4c9f-8efe-1244bf2d35df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '142023598c53476e9afa773db40dab8e'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:26.997620 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-846f21e4-a5d4-4c9f-8efe-1244bf2d35df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '142023598c53476e9afa773db40dab8e'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:27.013327 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-9a68fa32-f1c9-4d7f-8b13-ea6abe71bc1f None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:27.014523 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-9a68fa32-f1c9-4d7f-8b13-ea6abe71bc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:27.018347 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 837/1665] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:26 2021] DELETE /identity/v3/users/142023598c53476e9afa773db40dab8e => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:27.020223 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83af29-17ca-4512-a9d4-25a281ee07a9 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:27.020530 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83af29-17ca-4512-a9d4-25a281ee07a9 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:27.020845 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83af29-17ca-4512-a9d4-25a281ee07a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:27.114191 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-fb83af29-17ca-4512-a9d4-25a281ee07a9 None None] MFA Rules not processed for user `ef4d60cf2c664439a90c7834e7357ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:27.119713 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-fb83af29-17ca-4512-a9d4-25a281ee07a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:27.200835 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 829/1666] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:27.255942 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 838/1667] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:27 2021] POST /identity/v3/auth/tokens => generated 3662 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:27.258880 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68fa32-f1c9-4d7f-8b13-ea6abe71bc1f None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:27.263523 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-9a68fa32-f1c9-4d7f-8b13-ea6abe71bc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:27.267001 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c92ce-a898-4c3f-80d9-2e60bd4242e9 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:27.267251 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c92ce-a898-4c3f-80d9-2e60bd4242e9 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:27.267541 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c92ce-a898-4c3f-80d9-2e60bd4242e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:27.300392 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68fa32-f1c9-4d7f-8b13-ea6abe71bc1f None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:27.315673 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fc94f-866e-4429-8f09-33ce5f5c0556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:27.318533 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fc94f-866e-4429-8f09-33ce5f5c0556 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:27.318842 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fc94f-866e-4429-8f09-33ce5f5c0556 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:27.319132 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fc94f-866e-4429-8f09-33ce5f5c0556 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:27.322947 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1fc94f-866e-4429-8f09-33ce5f5c0556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:27.331084 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1fc94f-866e-4429-8f09-33ce5f5c0556 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:27.343040 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-b06c92ce-a898-4c3f-80d9-2e60bd4242e9 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:27.347687 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-b06c92ce-a898-4c3f-80d9-2e60bd4242e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:27.373855 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 839/1668] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:27.383095 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c92ce-a898-4c3f-80d9-2e60bd4242e9 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:27.396736 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c92ce-a898-4c3f-80d9-2e60bd4242e9 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:27.403508 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 830/1669] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:27 2021] POST /identity/v3/projects => generated 357 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:27.403859 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f62c5-da48-40af-a468-464af9b26126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:27.404646 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f62c5-da48-40af-a468-464af9b26126 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:27.405030 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f62c5-da48-40af-a468-464af9b26126 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:27.405598 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f62c5-da48-40af-a468-464af9b26126 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:27.406495 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f62c5-da48-40af-a468-464af9b26126 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:39:27.406928 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f62c5-da48-40af-a468-464af9b26126 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:27.407464 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fc94f-866e-4429-8f09-33ce5f5c0556 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:27.410123 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f62c5-da48-40af-a468-464af9b26126 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:27.438985 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 840/1670] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:39:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:39:27.440417 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f62c5-da48-40af-a468-464af9b26126 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:27.460481 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f62c5-da48-40af-a468-464af9b26126 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:27.613426 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fc94f-866e-4429-8f09-33ce5f5c0556 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:27.647514 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925222be-cd39-4975-86c9-221917ff1eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:27.655689 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925222be-cd39-4975-86c9-221917ff1eab admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:27.656219 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925222be-cd39-4975-86c9-221917ff1eab admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:27.656522 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925222be-cd39-4975-86c9-221917ff1eab admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:27.657505 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925222be-cd39-4975-86c9-221917ff1eab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:27.660701 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925222be-cd39-4975-86c9-221917ff1eab admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:27.683640 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4d57f-faec-4024-80e4-486166b85ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:27.684370 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4d57f-faec-4024-80e4-486166b85ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:27.684688 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4d57f-faec-4024-80e4-486166b85ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:27.684977 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4d57f-faec-4024-80e4-486166b85ef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:27.685646 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4d57f-faec-4024-80e4-486166b85ef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:27.687588 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4d57f-faec-4024-80e4-486166b85ef6 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:27.698091 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 831/1671] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:27 2021] POST /identity/v3/users => generated 285 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:27.708092 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925222be-cd39-4975-86c9-221917ff1eab admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:27.721875 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925222be-cd39-4975-86c9-221917ff1eab admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:27.764225 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36613ad-b03a-4893-8221-d4eaef0d5746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:27.764970 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36613ad-b03a-4893-8221-d4eaef0d5746 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:27.772925 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36613ad-b03a-4893-8221-d4eaef0d5746 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:27.773742 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36613ad-b03a-4893-8221-d4eaef0d5746 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:27.775858 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36613ad-b03a-4893-8221-d4eaef0d5746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:27.779787 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36613ad-b03a-4893-8221-d4eaef0d5746 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:27.791143 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 841/1672] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:27 2021] POST /identity/v3/projects => generated 365 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:27.800142 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4d57f-faec-4024-80e4-486166b85ef6 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:27.802898 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 832/1673] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:27 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:27.809831 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36613ad-b03a-4893-8221-d4eaef0d5746 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:27.859369 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36613ad-b03a-4893-8221-d4eaef0d5746 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:27.925501 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4d57f-faec-4024-80e4-486166b85ef6 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:27.937930 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75a3f0-6664-447e-996c-61344fc705fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:27.940934 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75a3f0-6664-447e-996c-61344fc705fa admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:27.942524 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75a3f0-6664-447e-996c-61344fc705fa admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:27.943170 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75a3f0-6664-447e-996c-61344fc705fa admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:27.944409 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75a3f0-6664-447e-996c-61344fc705fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:27.951589 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75a3f0-6664-447e-996c-61344fc705fa admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:28.015876 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 842/1674] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:27 2021] POST /identity/v3/users => generated 283 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:28.018421 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75a3f0-6664-447e-996c-61344fc705fa admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:28.035698 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f1574-b35b-4895-be2a-931f3eaabd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:28.037069 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f1574-b35b-4895-be2a-931f3eaabd54 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:28.037556 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f1574-b35b-4895-be2a-931f3eaabd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:28.038192 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f1574-b35b-4895-be2a-931f3eaabd54 admin admin] PATH_INFO: `/v3/projects/a4296a23cc6f43ab835ed853c3fc1565/users/03900d87ad374237a7ba23019f0167d6/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:28.058105 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75a3f0-6664-447e-996c-61344fc705fa admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:28.072500 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ab2eb-05a7-4ed8-b5c2-84a9b31d3e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:28.075290 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ab2eb-05a7-4ed8-b5c2-84a9b31d3e48 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:28.075290 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ab2eb-05a7-4ed8-b5c2-84a9b31d3e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:28.075290 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ab2eb-05a7-4ed8-b5c2-84a9b31d3e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:28.077424 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ab2eb-05a7-4ed8-b5c2-84a9b31d3e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:28.077595 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f1574-b35b-4895-be2a-931f3eaabd54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4296a23cc6f43ab835ed853c3fc1565, user_id=03900d87ad374237a7ba23019f0167d6, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:28.080412 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ab2eb-05a7-4ed8-b5c2-84a9b31d3e48 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:28.080826 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f1574-b35b-4895-be2a-931f3eaabd54 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:28.114086 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 843/1675] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:28 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:28.115431 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ab2eb-05a7-4ed8-b5c2-84a9b31d3e48 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:28.116176 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 833/1676] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:27 2021] PUT /identity/v3/projects/a4296a23cc6f43ab835ed853c3fc1565/users/03900d87ad374237a7ba23019f0167d6/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:28.121392 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f1574-b35b-4895-be2a-931f3eaabd54 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:28.138599 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ab2eb-05a7-4ed8-b5c2-84a9b31d3e48 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:28.267136 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f1574-b35b-4895-be2a-931f3eaabd54 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:28.267755 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c69a19-d3f1-4221-ab66-4a698e4a723e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:28.268266 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c69a19-d3f1-4221-ab66-4a698e4a723e admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:28.268622 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c69a19-d3f1-4221-ab66-4a698e4a723e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:28.269145 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c69a19-d3f1-4221-ab66-4a698e4a723e admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:28.270030 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c69a19-d3f1-4221-ab66-4a698e4a723e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:28.271743 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c69a19-d3f1-4221-ab66-4a698e4a723e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:28.273828 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b4a25-8b81-40e3-9c49-41e1df395dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:28.275000 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b4a25-8b81-40e3-9c49-41e1df395dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:28.275461 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b4a25-8b81-40e3-9c49-41e1df395dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:28.275913 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b4a25-8b81-40e3-9c49-41e1df395dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:28.277150 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b4a25-8b81-40e3-9c49-41e1df395dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:28.279029 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b4a25-8b81-40e3-9c49-41e1df395dc3 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:28.288206 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 844/1677] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:28 2021] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:28.290177 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c69a19-d3f1-4221-ab66-4a698e4a723e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:28.302459 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 834/1678] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:28 2021] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:28.305062 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c69a19-d3f1-4221-ab66-4a698e4a723e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:28.309703 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b4a25-8b81-40e3-9c49-41e1df395dc3 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:28.311771 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ae3b4-d6ee-483e-b6aa-abff9503f2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:28.312711 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ae3b4-d6ee-483e-b6aa-abff9503f2d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:28.315455 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ae3b4-d6ee-483e-b6aa-abff9503f2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:28.315914 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ae3b4-d6ee-483e-b6aa-abff9503f2d6 admin admin] PATH_INFO: `/v3/projects/60ae8c809a84419a98f50f025d3434ca/users/5886011f543448899f15c132f7309ade/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:28.340865 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b4a25-8b81-40e3-9c49-41e1df395dc3 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:28.370909 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf5aca-86ad-4067-9d76-5eeb86adda61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:28.372084 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf5aca-86ad-4067-9d76-5eeb86adda61 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:28.372534 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf5aca-86ad-4067-9d76-5eeb86adda61 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:28.372996 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf5aca-86ad-4067-9d76-5eeb86adda61 admin admin] PATH_INFO: `/v3/projects/a4296a23cc6f43ab835ed853c3fc1565/users/03900d87ad374237a7ba23019f0167d6/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:28.377008 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf5aca-86ad-4067-9d76-5eeb86adda61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4296a23cc6f43ab835ed853c3fc1565, user_id=03900d87ad374237a7ba23019f0167d6, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:28.381390 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ae3b4-d6ee-483e-b6aa-abff9503f2d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ae8c809a84419a98f50f025d3434ca, user_id=5886011f543448899f15c132f7309ade, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:28.382731 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf5aca-86ad-4067-9d76-5eeb86adda61 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:28.428929 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ae3b4-d6ee-483e-b6aa-abff9503f2d6 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:28.455363 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 835/1679] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:28 2021] PUT /identity/v3/projects/a4296a23cc6f43ab835ed853c3fc1565/users/03900d87ad374237a7ba23019f0167d6/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:28.465894 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf5aca-86ad-4067-9d76-5eeb86adda61 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:28.465894 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-7daf5aca-86ad-4067-9d76-5eeb86adda61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:28.479922 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 845/1680] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:28 2021] PUT /identity/v3/projects/60ae8c809a84419a98f50f025d3434ca/users/5886011f543448899f15c132f7309ade/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:28.490071 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c9a61-3558-4683-96af-57ac97fb56d1 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:28.490424 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c9a61-3558-4683-96af-57ac97fb56d1 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:28.490714 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c9a61-3558-4683-96af-57ac97fb56d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:28.640105 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-360c9a61-3558-4683-96af-57ac97fb56d1 None None] MFA Rules not processed for user `03900d87ad374237a7ba23019f0167d6`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:28.641269 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-360c9a61-3558-4683-96af-57ac97fb56d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:28.737820 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf5aca-86ad-4067-9d76-5eeb86adda61 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:28.870203 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 846/1681] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:28 2021] POST /identity/v3/auth/tokens => generated 3731 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:28.872621 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbd30f-2d3d-4f46-ae2f-10dd2eaaa387 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:28.872937 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbd30f-2d3d-4f46-ae2f-10dd2eaaa387 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:28.873364 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbd30f-2d3d-4f46-ae2f-10dd2eaaa387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:28.910087 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d80ec-7fcf-4d33-9bec-84b83ba4cc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:28.911533 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d80ec-7fcf-4d33-9bec-84b83ba4cc30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:28.911956 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d80ec-7fcf-4d33-9bec-84b83ba4cc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:28.912534 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d80ec-7fcf-4d33-9bec-84b83ba4cc30 admin admin] PATH_INFO: `/v3/projects/6ff98b579b504435a2894902e8739880` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:28.917951 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d80ec-7fcf-4d33-9bec-84b83ba4cc30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ff98b579b504435a2894902e8739880)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:28.920009 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d80ec-7fcf-4d33-9bec-84b83ba4cc30 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:28.991239 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-53fbd30f-2d3d-4f46-ae2f-10dd2eaaa387 None None] MFA Rules not processed for user `5886011f543448899f15c132f7309ade`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:28.992485 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-53fbd30f-2d3d-4f46-ae2f-10dd2eaaa387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:29.071106 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-280d80ec-7fcf-4d33-9bec-84b83ba4cc30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ff98b579b504435a2894902e8739880', 'request_id': 'req-280d80ec-7fcf-4d33-9bec-84b83ba4cc30'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:29.094547 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-280d80ec-7fcf-4d33-9bec-84b83ba4cc30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ff98b579b504435a2894902e8739880', 'request_id': 'req-280d80ec-7fcf-4d33-9bec-84b83ba4cc30'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:29.107725 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-280d80ec-7fcf-4d33-9bec-84b83ba4cc30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ff98b579b504435a2894902e8739880', 'request_id': 'req-280d80ec-7fcf-4d33-9bec-84b83ba4cc30'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:29.136255 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-280d80ec-7fcf-4d33-9bec-84b83ba4cc30 admin admin] The token cache is being invalidate because project 6ff98b579b504435a2894902e8739880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:29.137142 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-280d80ec-7fcf-4d33-9bec-84b83ba4cc30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:29.138760 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-280d80ec-7fcf-4d33-9bec-84b83ba4cc30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:29.149514 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 836/1682] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:28 2021] DELETE /identity/v3/projects/6ff98b579b504435a2894902e8739880 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:29.151493 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d80ec-7fcf-4d33-9bec-84b83ba4cc30 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:29.154508 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-280d80ec-7fcf-4d33-9bec-84b83ba4cc30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:29.225870 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 847/1683] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:28 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:29.227724 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbd30f-2d3d-4f46-ae2f-10dd2eaaa387 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:29.235893 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-53fbd30f-2d3d-4f46-ae2f-10dd2eaaa387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:29.339963 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d80ec-7fcf-4d33-9bec-84b83ba4cc30 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:29.348239 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca37bc1-9747-4af1-81d5-5db0eba4b3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:29.349734 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca37bc1-9747-4af1-81d5-5db0eba4b3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:29.350256 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca37bc1-9747-4af1-81d5-5db0eba4b3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:29.350772 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca37bc1-9747-4af1-81d5-5db0eba4b3c1 admin admin] PATH_INFO: `/v3/projects/2591113b3964487b97d4124db6e36a39` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:29.352911 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca37bc1-9747-4af1-81d5-5db0eba4b3c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2591113b3964487b97d4124db6e36a39)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:29.357850 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca37bc1-9747-4af1-81d5-5db0eba4b3c1 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:29.471439 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-dca37bc1-9747-4af1-81d5-5db0eba4b3c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2591113b3964487b97d4124db6e36a39', 'request_id': 'req-dca37bc1-9747-4af1-81d5-5db0eba4b3c1'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:29.476581 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbd30f-2d3d-4f46-ae2f-10dd2eaaa387 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:29.497537 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-dca37bc1-9747-4af1-81d5-5db0eba4b3c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2591113b3964487b97d4124db6e36a39', 'request_id': 'req-dca37bc1-9747-4af1-81d5-5db0eba4b3c1'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:29.507566 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-dca37bc1-9747-4af1-81d5-5db0eba4b3c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2591113b3964487b97d4124db6e36a39', 'request_id': 'req-dca37bc1-9747-4af1-81d5-5db0eba4b3c1'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:29.556468 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-dca37bc1-9747-4af1-81d5-5db0eba4b3c1 admin admin] The token cache is being invalidate because project 2591113b3964487b97d4124db6e36a39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:29.557830 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-dca37bc1-9747-4af1-81d5-5db0eba4b3c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:29.559213 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-dca37bc1-9747-4af1-81d5-5db0eba4b3c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:29.568803 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 837/1684] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:29 2021] DELETE /identity/v3/projects/2591113b3964487b97d4124db6e36a39 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:29.571813 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577918b-691c-450a-89ab-2e076c74c6b8 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:29.572578 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577918b-691c-450a-89ab-2e076c74c6b8 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:29.573642 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577918b-691c-450a-89ab-2e076c74c6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:29.631267 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-7577918b-691c-450a-89ab-2e076c74c6b8 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:29.633935 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-7577918b-691c-450a-89ab-2e076c74c6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:29.647551 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5dc144-d41d-41f9-9872-a50304367463 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:29.648160 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dc144-d41d-41f9-9872-a50304367463 service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:29.648453 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dc144-d41d-41f9-9872-a50304367463 service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:29.648896 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dc144-d41d-41f9-9872-a50304367463 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:29.651506 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-6e5dc144-d41d-41f9-9872-a50304367463 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:29.809549 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5dc144-d41d-41f9-9872-a50304367463 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:29.812496 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5dc144-d41d-41f9-9872-a50304367463 service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:29.852092 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 838/1685] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:29.866016 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577918b-691c-450a-89ab-2e076c74c6b8 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:29.866016 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-7577918b-691c-450a-89ab-2e076c74c6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:29.875391 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 848/1686] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:29 2021] GET /identity/v3/auth/tokens => generated 3731 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:29.881661 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cbdb0-2f74-420b-ba42-ac5bdeac8918 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:29.887589 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cbdb0-2f74-420b-ba42-ac5bdeac8918 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:29.888556 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cbdb0-2f74-420b-ba42-ac5bdeac8918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:29.933401 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577918b-691c-450a-89ab-2e076c74c6b8 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:29.958699 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdaa51-29fc-4e16-8648-3183bdb45294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:29.959324 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdaa51-29fc-4e16-8648-3183bdb45294 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:29.959625 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdaa51-29fc-4e16-8648-3183bdb45294 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:29.959905 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdaa51-29fc-4e16-8648-3183bdb45294 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:29.960564 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdaa51-29fc-4e16-8648-3183bdb45294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:29.962947 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdaa51-29fc-4e16-8648-3183bdb45294 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:30.004387 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-488cbdb0-2f74-420b-ba42-ac5bdeac8918 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:30.008888 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-488cbdb0-2f74-420b-ba42-ac5bdeac8918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:30.047341 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 849/1687] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:30.065250 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 839/1688] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:29 2021] POST /identity/v3/projects => generated 363 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:30.066913 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe88517-4d00-4258-b488-a8663ddeae4d None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:30.067415 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe88517-4d00-4258-b488-a8663ddeae4d None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:30.067865 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe88517-4d00-4258-b488-a8663ddeae4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:30.069594 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ce3ae-e696-4518-b23d-5981a4a4e41a None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:30.070102 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ce3ae-e696-4518-b23d-5981a4a4e41a None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:30.078227 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ce3ae-e696-4518-b23d-5981a4a4e41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:30.151266 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-4b9ce3ae-e696-4518-b23d-5981a4a4e41a None None] MFA Rules not processed for user `34e25627f3384826b35caf92a804c6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:30.154563 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-cfe88517-4d00-4258-b488-a8663ddeae4d None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:30.156375 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-cfe88517-4d00-4258-b488-a8663ddeae4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:30.168212 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-4b9ce3ae-e696-4518-b23d-5981a4a4e41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:30.330493 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 850/1689] 10.222.0.66 () {58 vars in 1015 bytes} [Thu Dec 16 14:39:30 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:30.332444 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a2668-7738-4e86-a2d9-5be48ecd8e4c None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:30.332972 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a2668-7738-4e86-a2d9-5be48ecd8e4c None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:30.333387 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a2668-7738-4e86-a2d9-5be48ecd8e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:30.363398 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 840/1690] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:30.369044 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe88517-4d00-4258-b488-a8663ddeae4d None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:30.395447 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe88517-4d00-4258-b488-a8663ddeae4d None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:30.416431 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-e14a2668-7738-4e86-a2d9-5be48ecd8e4c None None] MFA Rules not processed for user `fa7dedfceea346ca997eedec181935c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:30.418928 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e14a2668-7738-4e86-a2d9-5be48ecd8e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:30.437588 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56e1c6-2808-429a-b607-8bdac61210e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:30.438626 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56e1c6-2808-429a-b607-8bdac61210e3 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:30.439129 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56e1c6-2808-429a-b607-8bdac61210e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:30.439613 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56e1c6-2808-429a-b607-8bdac61210e3 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:30.440772 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56e1c6-2808-429a-b607-8bdac61210e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:30.470751 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56e1c6-2808-429a-b607-8bdac61210e3 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:30.514769 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 851/1691] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Dec 16 14:39:30 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:30.516137 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdcadd-282c-408f-812f-eb8883297bab None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:30.516390 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdcadd-282c-408f-812f-eb8883297bab None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:30.516678 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdcadd-282c-408f-812f-eb8883297bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:30.579544 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 841/1692] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:30 2021] POST /identity/v3/users => generated 288 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:30.584446 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56e1c6-2808-429a-b607-8bdac61210e3 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:30.584915 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-20cdcadd-282c-408f-812f-eb8883297bab None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:30.589865 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-20cdcadd-282c-408f-812f-eb8883297bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:30.590386 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-af56e1c6-2808-429a-b607-8bdac61210e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:30.608894 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 852/1693] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:30.610238 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdcadd-282c-408f-812f-eb8883297bab None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:30.613656 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-20cdcadd-282c-408f-812f-eb8883297bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:30.652426 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdcadd-282c-408f-812f-eb8883297bab None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:30.664305 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9449721-7838-4de6-b14b-f04a41e8a76a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:30.667579 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9449721-7838-4de6-b14b-f04a41e8a76a service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:30.668633 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9449721-7838-4de6-b14b-f04a41e8a76a service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:30.669233 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9449721-7838-4de6-b14b-f04a41e8a76a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:30.688420 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9449721-7838-4de6-b14b-f04a41e8a76a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:30.691524 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9449721-7838-4de6-b14b-f04a41e8a76a service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:30.717454 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 853/1694] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:30 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:30.719185 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9449721-7838-4de6-b14b-f04a41e8a76a service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:30.816293 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9449721-7838-4de6-b14b-f04a41e8a76a service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:30.835189 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56e1c6-2808-429a-b607-8bdac61210e3 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:30.842782 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb25215-c64a-413d-ad2b-70622b138079 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:30.843438 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb25215-c64a-413d-ad2b-70622b138079 service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:30.843697 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb25215-c64a-413d-ad2b-70622b138079 service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:30.843981 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb25215-c64a-413d-ad2b-70622b138079 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:30.846541 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-dcb25215-c64a-413d-ad2b-70622b138079 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:30.849349 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252ccc2-4354-4027-9d4f-5d9bd1d96177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:30.857451 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252ccc2-4354-4027-9d4f-5d9bd1d96177 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:30.859114 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252ccc2-4354-4027-9d4f-5d9bd1d96177 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:30.860333 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252ccc2-4354-4027-9d4f-5d9bd1d96177 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:30.861388 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252ccc2-4354-4027-9d4f-5d9bd1d96177 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:39:30.866002 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252ccc2-4354-4027-9d4f-5d9bd1d96177 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:30.877317 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252ccc2-4354-4027-9d4f-5d9bd1d96177 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:30.942909 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 854/1695] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:39:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:39:30.948398 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252ccc2-4354-4027-9d4f-5d9bd1d96177 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:30.952673 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb25215-c64a-413d-ad2b-70622b138079 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:30.954188 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb25215-c64a-413d-ad2b-70622b138079 service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:30.974903 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252ccc2-4354-4027-9d4f-5d9bd1d96177 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:30.989254 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 842/1696] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:30 2021] GET /identity/v3/auth/tokens => generated 3662 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:30.991773 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb25215-c64a-413d-ad2b-70622b138079 service cinder] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:30.993633 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fa645-3444-4114-82f9-44f5eea65e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:30.994518 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fa645-3444-4114-82f9-44f5eea65e01 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:30.995013 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fa645-3444-4114-82f9-44f5eea65e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:30.995556 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fa645-3444-4114-82f9-44f5eea65e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:30.997542 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fa645-3444-4114-82f9-44f5eea65e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:30.999572 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fa645-3444-4114-82f9-44f5eea65e01 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:31.031873 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb25215-c64a-413d-ad2b-70622b138079 service cinder] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:31.034565 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 855/1697] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:30 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:31.035603 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fa645-3444-4114-82f9-44f5eea65e01 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:31.044953 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-7e5fa645-3444-4114-82f9-44f5eea65e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:31.067489 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed7d1b-bd57-4654-b388-b6a3215d8c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:31.068523 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed7d1b-bd57-4654-b388-b6a3215d8c8b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:31.069711 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed7d1b-bd57-4654-b388-b6a3215d8c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:31.070194 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed7d1b-bd57-4654-b388-b6a3215d8c8b admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:31.076458 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed7d1b-bd57-4654-b388-b6a3215d8c8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:39:31.077192 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed7d1b-bd57-4654-b388-b6a3215d8c8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:31.082391 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed7d1b-bd57-4654-b388-b6a3215d8c8b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:31.138026 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 843/1698] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:39:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:39:31.140478 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc57122-accc-4e32-b7a9-d110bef216bf None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:31.140774 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc57122-accc-4e32-b7a9-d110bef216bf None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:31.147295 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc57122-accc-4e32-b7a9-d110bef216bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:31.225325 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-6bc57122-accc-4e32-b7a9-d110bef216bf None None] MFA Rules not processed for user `4166133ac04844d491662feab2bd2d21`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:31.231434 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-6bc57122-accc-4e32-b7a9-d110bef216bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:31.282446 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fa645-3444-4114-82f9-44f5eea65e01 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:31.307522 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2d65f-ca9f-40ab-99a6-c29c94a6e210 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de4c90e44b96488aa47fbbc302e4f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:31.308491 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2d65f-ca9f-40ab-99a6-c29c94a6e210 service swift] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:31.308826 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2d65f-ca9f-40ab-99a6-c29c94a6e210 service swift] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:31.309164 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2d65f-ca9f-40ab-99a6-c29c94a6e210 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:31.342342 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2d65f-ca9f-40ab-99a6-c29c94a6e210 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:31.343997 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2d65f-ca9f-40ab-99a6-c29c94a6e210 service swift] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:31.388534 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 856/1699] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Dec 16 14:39:31 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:39:31.392731 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2d65f-ca9f-40ab-99a6-c29c94a6e210 service swift] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:31.432485 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2d65f-ca9f-40ab-99a6-c29c94a6e210 service swift] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:31.453430 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb80dda-d82c-4907-8b96-a6c640f359aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:31.454323 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb80dda-d82c-4907-8b96-a6c640f359aa admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:31.454645 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb80dda-d82c-4907-8b96-a6c640f359aa admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:31.456136 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb80dda-d82c-4907-8b96-a6c640f359aa admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:31.457013 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb80dda-d82c-4907-8b96-a6c640f359aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:31.466218 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb80dda-d82c-4907-8b96-a6c640f359aa admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:31.516063 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 844/1700] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:31 2021] POST /identity/v3/auth/tokens => generated 3700 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:31.531657 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc57122-accc-4e32-b7a9-d110bef216bf None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:31.579748 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc57122-accc-4e32-b7a9-d110bef216bf None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:31.610472 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151765be-eba6-4d5a-b83b-5772aeda184e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:31.611368 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151765be-eba6-4d5a-b83b-5772aeda184e admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:31.611662 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151765be-eba6-4d5a-b83b-5772aeda184e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:31.611954 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151765be-eba6-4d5a-b83b-5772aeda184e admin admin] PATH_INFO: `/v3/projects/115708cd0f0846789aa7a721c9ce0930/users/6a9e699aa666421c88f62e8e0267b53d/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:31.634447 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 857/1701] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:31 2021] POST /identity/v3/projects => generated 363 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:31.636557 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb80dda-d82c-4907-8b96-a6c640f359aa admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:31.690214 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151765be-eba6-4d5a-b83b-5772aeda184e admin admin] RBAC: Authorizing `identity:create_grant(project_id=115708cd0f0846789aa7a721c9ce0930, user_id=6a9e699aa666421c88f62e8e0267b53d, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:31.699907 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151765be-eba6-4d5a-b83b-5772aeda184e admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:31.735307 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 845/1702] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:31 2021] PUT /identity/v3/projects/115708cd0f0846789aa7a721c9ce0930/users/6a9e699aa666421c88f62e8e0267b53d/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:31.735307 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe6f37-e9b1-413b-854f-44886ac63bcd None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:31.735307 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe6f37-e9b1-413b-854f-44886ac63bcd None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:31.735307 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe6f37-e9b1-413b-854f-44886ac63bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:31.815158 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-acbe6f37-e9b1-413b-854f-44886ac63bcd None None] MFA Rules not processed for user `18d85bcc0aeb413aa2ade769fd10e431`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:31.816360 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-acbe6f37-e9b1-413b-854f-44886ac63bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:31.950010 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 846/1703] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:31 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:31.951786 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe6f37-e9b1-413b-854f-44886ac63bcd None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:32.044282 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb80dda-d82c-4907-8b96-a6c640f359aa admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:32.264394 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be87c9-0527-42a5-9b9a-e2d86008775b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:32.265245 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be87c9-0527-42a5-9b9a-e2d86008775b admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:32.266684 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be87c9-0527-42a5-9b9a-e2d86008775b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:32.267512 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be87c9-0527-42a5-9b9a-e2d86008775b admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:32.270211 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be87c9-0527-42a5-9b9a-e2d86008775b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:32.275359 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be87c9-0527-42a5-9b9a-e2d86008775b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:32.299931 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe6f37-e9b1-413b-854f-44886ac63bcd None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:32.325482 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1d66d-3480-438d-8d8e-cae7d8b589d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:32.328351 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1d66d-3480-438d-8d8e-cae7d8b589d7 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:32.328744 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1d66d-3480-438d-8d8e-cae7d8b589d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:32.338033 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1d66d-3480-438d-8d8e-cae7d8b589d7 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:32.339055 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1d66d-3480-438d-8d8e-cae7d8b589d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:32.341093 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1d66d-3480-438d-8d8e-cae7d8b589d7 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:32.368264 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 858/1704] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:31 2021] POST /identity/v3/projects => generated 391 bytes in 732 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:32.372137 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be87c9-0527-42a5-9b9a-e2d86008775b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:32.442736 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 847/1705] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:31 2021] POST /identity/v3/users => generated 282 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:32.444161 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1d66d-3480-438d-8d8e-cae7d8b589d7 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:32.452922 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-c6f1d66d-3480-438d-8d8e-cae7d8b589d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:32.597590 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be87c9-0527-42a5-9b9a-e2d86008775b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:32.610262 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268e764-6aae-417f-abf8-9236c7831167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:32.611610 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268e764-6aae-417f-abf8-9236c7831167 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:32.611610 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268e764-6aae-417f-abf8-9236c7831167 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:32.613557 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268e764-6aae-417f-abf8-9236c7831167 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:32.614783 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268e764-6aae-417f-abf8-9236c7831167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:32.617991 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268e764-6aae-417f-abf8-9236c7831167 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:32.654872 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 859/1706] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:32 2021] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:32.655937 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268e764-6aae-417f-abf8-9236c7831167 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:32.676918 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268e764-6aae-417f-abf8-9236c7831167 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:32.689131 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0659001-8a0d-43c1-a4a6-fc45e772fa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:32.689913 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0659001-8a0d-43c1-a4a6-fc45e772fa83 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:32.690242 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0659001-8a0d-43c1-a4a6-fc45e772fa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:32.690581 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0659001-8a0d-43c1-a4a6-fc45e772fa83 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:32.691314 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0659001-8a0d-43c1-a4a6-fc45e772fa83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:32.697028 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0659001-8a0d-43c1-a4a6-fc45e772fa83 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:32.747754 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 860/1707] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:32 2021] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:32.749654 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0659001-8a0d-43c1-a4a6-fc45e772fa83 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:32.756040 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1d66d-3480-438d-8d8e-cae7d8b589d7 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:32.799529 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0659001-8a0d-43c1-a4a6-fc45e772fa83 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:32.804608 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf107a6-cf15-4172-9dfa-0a0714ed0f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:32.805383 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf107a6-cf15-4172-9dfa-0a0714ed0f08 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:32.805745 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf107a6-cf15-4172-9dfa-0a0714ed0f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:32.806039 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf107a6-cf15-4172-9dfa-0a0714ed0f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:32.807173 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf107a6-cf15-4172-9dfa-0a0714ed0f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:32.809667 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf107a6-cf15-4172-9dfa-0a0714ed0f08 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:32.843668 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 861/1708] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:32 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:32.844601 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf107a6-cf15-4172-9dfa-0a0714ed0f08 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:32.875744 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf107a6-cf15-4172-9dfa-0a0714ed0f08 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:32.891429 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e283a0f-d51b-479a-a757-960c93d43025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:32.893124 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e283a0f-d51b-479a-a757-960c93d43025 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:32.893443 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e283a0f-d51b-479a-a757-960c93d43025 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:32.893739 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e283a0f-d51b-479a-a757-960c93d43025 admin admin] PATH_INFO: `/v3/projects/115708cd0f0846789aa7a721c9ce0930/users/6a9e699aa666421c88f62e8e0267b53d/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:32.898553 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e283a0f-d51b-479a-a757-960c93d43025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=115708cd0f0846789aa7a721c9ce0930, user_id=6a9e699aa666421c88f62e8e0267b53d, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:32.908090 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e283a0f-d51b-479a-a757-960c93d43025 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:32.940958 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 862/1709] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:32 2021] PUT /identity/v3/projects/115708cd0f0846789aa7a721c9ce0930/users/6a9e699aa666421c88f62e8e0267b53d/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:32.947292 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c445861-2ef3-4e09-85a8-f7da22aae1df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:32.947911 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c445861-2ef3-4e09-85a8-f7da22aae1df service nova] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:32.948259 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c445861-2ef3-4e09-85a8-f7da22aae1df service nova] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:32.948575 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c445861-2ef3-4e09-85a8-f7da22aae1df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:32.952657 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e283a0f-d51b-479a-a757-960c93d43025 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:33.244390 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e283a0f-d51b-479a-a757-960c93d43025 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:33.246980 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c445861-2ef3-4e09-85a8-f7da22aae1df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:33.261434 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c445861-2ef3-4e09-85a8-f7da22aae1df service nova] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:33.268775 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59aecd3-0004-4066-8e44-a64421162872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:33.269563 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59aecd3-0004-4066-8e44-a64421162872 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:33.269707 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59aecd3-0004-4066-8e44-a64421162872 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:33.269990 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59aecd3-0004-4066-8e44-a64421162872 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:33.270714 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59aecd3-0004-4066-8e44-a64421162872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:33.272519 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59aecd3-0004-4066-8e44-a64421162872 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:33.309475 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 863/1710] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:32 2021] GET /identity/v3/roles => generated 1420 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:33.315710 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59aecd3-0004-4066-8e44-a64421162872 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:33.344141 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 848/1711] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:32 2021] GET /identity/v3/auth/tokens => generated 3694 bytes in 898 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:33.348612 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fddcf-83c3-4538-8f16-ee4e0cd2982f None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:33.353743 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fddcf-83c3-4538-8f16-ee4e0cd2982f None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:33.356129 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fddcf-83c3-4538-8f16-ee4e0cd2982f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:33.362862 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59aecd3-0004-4066-8e44-a64421162872 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:33.397859 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04b61a-f9ae-4242-a4e6-2cb5c7ace95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:33.398635 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04b61a-f9ae-4242-a4e6-2cb5c7ace95b admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:33.399089 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04b61a-f9ae-4242-a4e6-2cb5c7ace95b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:33.399822 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04b61a-f9ae-4242-a4e6-2cb5c7ace95b admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:33.401040 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04b61a-f9ae-4242-a4e6-2cb5c7ace95b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:33.403913 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04b61a-f9ae-4242-a4e6-2cb5c7ace95b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:33.455930 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 864/1712] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:33 2021] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:33.457234 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04b61a-f9ae-4242-a4e6-2cb5c7ace95b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:33.485592 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-fc0fddcf-83c3-4538-8f16-ee4e0cd2982f None None] MFA Rules not processed for user `6a9e699aa666421c88f62e8e0267b53d`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:33.492982 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-fc0fddcf-83c3-4538-8f16-ee4e0cd2982f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:33.495679 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04b61a-f9ae-4242-a4e6-2cb5c7ace95b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:33.516902 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fd5e4-4a3f-4e4f-a1dc-570617fb87a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:33.517543 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fd5e4-4a3f-4e4f-a1dc-570617fb87a2 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:33.517835 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fd5e4-4a3f-4e4f-a1dc-570617fb87a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:33.518121 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fd5e4-4a3f-4e4f-a1dc-570617fb87a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:33.518965 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36fd5e4-4a3f-4e4f-a1dc-570617fb87a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:33.520645 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36fd5e4-4a3f-4e4f-a1dc-570617fb87a2 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:33.571713 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 865/1713] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:33 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:33.586348 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fd5e4-4a3f-4e4f-a1dc-570617fb87a2 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:33.624334 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fd5e4-4a3f-4e4f-a1dc-570617fb87a2 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:33.662144 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c203ed-0374-491e-a603-fdb7e8ba40b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:33.663045 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c203ed-0374-491e-a603-fdb7e8ba40b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:33.663332 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c203ed-0374-491e-a603-fdb7e8ba40b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:33.663617 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c203ed-0374-491e-a603-fdb7e8ba40b6 admin admin] PATH_INFO: `/v3/projects/98332976af014a5181e467f387b45a17/users/8908b192b95d43e59eccd9585c196f24/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:33.742741 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c203ed-0374-491e-a603-fdb7e8ba40b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98332976af014a5181e467f387b45a17, user_id=8908b192b95d43e59eccd9585c196f24, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:33.755872 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c203ed-0374-491e-a603-fdb7e8ba40b6 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:33.805922 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 866/1714] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:33 2021] PUT /identity/v3/projects/98332976af014a5181e467f387b45a17/users/8908b192b95d43e59eccd9585c196f24/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:33.808081 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c203ed-0374-491e-a603-fdb7e8ba40b6 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:34.149190 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 849/1715] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:33 2021] POST /identity/v3/auth/tokens => generated 3737 bytes in 804 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:34.151091 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3103c5-062c-4e43-bc48-cf3b244f5200 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:34.162190 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3103c5-062c-4e43-bc48-cf3b244f5200 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:34.164185 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3103c5-062c-4e43-bc48-cf3b244f5200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:34.268524 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c203ed-0374-491e-a603-fdb7e8ba40b6 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:34.276185 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156197ed-615c-4b71-8911-3ba2f5aecc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:34.278237 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156197ed-615c-4b71-8911-3ba2f5aecc16 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:34.278740 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156197ed-615c-4b71-8911-3ba2f5aecc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:34.279253 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156197ed-615c-4b71-8911-3ba2f5aecc16 admin admin] PATH_INFO: `/v3/projects/b2f30e7cfc3c40bda18ce9e91bcfcbdd/users/10a1df522051433c8407de00d266b025/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:34.291077 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-7d3103c5-062c-4e43-bc48-cf3b244f5200 None None] MFA Rules not processed for user `8908b192b95d43e59eccd9585c196f24`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:34.295271 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-7d3103c5-062c-4e43-bc48-cf3b244f5200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:34.380855 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156197ed-615c-4b71-8911-3ba2f5aecc16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2f30e7cfc3c40bda18ce9e91bcfcbdd, user_id=10a1df522051433c8407de00d266b025, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:34.406288 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156197ed-615c-4b71-8911-3ba2f5aecc16 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:34.426537 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 850/1716] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:34 2021] POST /identity/v3/auth/tokens => generated 3670 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:34.430948 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3103c5-062c-4e43-bc48-cf3b244f5200 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:34.435586 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-7d3103c5-062c-4e43-bc48-cf3b244f5200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:34.485454 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 867/1717] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:33 2021] PUT /identity/v3/projects/b2f30e7cfc3c40bda18ce9e91bcfcbdd/users/10a1df522051433c8407de00d266b025/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:34.486975 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb81e64-12d4-4dbc-bb7e-688c176d1741 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:34.487240 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb81e64-12d4-4dbc-bb7e-688c176d1741 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:34.487519 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb81e64-12d4-4dbc-bb7e-688c176d1741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:34.664434 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-cbb81e64-12d4-4dbc-bb7e-688c176d1741 None None] MFA Rules not processed for user `10a1df522051433c8407de00d266b025`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:34.670620 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-cbb81e64-12d4-4dbc-bb7e-688c176d1741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:34.708863 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3103c5-062c-4e43-bc48-cf3b244f5200 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:35.090744 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 868/1718] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:34 2021] POST /identity/v3/auth/tokens => generated 3698 bytes in 598 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:35.092361 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb81e64-12d4-4dbc-bb7e-688c176d1741 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:35.285418 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed48eb-23a3-45af-80fe-6626e8f74684 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:35.292071 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed48eb-23a3-45af-80fe-6626e8f74684 service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:35.296241 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed48eb-23a3-45af-80fe-6626e8f74684 service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:35.296774 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed48eb-23a3-45af-80fe-6626e8f74684 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:35.400392 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb81e64-12d4-4dbc-bb7e-688c176d1741 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:35.427676 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796a177-5db6-4559-ad7b-e5eb8b402de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:35.429210 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796a177-5db6-4559-ad7b-e5eb8b402de5 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:35.429732 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796a177-5db6-4559-ad7b-e5eb8b402de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:35.430291 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796a177-5db6-4559-ad7b-e5eb8b402de5 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:35.432501 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796a177-5db6-4559-ad7b-e5eb8b402de5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:35.447279 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796a177-5db6-4559-ad7b-e5eb8b402de5 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:35.577502 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed48eb-23a3-45af-80fe-6626e8f74684 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:35.579030 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed48eb-23a3-45af-80fe-6626e8f74684 service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:35.594562 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 869/1719] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:35 2021] POST /identity/v3/projects => generated 393 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:35.594562 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16297bee-b2fe-431f-b31d-c6fe01038854 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:35.594562 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16297bee-b2fe-431f-b31d-c6fe01038854 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:35.594562 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16297bee-b2fe-431f-b31d-c6fe01038854 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:35.606248 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 870/1720] 10.222.0.64 () {54 vars in 921 bytes} [Thu Dec 16 14:39:35 2021] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:39:35.608662 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16297bee-b2fe-431f-b31d-c6fe01038854 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:35.648643 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 851/1721] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:34 2021] GET /identity/v3/auth/tokens => generated 3737 bytes in 1219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:35.650707 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67814cc9-4d76-4ca3-8cfc-18f1a1866eaa None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:35.652735 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67814cc9-4d76-4ca3-8cfc-18f1a1866eaa None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:35.653298 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67814cc9-4d76-4ca3-8cfc-18f1a1866eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:35.744880 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-67814cc9-4d76-4ca3-8cfc-18f1a1866eaa None None] MFA Rules not processed for user `8e416527de444ef1b744da062ee1e7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:35.768761 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-67814cc9-4d76-4ca3-8cfc-18f1a1866eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:35.937449 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16297bee-b2fe-431f-b31d-c6fe01038854 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:35.956149 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bf7ff-0bea-4f68-8358-de67a9e5d912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:35.959365 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bf7ff-0bea-4f68-8358-de67a9e5d912 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:35.960362 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bf7ff-0bea-4f68-8358-de67a9e5d912 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:35.962618 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bf7ff-0bea-4f68-8358-de67a9e5d912 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:35.964596 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64bf7ff-0bea-4f68-8358-de67a9e5d912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:35.970563 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64bf7ff-0bea-4f68-8358-de67a9e5d912 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:36.019442 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 871/1722] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:35 2021] POST /identity/v3/users => generated 303 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:36.020841 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bf7ff-0bea-4f68-8358-de67a9e5d912 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:36.145215 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 852/1723] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Dec 16 14:39:35 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:36.148311 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67814cc9-4d76-4ca3-8cfc-18f1a1866eaa None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:36.181525 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bf7ff-0bea-4f68-8358-de67a9e5d912 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:36.188899 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67814cc9-4d76-4ca3-8cfc-18f1a1866eaa None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:36.197479 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3baee4-7ea1-4c5b-9fc7-84a29a053e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:36.198853 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3baee4-7ea1-4c5b-9fc7-84a29a053e44 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:36.199538 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3baee4-7ea1-4c5b-9fc7-84a29a053e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:36.200204 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3baee4-7ea1-4c5b-9fc7-84a29a053e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:36.201950 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3baee4-7ea1-4c5b-9fc7-84a29a053e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:36.205363 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3baee4-7ea1-4c5b-9fc7-84a29a053e44 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:36.216760 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b316b9-8593-45cc-a532-2da6eca4e744 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:36.217771 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b316b9-8593-45cc-a532-2da6eca4e744 service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:36.218261 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b316b9-8593-45cc-a532-2da6eca4e744 service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:36.218745 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b316b9-8593-45cc-a532-2da6eca4e744 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:36.231227 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 853/1724] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:36 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:36.233199 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3baee4-7ea1-4c5b-9fc7-84a29a053e44 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:36.255699 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3baee4-7ea1-4c5b-9fc7-84a29a053e44 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:36.266506 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26937c11-a9a2-47da-b35b-5a749ed7f454 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:36.267586 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26937c11-a9a2-47da-b35b-5a749ed7f454 service nova] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:36.268176 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26937c11-a9a2-47da-b35b-5a749ed7f454 service nova] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:36.268734 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26937c11-a9a2-47da-b35b-5a749ed7f454 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:36.290354 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26937c11-a9a2-47da-b35b-5a749ed7f454 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:36.294663 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26937c11-a9a2-47da-b35b-5a749ed7f454 service nova] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:36.318455 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 854/1725] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:36 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:36.320066 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26937c11-a9a2-47da-b35b-5a749ed7f454 service nova] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:36.342426 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26937c11-a9a2-47da-b35b-5a749ed7f454 service nova] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:36.353104 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56ee4c-2b1d-4a93-8a38-3160f7bfd249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:36.355540 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56ee4c-2b1d-4a93-8a38-3160f7bfd249 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:36.356048 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56ee4c-2b1d-4a93-8a38-3160f7bfd249 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:36.356802 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56ee4c-2b1d-4a93-8a38-3160f7bfd249 admin admin] PATH_INFO: `/v3/projects/d3727007468043628fad76975c69c52b/users/029b7e9dc00842cb9893e03efff16de3/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:36.405617 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56ee4c-2b1d-4a93-8a38-3160f7bfd249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3727007468043628fad76975c69c52b, user_id=029b7e9dc00842cb9893e03efff16de3, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:36.412666 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56ee4c-2b1d-4a93-8a38-3160f7bfd249 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:36.418489 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b316b9-8593-45cc-a532-2da6eca4e744 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:36.420130 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b316b9-8593-45cc-a532-2da6eca4e744 service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:36.443919 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 872/1726] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:36 2021] GET /identity/v3/auth/tokens => generated 3670 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:36.460932 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 855/1727] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:36 2021] PUT /identity/v3/projects/d3727007468043628fad76975c69c52b/users/029b7e9dc00842cb9893e03efff16de3/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:36.462571 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b316b9-8593-45cc-a532-2da6eca4e744 service cinder] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:36.480301 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b316b9-8593-45cc-a532-2da6eca4e744 service cinder] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:36.666177 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6017a9f-0af8-47d1-8b0a-4ed43407da41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:36.668154 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6017a9f-0af8-47d1-8b0a-4ed43407da41 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:36.669939 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6017a9f-0af8-47d1-8b0a-4ed43407da41 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:36.670451 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6017a9f-0af8-47d1-8b0a-4ed43407da41 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:36.673331 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6017a9f-0af8-47d1-8b0a-4ed43407da41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:36.677103 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6017a9f-0af8-47d1-8b0a-4ed43407da41 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:36.708071 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 873/1728] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:36 2021] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:36.711087 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56ee4c-2b1d-4a93-8a38-3160f7bfd249 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:36.770038 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56ee4c-2b1d-4a93-8a38-3160f7bfd249 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:36.802740 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e45236-ba7f-436a-938d-6e440e3dae61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:36.813040 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e45236-ba7f-436a-938d-6e440e3dae61 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:36.816182 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e45236-ba7f-436a-938d-6e440e3dae61 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:36.816973 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e45236-ba7f-436a-938d-6e440e3dae61 admin admin] PATH_INFO: `/v3/projects/d3727007468043628fad76975c69c52b/users/029b7e9dc00842cb9893e03efff16de3/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:36.834778 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e45236-ba7f-436a-938d-6e440e3dae61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3727007468043628fad76975c69c52b, user_id=029b7e9dc00842cb9893e03efff16de3, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:36.856759 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e45236-ba7f-436a-938d-6e440e3dae61 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:36.964009 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 856/1729] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:36 2021] PUT /identity/v3/projects/d3727007468043628fad76975c69c52b/users/029b7e9dc00842cb9893e03efff16de3/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:36.986133 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799609b-d795-4b18-b272-d4f6b2e48e5a None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:36.986908 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799609b-d795-4b18-b272-d4f6b2e48e5a None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:36.987339 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799609b-d795-4b18-b272-d4f6b2e48e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:37.080051 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-a799609b-d795-4b18-b272-d4f6b2e48e5a None None] MFA Rules not processed for user `029b7e9dc00842cb9893e03efff16de3`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:37.081288 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-a799609b-d795-4b18-b272-d4f6b2e48e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:37.282254 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 874/1730] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:36 2021] POST /identity/v3/auth/tokens => generated 3767 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:37.645264 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e45236-ba7f-436a-938d-6e440e3dae61 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:37.890117 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e45236-ba7f-436a-938d-6e440e3dae61 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:37.920818 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fc591-4006-405a-a2be-968ed854a646 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:37.921834 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fc591-4006-405a-a2be-968ed854a646 service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:37.922317 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fc591-4006-405a-a2be-968ed854a646 service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:37.923455 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fc591-4006-405a-a2be-968ed854a646 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:37.978348 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05fc591-4006-405a-a2be-968ed854a646 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:37.981585 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05fc591-4006-405a-a2be-968ed854a646 service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:38.045177 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 857/1731] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:37 2021] GET /identity/v3/auth/tokens => generated 3767 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:38.144368 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799609b-d795-4b18-b272-d4f6b2e48e5a None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:38.162968 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799609b-d795-4b18-b272-d4f6b2e48e5a None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:38.174757 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742e6b3-14c1-49c2-a15f-7acd6ed9bf3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:38.175775 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742e6b3-14c1-49c2-a15f-7acd6ed9bf3c service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:38.176256 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742e6b3-14c1-49c2-a15f-7acd6ed9bf3c service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:38.176731 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742e6b3-14c1-49c2-a15f-7acd6ed9bf3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:38.190521 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-0742e6b3-14c1-49c2-a15f-7acd6ed9bf3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:38.349104 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742e6b3-14c1-49c2-a15f-7acd6ed9bf3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:38.350678 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742e6b3-14c1-49c2-a15f-7acd6ed9bf3c service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:38.361704 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 875/1732] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:38 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:39:38.506897 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fc591-4006-405a-a2be-968ed854a646 service cinder] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:38.520457 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fc591-4006-405a-a2be-968ed854a646 service cinder] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:38.532602 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fef883-7e42-4773-8851-fe8bb1ba4b07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:38.533367 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fef883-7e42-4773-8851-fe8bb1ba4b07 service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:38.533819 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fef883-7e42-4773-8851-fe8bb1ba4b07 service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:38.534163 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fef883-7e42-4773-8851-fe8bb1ba4b07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:38.709058 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fef883-7e42-4773-8851-fe8bb1ba4b07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:38.713897 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fef883-7e42-4773-8851-fe8bb1ba4b07 service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:38.736091 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 858/1733] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:38 2021] GET /identity/v3/auth/tokens => generated 3698 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:41.215794 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3a797-2a80-4f2e-afa5-602f019639ce None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:41.216731 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3a797-2a80-4f2e-afa5-602f019639ce None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:41.217191 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3a797-2a80-4f2e-afa5-602f019639ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:41.313043 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-5cc3a797-2a80-4f2e-afa5-602f019639ce None None] MFA Rules not processed for user `18d85bcc0aeb413aa2ade769fd10e431`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:41.314395 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-5cc3a797-2a80-4f2e-afa5-602f019639ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:41.568218 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 876/1734] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:41 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:45.109155 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61925d-87ad-4b59-9c0f-e267f1fa2d02 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:45.110399 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61925d-87ad-4b59-9c0f-e267f1fa2d02 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:45.111143 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61925d-87ad-4b59-9c0f-e267f1fa2d02 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:45.115434 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 859/1735] 10.222.0.64 () {54 vars in 921 bytes} [Thu Dec 16 14:39:45 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:39:45.153626 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353a5df-130b-4055-98b1-11fad1dffc5d None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:45.154404 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353a5df-130b-4055-98b1-11fad1dffc5d None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:45.154404 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353a5df-130b-4055-98b1-11fad1dffc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:45.229783 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-b353a5df-130b-4055-98b1-11fad1dffc5d None None] MFA Rules not processed for user `8e416527de444ef1b744da062ee1e7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:45.234423 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-b353a5df-130b-4055-98b1-11fad1dffc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:45.452451 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 877/1736] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Dec 16 14:39:45 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:46.171139 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61925d-87ad-4b59-9c0f-e267f1fa2d02 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:46.197047 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61925d-87ad-4b59-9c0f-e267f1fa2d02 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:46.210229 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c081d27-ca5d-462e-a9e1-e54c71182c7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:46.210987 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c081d27-ca5d-462e-a9e1-e54c71182c7b service nova] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:46.212399 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c081d27-ca5d-462e-a9e1-e54c71182c7b service nova] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:46.214340 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c081d27-ca5d-462e-a9e1-e54c71182c7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:46.233016 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c081d27-ca5d-462e-a9e1-e54c71182c7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:46.234907 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c081d27-ca5d-462e-a9e1-e54c71182c7b service nova] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:46.282718 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 860/1737] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:46 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:49.403960 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353a5df-130b-4055-98b1-11fad1dffc5d None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:49.464758 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c081d27-ca5d-462e-a9e1-e54c71182c7b service nova] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:49.487718 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353a5df-130b-4055-98b1-11fad1dffc5d None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:49.496197 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f77d9-3584-46ce-9c26-ce781fb1a547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:49.497078 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f77d9-3584-46ce-9c26-ce781fb1a547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:49.497474 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f77d9-3584-46ce-9c26-ce781fb1a547 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:49.497761 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f77d9-3584-46ce-9c26-ce781fb1a547 admin admin] PATH_INFO: `/v3/users/10a1df522051433c8407de00d266b025` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:49.498941 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f77d9-3584-46ce-9c26-ce781fb1a547 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10a1df522051433c8407de00d266b025)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:49.501314 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f77d9-3584-46ce-9c26-ce781fb1a547 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:49.554460 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-c96f77d9-3584-46ce-9c26-ce781fb1a547 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10a1df522051433c8407de00d266b025'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:49.554460 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-c96f77d9-3584-46ce-9c26-ce781fb1a547 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10a1df522051433c8407de00d266b025'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:49.555944 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c081d27-ca5d-462e-a9e1-e54c71182c7b service nova] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:49.561083 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76ca89-7251-4759-bb97-584716285827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:49.561897 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76ca89-7251-4759-bb97-584716285827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:49.562187 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76ca89-7251-4759-bb97-584716285827 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:49.562470 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76ca89-7251-4759-bb97-584716285827 admin admin] PATH_INFO: `/v3/users/5886011f543448899f15c132f7309ade` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:49.563602 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76ca89-7251-4759-bb97-584716285827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5886011f543448899f15c132f7309ade)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:49.565545 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76ca89-7251-4759-bb97-584716285827 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:49.568300 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-c96f77d9-3584-46ce-9c26-ce781fb1a547 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10a1df522051433c8407de00d266b025'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:49.576927 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-c96f77d9-3584-46ce-9c26-ce781fb1a547 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10a1df522051433c8407de00d266b025'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:49.585829 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-c96f77d9-3584-46ce-9c26-ce781fb1a547 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10a1df522051433c8407de00d266b025'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:49.592111 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 878/1738] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:49 2021] DELETE /identity/v3/users/10a1df522051433c8407de00d266b025 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:49.596941 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68c1a8-fb34-47a5-898f-1f39cbeea62c None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:49.597264 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68c1a8-fb34-47a5-898f-1f39cbeea62c None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:49.597572 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68c1a8-fb34-47a5-898f-1f39cbeea62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:49.616908 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5b76ca89-7251-4759-bb97-584716285827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5886011f543448899f15c132f7309ade'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:49.617551 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5b76ca89-7251-4759-bb97-584716285827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5886011f543448899f15c132f7309ade'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:49.621344 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-ff68c1a8-fb34-47a5-898f-1f39cbeea62c None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:49.622606 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-ff68c1a8-fb34-47a5-898f-1f39cbeea62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:49.633467 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5b76ca89-7251-4759-bb97-584716285827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5886011f543448899f15c132f7309ade'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:49.644710 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5b76ca89-7251-4759-bb97-584716285827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5886011f543448899f15c132f7309ade'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:49.659612 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5b76ca89-7251-4759-bb97-584716285827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5886011f543448899f15c132f7309ade'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:49.669121 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 861/1739] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:49 2021] DELETE /identity/v3/users/5886011f543448899f15c132f7309ade => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:39:49.674663 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d4c4b-83ee-45a0-9d65-6e1e61ba3d63 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:49.674947 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d4c4b-83ee-45a0-9d65-6e1e61ba3d63 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:49.675350 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d4c4b-83ee-45a0-9d65-6e1e61ba3d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:49.699239 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-3c2d4c4b-83ee-45a0-9d65-6e1e61ba3d63 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:49.700618 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-3c2d4c4b-83ee-45a0-9d65-6e1e61ba3d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:49.709096 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 879/1740] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:49.726881 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68c1a8-fb34-47a5-898f-1f39cbeea62c None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:49.729830 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-ff68c1a8-fb34-47a5-898f-1f39cbeea62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:49.783268 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 862/1741] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:49.794482 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d4c4b-83ee-45a0-9d65-6e1e61ba3d63 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:49.796073 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-3c2d4c4b-83ee-45a0-9d65-6e1e61ba3d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:49.809762 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68c1a8-fb34-47a5-898f-1f39cbeea62c None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:49.871260 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1235e-e1da-471a-9a91-dad748d04b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:49.871870 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1235e-e1da-471a-9a91-dad748d04b26 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:49.872161 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1235e-e1da-471a-9a91-dad748d04b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:49.872448 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1235e-e1da-471a-9a91-dad748d04b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:49.882520 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1235e-e1da-471a-9a91-dad748d04b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:49.883991 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1235e-e1da-471a-9a91-dad748d04b26 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:49.885047 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d4c4b-83ee-45a0-9d65-6e1e61ba3d63 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:49.889879 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6576577-f516-4a03-9dbc-1bb1344ad15b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:49.891257 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6576577-f516-4a03-9dbc-1bb1344ad15b service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:49.891747 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6576577-f516-4a03-9dbc-1bb1344ad15b service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:49.892582 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6576577-f516-4a03-9dbc-1bb1344ad15b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:49.895107 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 880/1742] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:49 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:39:49.904836 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6576577-f516-4a03-9dbc-1bb1344ad15b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:49.906798 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6576577-f516-4a03-9dbc-1bb1344ad15b service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:49.920172 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 863/1743] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:49 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:51.741109 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1235e-e1da-471a-9a91-dad748d04b26 service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:51.747164 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-a4b1235e-e1da-471a-9a91-dad748d04b26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:51.787195 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6576577-f516-4a03-9dbc-1bb1344ad15b service neutron] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:51.787713 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1235e-e1da-471a-9a91-dad748d04b26 service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:51.789006 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-f6576577-f516-4a03-9dbc-1bb1344ad15b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:51.799930 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab5d54-0f34-4daf-b089-538429a82ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:51.801566 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab5d54-0f34-4daf-b089-538429a82ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:51.802019 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab5d54-0f34-4daf-b089-538429a82ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:51.802466 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab5d54-0f34-4daf-b089-538429a82ec6 admin admin] PATH_INFO: `/v3/projects/b2f30e7cfc3c40bda18ce9e91bcfcbdd` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:51.804100 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab5d54-0f34-4daf-b089-538429a82ec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2f30e7cfc3c40bda18ce9e91bcfcbdd)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:51.806097 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6576577-f516-4a03-9dbc-1bb1344ad15b service neutron] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:51.807286 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab5d54-0f34-4daf-b089-538429a82ec6 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:51.812116 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dac66d-e6a9-400d-820c-9e821b5be8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:51.812958 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dac66d-e6a9-400d-820c-9e821b5be8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:51.813256 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dac66d-e6a9-400d-820c-9e821b5be8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:51.813538 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dac66d-e6a9-400d-820c-9e821b5be8f2 admin admin] PATH_INFO: `/v3/projects/60ae8c809a84419a98f50f025d3434ca` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:51.814774 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dac66d-e6a9-400d-820c-9e821b5be8f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60ae8c809a84419a98f50f025d3434ca)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:51.816704 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dac66d-e6a9-400d-820c-9e821b5be8f2 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:51.881941 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-91dac66d-e6a9-400d-820c-9e821b5be8f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60ae8c809a84419a98f50f025d3434ca', 'request_id': 'req-91dac66d-e6a9-400d-820c-9e821b5be8f2'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:51.896045 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-91dac66d-e6a9-400d-820c-9e821b5be8f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60ae8c809a84419a98f50f025d3434ca', 'request_id': 'req-91dac66d-e6a9-400d-820c-9e821b5be8f2'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:51.903390 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-91dac66d-e6a9-400d-820c-9e821b5be8f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60ae8c809a84419a98f50f025d3434ca', 'request_id': 'req-91dac66d-e6a9-400d-820c-9e821b5be8f2'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:51.920262 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-91dac66d-e6a9-400d-820c-9e821b5be8f2 admin admin] The token cache is being invalidate because project 60ae8c809a84419a98f50f025d3434ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:51.920731 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-91dac66d-e6a9-400d-820c-9e821b5be8f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:51.922316 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-91dac66d-e6a9-400d-820c-9e821b5be8f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:51.928256 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 864/1744] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:51 2021] DELETE /identity/v3/projects/60ae8c809a84419a98f50f025d3434ca => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:51.929375 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dac66d-e6a9-400d-820c-9e821b5be8f2 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:51.931110 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-91dac66d-e6a9-400d-820c-9e821b5be8f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:51.947136 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-42ab5d54-0f34-4daf-b089-538429a82ec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2f30e7cfc3c40bda18ce9e91bcfcbdd', 'request_id': 'req-42ab5d54-0f34-4daf-b089-538429a82ec6'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:51.962610 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-42ab5d54-0f34-4daf-b089-538429a82ec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2f30e7cfc3c40bda18ce9e91bcfcbdd', 'request_id': 'req-42ab5d54-0f34-4daf-b089-538429a82ec6'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:51.977921 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-42ab5d54-0f34-4daf-b089-538429a82ec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2f30e7cfc3c40bda18ce9e91bcfcbdd', 'request_id': 'req-42ab5d54-0f34-4daf-b089-538429a82ec6'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:52.013931 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-42ab5d54-0f34-4daf-b089-538429a82ec6 admin admin] The token cache is being invalidate because project b2f30e7cfc3c40bda18ce9e91bcfcbdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:52.014876 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-42ab5d54-0f34-4daf-b089-538429a82ec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:52.016290 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-42ab5d54-0f34-4daf-b089-538429a82ec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:52.025852 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 881/1745] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:51 2021] DELETE /identity/v3/projects/b2f30e7cfc3c40bda18ce9e91bcfcbdd => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:52.027777 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab5d54-0f34-4daf-b089-538429a82ec6 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:52.030011 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-42ab5d54-0f34-4daf-b089-538429a82ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:52.055526 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dac66d-e6a9-400d-820c-9e821b5be8f2 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:52.146978 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab5d54-0f34-4daf-b089-538429a82ec6 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:52.153953 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a45e77-33d3-4af2-9524-6484ac5a67b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:52.156053 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a45e77-33d3-4af2-9524-6484ac5a67b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:52.157503 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6ef9f-303c-4937-b3ce-82bfe0ac8ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:52.159405 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a45e77-33d3-4af2-9524-6484ac5a67b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:52.159900 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a45e77-33d3-4af2-9524-6484ac5a67b1 admin admin] PATH_INFO: `/v3/users/029b7e9dc00842cb9893e03efff16de3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:52.160013 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6ef9f-303c-4937-b3ce-82bfe0ac8ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:52.160473 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6ef9f-303c-4937-b3ce-82bfe0ac8ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:52.161161 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6ef9f-303c-4937-b3ce-82bfe0ac8ffa admin admin] PATH_INFO: `/v3/users/6a9e699aa666421c88f62e8e0267b53d` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:52.161614 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a45e77-33d3-4af2-9524-6484ac5a67b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=029b7e9dc00842cb9893e03efff16de3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:52.163762 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a45e77-33d3-4af2-9524-6484ac5a67b1 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:52.164898 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6ef9f-303c-4937-b3ce-82bfe0ac8ffa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a9e699aa666421c88f62e8e0267b53d)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:52.166964 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6ef9f-303c-4937-b3ce-82bfe0ac8ffa admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:52.281219 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-bbd6ef9f-303c-4937-b3ce-82bfe0ac8ffa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a9e699aa666421c88f62e8e0267b53d'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:52.282078 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-bbd6ef9f-303c-4937-b3ce-82bfe0ac8ffa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a9e699aa666421c88f62e8e0267b53d'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:52.284334 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-83a45e77-33d3-4af2-9524-6484ac5a67b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '029b7e9dc00842cb9893e03efff16de3'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:52.286890 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-83a45e77-33d3-4af2-9524-6484ac5a67b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '029b7e9dc00842cb9893e03efff16de3'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:52.296831 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-bbd6ef9f-303c-4937-b3ce-82bfe0ac8ffa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a9e699aa666421c88f62e8e0267b53d'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:52.306378 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-bbd6ef9f-303c-4937-b3ce-82bfe0ac8ffa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a9e699aa666421c88f62e8e0267b53d'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:52.319280 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-bbd6ef9f-303c-4937-b3ce-82bfe0ac8ffa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a9e699aa666421c88f62e8e0267b53d'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:52.329116 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-83a45e77-33d3-4af2-9524-6484ac5a67b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '029b7e9dc00842cb9893e03efff16de3'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:52.331423 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 865/1746] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:51 2021] DELETE /identity/v3/users/6a9e699aa666421c88f62e8e0267b53d => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:52.341778 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-83a45e77-33d3-4af2-9524-6484ac5a67b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '029b7e9dc00842cb9893e03efff16de3'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:52.355045 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-83a45e77-33d3-4af2-9524-6484ac5a67b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '029b7e9dc00842cb9893e03efff16de3'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:52.363144 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 882/1747] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:52 2021] DELETE /identity/v3/users/029b7e9dc00842cb9893e03efff16de3 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:53.136114 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6ef9f-303c-4937-b3ce-82bfe0ac8ffa admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:53.136114 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-bbd6ef9f-303c-4937-b3ce-82bfe0ac8ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:53.139438 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a45e77-33d3-4af2-9524-6484ac5a67b1 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:53.142040 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-83a45e77-33d3-4af2-9524-6484ac5a67b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:53.217749 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6ef9f-303c-4937-b3ce-82bfe0ac8ffa admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:53.263188 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a45e77-33d3-4af2-9524-6484ac5a67b1 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:53.271015 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8db20c-e6df-4a6f-8de6-7a07698bb6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:53.272419 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8db20c-e6df-4a6f-8de6-7a07698bb6a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:53.273049 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8db20c-e6df-4a6f-8de6-7a07698bb6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:53.273877 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8db20c-e6df-4a6f-8de6-7a07698bb6a4 admin admin] PATH_INFO: `/v3/projects/d3727007468043628fad76975c69c52b` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:53.276415 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8db20c-e6df-4a6f-8de6-7a07698bb6a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3727007468043628fad76975c69c52b)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:53.280337 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8db20c-e6df-4a6f-8de6-7a07698bb6a4 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:53.310581 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d1ac6-9ee1-4173-b3bf-23e5dd20b165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:53.311893 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d1ac6-9ee1-4173-b3bf-23e5dd20b165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:53.312371 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d1ac6-9ee1-4173-b3bf-23e5dd20b165 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:53.312900 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d1ac6-9ee1-4173-b3bf-23e5dd20b165 admin admin] PATH_INFO: `/v3/projects/115708cd0f0846789aa7a721c9ce0930` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:53.315559 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d1ac6-9ee1-4173-b3bf-23e5dd20b165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=115708cd0f0846789aa7a721c9ce0930)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:53.319479 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d1ac6-9ee1-4173-b3bf-23e5dd20b165 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:53.358097 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-cc8db20c-e6df-4a6f-8de6-7a07698bb6a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3727007468043628fad76975c69c52b', 'request_id': 'req-cc8db20c-e6df-4a6f-8de6-7a07698bb6a4'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:53.363622 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-cc8db20c-e6df-4a6f-8de6-7a07698bb6a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3727007468043628fad76975c69c52b', 'request_id': 'req-cc8db20c-e6df-4a6f-8de6-7a07698bb6a4'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:53.371791 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-cc8db20c-e6df-4a6f-8de6-7a07698bb6a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3727007468043628fad76975c69c52b', 'request_id': 'req-cc8db20c-e6df-4a6f-8de6-7a07698bb6a4'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:53.383986 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ef7d1ac6-9ee1-4173-b3bf-23e5dd20b165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '115708cd0f0846789aa7a721c9ce0930', 'request_id': 'req-ef7d1ac6-9ee1-4173-b3bf-23e5dd20b165'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:53.395159 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-cc8db20c-e6df-4a6f-8de6-7a07698bb6a4 admin admin] The token cache is being invalidate because project d3727007468043628fad76975c69c52b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:53.395627 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-cc8db20c-e6df-4a6f-8de6-7a07698bb6a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:53.396446 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-cc8db20c-e6df-4a6f-8de6-7a07698bb6a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:53.396937 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ef7d1ac6-9ee1-4173-b3bf-23e5dd20b165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '115708cd0f0846789aa7a721c9ce0930', 'request_id': 'req-ef7d1ac6-9ee1-4173-b3bf-23e5dd20b165'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:53.398309 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 883/1748] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:53 2021] DELETE /identity/v3/projects/d3727007468043628fad76975c69c52b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:53.404657 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc518ae2-ca50-4abd-a597-9b92e2502ffc None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:53.404985 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc518ae2-ca50-4abd-a597-9b92e2502ffc None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:53.405283 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc518ae2-ca50-4abd-a597-9b92e2502ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:53.408284 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ef7d1ac6-9ee1-4173-b3bf-23e5dd20b165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '115708cd0f0846789aa7a721c9ce0930', 'request_id': 'req-ef7d1ac6-9ee1-4173-b3bf-23e5dd20b165'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:53.429976 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ef7d1ac6-9ee1-4173-b3bf-23e5dd20b165 admin admin] The token cache is being invalidate because project 115708cd0f0846789aa7a721c9ce0930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:53.430434 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ef7d1ac6-9ee1-4173-b3bf-23e5dd20b165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:53.431863 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ef7d1ac6-9ee1-4173-b3bf-23e5dd20b165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:53.434342 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 866/1749] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:53 2021] DELETE /identity/v3/projects/115708cd0f0846789aa7a721c9ce0930 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:53.435056 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-cc518ae2-ca50-4abd-a597-9b92e2502ffc None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:53.436521 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-cc518ae2-ca50-4abd-a597-9b92e2502ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:53.441758 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1ac21-65ef-462c-8603-a7c65ec0c744 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:53.442381 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1ac21-65ef-462c-8603-a7c65ec0c744 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:53.443475 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1ac21-65ef-462c-8603-a7c65ec0c744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:53.475502 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-5dd1ac21-65ef-462c-8603-a7c65ec0c744 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:53.476959 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-5dd1ac21-65ef-462c-8603-a7c65ec0c744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:53.523016 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 884/1750] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:53.534999 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fae4ca-d5a0-47ef-a957-597a9a4b6782 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:53.535320 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fae4ca-d5a0-47ef-a957-597a9a4b6782 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:53.535659 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fae4ca-d5a0-47ef-a957-597a9a4b6782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:53.559556 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-a9fae4ca-d5a0-47ef-a957-597a9a4b6782 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:53.560656 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-a9fae4ca-d5a0-47ef-a957-597a9a4b6782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:53.567545 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 867/1751] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:53.580055 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 885/1752] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:53.584491 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078b5d2-7d2e-465d-841e-fab1438ada3d None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:53.584995 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078b5d2-7d2e-465d-841e-fab1438ada3d None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:53.585449 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078b5d2-7d2e-465d-841e-fab1438ada3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:53.586385 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fae4ca-d5a0-47ef-a957-597a9a4b6782 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:53.601444 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fae4ca-d5a0-47ef-a957-597a9a4b6782 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:53.608744 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72902c63-3395-4484-ae24-e2db1d9e2a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:53.609785 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72902c63-3395-4484-ae24-e2db1d9e2a5f admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:53.610239 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72902c63-3395-4484-ae24-e2db1d9e2a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:53.610695 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72902c63-3395-4484-ae24-e2db1d9e2a5f admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:53.611911 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72902c63-3395-4484-ae24-e2db1d9e2a5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:39:53.612400 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72902c63-3395-4484-ae24-e2db1d9e2a5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:53.615270 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72902c63-3395-4484-ae24-e2db1d9e2a5f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:53.627518 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-6078b5d2-7d2e-465d-841e-fab1438ada3d None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:53.629315 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-6078b5d2-7d2e-465d-841e-fab1438ada3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:53.644466 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 886/1753] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:39:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:39:53.645599 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72902c63-3395-4484-ae24-e2db1d9e2a5f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:53.646752 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 868/1754] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:53.652002 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078b5d2-7d2e-465d-841e-fab1438ada3d None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:53.662842 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078b5d2-7d2e-465d-841e-fab1438ada3d None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:53.664772 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72902c63-3395-4484-ae24-e2db1d9e2a5f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:53.670622 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7cec4-34f9-403e-a2a1-279079359aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:53.670906 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ca543-a86a-456a-9994-99d1bcfb53ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:53.671742 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ca543-a86a-456a-9994-99d1bcfb53ca admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:53.671861 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7cec4-34f9-403e-a2a1-279079359aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:53.672075 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7cec4-34f9-403e-a2a1-279079359aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:53.672429 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7cec4-34f9-403e-a2a1-279079359aa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:53.672755 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ca543-a86a-456a-9994-99d1bcfb53ca admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:53.673271 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ca543-a86a-456a-9994-99d1bcfb53ca admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:53.673820 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7cec4-34f9-403e-a2a1-279079359aa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:39:53.674188 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7cec4-34f9-403e-a2a1-279079359aa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:53.674548 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ca543-a86a-456a-9994-99d1bcfb53ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:53.676078 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7cec4-34f9-403e-a2a1-279079359aa0 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:53.677468 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ca543-a86a-456a-9994-99d1bcfb53ca admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:53.691758 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 869/1755] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:39:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:39:53.696536 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7cec4-34f9-403e-a2a1-279079359aa0 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:53.721080 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7cec4-34f9-403e-a2a1-279079359aa0 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:53.724294 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 887/1756] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:53 2021] POST /identity/v3/projects => generated 399 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:53.728299 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ca543-a86a-456a-9994-99d1bcfb53ca admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:53.729651 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5cb93-6ea6-4242-bfc9-5c063b7dbb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:53.730659 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5cb93-6ea6-4242-bfc9-5c063b7dbb1d admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:53.731059 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5cb93-6ea6-4242-bfc9-5c063b7dbb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:53.731453 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5cb93-6ea6-4242-bfc9-5c063b7dbb1d admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:53.732219 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5cb93-6ea6-4242-bfc9-5c063b7dbb1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:53.734583 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5cb93-6ea6-4242-bfc9-5c063b7dbb1d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:53.777428 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 870/1757] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:53 2021] POST /identity/v3/projects => generated 387 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:53.783354 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5cb93-6ea6-4242-bfc9-5c063b7dbb1d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:53.854923 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ca543-a86a-456a-9994-99d1bcfb53ca admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:53.905723 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5cb93-6ea6-4242-bfc9-5c063b7dbb1d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:53.912146 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79ed64-05bc-4e87-be33-daf487c17ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:53.913613 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79ed64-05bc-4e87-be33-daf487c17ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:53.914021 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79ed64-05bc-4e87-be33-daf487c17ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:53.914410 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79ed64-05bc-4e87-be33-daf487c17ab2 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:53.915175 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79ed64-05bc-4e87-be33-daf487c17ab2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:53.918141 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79ed64-05bc-4e87-be33-daf487c17ab2 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:53.946028 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 871/1758] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:53 2021] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:53.947358 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79ed64-05bc-4e87-be33-daf487c17ab2 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:53.960350 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c0658-24dd-44e1-bad8-5956715d374f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:53.961370 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c0658-24dd-44e1-bad8-5956715d374f admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:53.962321 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c0658-24dd-44e1-bad8-5956715d374f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:53.962950 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c0658-24dd-44e1-bad8-5956715d374f admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:53.963067 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79ed64-05bc-4e87-be33-daf487c17ab2 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:53.963985 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c0658-24dd-44e1-bad8-5956715d374f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:53.966645 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c0658-24dd-44e1-bad8-5956715d374f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:53.981118 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7e84d-ef7e-4e95-aa99-29abb12a13af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:53.982908 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7e84d-ef7e-4e95-aa99-29abb12a13af admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:53.984986 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7e84d-ef7e-4e95-aa99-29abb12a13af admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:53.986195 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7e84d-ef7e-4e95-aa99-29abb12a13af admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:53.988259 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7e84d-ef7e-4e95-aa99-29abb12a13af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:53.991946 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7e84d-ef7e-4e95-aa99-29abb12a13af admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:54.004816 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 872/1759] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:53 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:54.009155 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7e84d-ef7e-4e95-aa99-29abb12a13af admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:54.012390 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 888/1760] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:53 2021] POST /identity/v3/users => generated 300 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:39:54.016560 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c0658-24dd-44e1-bad8-5956715d374f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:54.020630 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7e84d-ef7e-4e95-aa99-29abb12a13af admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:54.025244 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbfb44-1832-4b9c-8ccd-f5cf26e3db38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:54.025868 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbfb44-1832-4b9c-8ccd-f5cf26e3db38 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:54.026155 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbfb44-1832-4b9c-8ccd-f5cf26e3db38 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:54.026435 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbfb44-1832-4b9c-8ccd-f5cf26e3db38 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:54.026736 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c0658-24dd-44e1-bad8-5956715d374f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:54.027121 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbfb44-1832-4b9c-8ccd-f5cf26e3db38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:54.028686 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbfb44-1832-4b9c-8ccd-f5cf26e3db38 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:54.031233 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdcea9c-691a-4475-beff-3b5cb32885d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:54.031835 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcea9c-691a-4475-beff-3b5cb32885d6 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:54.032121 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcea9c-691a-4475-beff-3b5cb32885d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:54.032407 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcea9c-691a-4475-beff-3b5cb32885d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:54.033142 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdcea9c-691a-4475-beff-3b5cb32885d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:54.034724 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdcea9c-691a-4475-beff-3b5cb32885d6 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:54.042351 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 873/1761] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:54 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:39:54.046422 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 889/1762] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:54 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:39:54.047268 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbfb44-1832-4b9c-8ccd-f5cf26e3db38 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:54.050627 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdcea9c-691a-4475-beff-3b5cb32885d6 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:54.058696 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbfb44-1832-4b9c-8ccd-f5cf26e3db38 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:54.061039 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdcea9c-691a-4475-beff-3b5cb32885d6 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:54.063311 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c842c15-4a54-47f2-8576-cbded2bcdab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:54.064148 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c842c15-4a54-47f2-8576-cbded2bcdab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:54.064444 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c842c15-4a54-47f2-8576-cbded2bcdab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:54.064705 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c842c15-4a54-47f2-8576-cbded2bcdab4 admin admin] PATH_INFO: `/v3/projects/8d71ad92eb884237bc8eb9416c2512be/users/33fb2f8120714e6799f217ffcb6a3859/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:54.065854 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27971b02-96a8-4fe4-9a85-52c7d03d32ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:54.066428 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27971b02-96a8-4fe4-9a85-52c7d03d32ee admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:54.066780 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27971b02-96a8-4fe4-9a85-52c7d03d32ee admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:54.067002 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27971b02-96a8-4fe4-9a85-52c7d03d32ee admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:54.067728 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27971b02-96a8-4fe4-9a85-52c7d03d32ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:54.069398 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27971b02-96a8-4fe4-9a85-52c7d03d32ee admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:54.081107 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 890/1763] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:54 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:39:54.085273 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27971b02-96a8-4fe4-9a85-52c7d03d32ee admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:54.086444 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c842c15-4a54-47f2-8576-cbded2bcdab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d71ad92eb884237bc8eb9416c2512be, user_id=33fb2f8120714e6799f217ffcb6a3859, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:54.089764 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c842c15-4a54-47f2-8576-cbded2bcdab4 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:54.095321 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27971b02-96a8-4fe4-9a85-52c7d03d32ee admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:54.100652 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b360623-a60d-4009-8740-40d4837950d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:54.101595 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b360623-a60d-4009-8740-40d4837950d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:54.101886 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b360623-a60d-4009-8740-40d4837950d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:54.102170 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b360623-a60d-4009-8740-40d4837950d6 admin admin] PATH_INFO: `/v3/projects/d6c6965ef3444ea7a421f56e18d95a1e/users/3072edefeac94f9ebb5c2b7fd3b736dd/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:54.110459 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 874/1764] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:54 2021] PUT /identity/v3/projects/8d71ad92eb884237bc8eb9416c2512be/users/33fb2f8120714e6799f217ffcb6a3859/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:54.114230 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac073dcd-a615-4743-887c-81b6d1370c62 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:54.114526 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac073dcd-a615-4743-887c-81b6d1370c62 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:54.114810 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac073dcd-a615-4743-887c-81b6d1370c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:54.123334 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b360623-a60d-4009-8740-40d4837950d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c6965ef3444ea7a421f56e18d95a1e, user_id=3072edefeac94f9ebb5c2b7fd3b736dd, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:54.126044 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b360623-a60d-4009-8740-40d4837950d6 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:54.140910 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 891/1765] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:54 2021] PUT /identity/v3/projects/d6c6965ef3444ea7a421f56e18d95a1e/users/3072edefeac94f9ebb5c2b7fd3b736dd/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:39:54.154069 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-ac073dcd-a615-4743-887c-81b6d1370c62 None None] MFA Rules not processed for user `33fb2f8120714e6799f217ffcb6a3859`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:54.155246 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-ac073dcd-a615-4743-887c-81b6d1370c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:54.156740 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ac636-2644-495d-b918-c543bc98122d None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:54.157371 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ac636-2644-495d-b918-c543bc98122d None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:54.157817 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ac636-2644-495d-b918-c543bc98122d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:54.200089 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-ac5ac636-2644-495d-b918-c543bc98122d None None] MFA Rules not processed for user `3072edefeac94f9ebb5c2b7fd3b736dd`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:54.202138 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-ac5ac636-2644-495d-b918-c543bc98122d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:54.247149 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 875/1766] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:54 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:54.251535 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac073dcd-a615-4743-887c-81b6d1370c62 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:54.315525 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 892/1767] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:54 2021] POST /identity/v3/auth/tokens => generated 3706 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:54.317037 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ac636-2644-495d-b918-c543bc98122d None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:54.332126 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac073dcd-a615-4743-887c-81b6d1370c62 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:54.332707 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ac636-2644-495d-b918-c543bc98122d None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:54.338942 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886172e3-1492-490e-b30a-f27ebf22bf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:54.339320 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf98bd-e5ae-4b81-abb1-76905f0098ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:54.339517 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886172e3-1492-490e-b30a-f27ebf22bf7b admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:54.339782 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886172e3-1492-490e-b30a-f27ebf22bf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:54.340066 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886172e3-1492-490e-b30a-f27ebf22bf7b admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:54.340167 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf98bd-e5ae-4b81-abb1-76905f0098ac admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:54.340510 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf98bd-e5ae-4b81-abb1-76905f0098ac admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:54.340723 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886172e3-1492-490e-b30a-f27ebf22bf7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:54.340907 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf98bd-e5ae-4b81-abb1-76905f0098ac admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:54.341761 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf98bd-e5ae-4b81-abb1-76905f0098ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:54.344010 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf98bd-e5ae-4b81-abb1-76905f0098ac admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:54.349058 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886172e3-1492-490e-b30a-f27ebf22bf7b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:54.383828 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 893/1768] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:54 2021] POST /identity/v3/projects => generated 399 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:39:54.391472 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf98bd-e5ae-4b81-abb1-76905f0098ac admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:54.406497 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 876/1769] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:54 2021] POST /identity/v3/projects => generated 387 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:54.411559 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886172e3-1492-490e-b30a-f27ebf22bf7b admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:54.469666 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf98bd-e5ae-4b81-abb1-76905f0098ac admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:54.500252 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886172e3-1492-490e-b30a-f27ebf22bf7b admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:54.505465 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3538933-88fc-45e9-b3fa-804db96570e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:54.506084 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3538933-88fc-45e9-b3fa-804db96570e0 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:54.506377 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3538933-88fc-45e9-b3fa-804db96570e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:54.506679 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3538933-88fc-45e9-b3fa-804db96570e0 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:54.507333 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3538933-88fc-45e9-b3fa-804db96570e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:54.509365 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3538933-88fc-45e9-b3fa-804db96570e0 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:54.533646 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 877/1770] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:54 2021] POST /identity/v3/users => generated 300 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:39:54.537936 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3538933-88fc-45e9-b3fa-804db96570e0 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:54.573430 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3538933-88fc-45e9-b3fa-804db96570e0 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:54.586449 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94012d-4727-408a-bee2-11812de65cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:54.587078 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94012d-4727-408a-bee2-11812de65cce admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:54.587375 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94012d-4727-408a-bee2-11812de65cce admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:54.587804 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94012d-4727-408a-bee2-11812de65cce admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:54.588637 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94012d-4727-408a-bee2-11812de65cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:54.590967 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94012d-4727-408a-bee2-11812de65cce admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:54.604019 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 878/1771] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:54 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:39:54.607774 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94012d-4727-408a-bee2-11812de65cce admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:54.619818 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94012d-4727-408a-bee2-11812de65cce admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:54.636648 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6670e-117e-4f08-ad37-cec80b7b84b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:54.637910 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6670e-117e-4f08-ad37-cec80b7b84b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:54.638449 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6670e-117e-4f08-ad37-cec80b7b84b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:54.638922 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6670e-117e-4f08-ad37-cec80b7b84b8 admin admin] PATH_INFO: `/v3/projects/2e83dfe1aa274510b7e7d48f56e60571/users/2c9f9df4c81e4541bd927670fbc653d0/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:54.643403 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05292ac-4e4a-49eb-9836-0e01bc09f8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:54.644180 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05292ac-4e4a-49eb-9836-0e01bc09f8a2 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:54.644572 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05292ac-4e4a-49eb-9836-0e01bc09f8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:54.644987 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05292ac-4e4a-49eb-9836-0e01bc09f8a2 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:54.645763 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05292ac-4e4a-49eb-9836-0e01bc09f8a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:54.649993 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05292ac-4e4a-49eb-9836-0e01bc09f8a2 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:54.696309 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6670e-117e-4f08-ad37-cec80b7b84b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e83dfe1aa274510b7e7d48f56e60571, user_id=2c9f9df4c81e4541bd927670fbc653d0, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:54.702382 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6670e-117e-4f08-ad37-cec80b7b84b8 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:54.710174 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 894/1772] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:54 2021] POST /identity/v3/users => generated 306 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:39:54.711444 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05292ac-4e4a-49eb-9836-0e01bc09f8a2 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:54.729972 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05292ac-4e4a-49eb-9836-0e01bc09f8a2 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:54.731906 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 879/1773] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:54 2021] PUT /identity/v3/projects/2e83dfe1aa274510b7e7d48f56e60571/users/2c9f9df4c81e4541bd927670fbc653d0/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:54.737265 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6670e-117e-4f08-ad37-cec80b7b84b8 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:54.840459 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3f340-f530-4549-9c64-2347eb61b444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:54.841456 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3f340-f530-4549-9c64-2347eb61b444 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:54.843597 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3f340-f530-4549-9c64-2347eb61b444 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:54.844018 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3f340-f530-4549-9c64-2347eb61b444 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:54.845625 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3f340-f530-4549-9c64-2347eb61b444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:54.847939 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3f340-f530-4549-9c64-2347eb61b444 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:54.891572 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 895/1774] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:54 2021] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:54.892943 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3f340-f530-4549-9c64-2347eb61b444 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:54.911441 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3f340-f530-4549-9c64-2347eb61b444 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:54.922615 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe69c79-0586-433f-9a40-b7e00daf35d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:54.924101 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe69c79-0586-433f-9a40-b7e00daf35d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:54.924224 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6670e-117e-4f08-ad37-cec80b7b84b8 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:54.924620 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe69c79-0586-433f-9a40-b7e00daf35d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:54.925379 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe69c79-0586-433f-9a40-b7e00daf35d4 admin admin] PATH_INFO: `/v3/projects/e510d3b81b9545c6aeff8043375fff53/users/83d046db359b4008a4fdb8c32ad8e84a/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:54.936832 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37e875-5a9d-4135-8680-ed31bb1c1ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:54.938147 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37e875-5a9d-4135-8680-ed31bb1c1ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:54.938525 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37e875-5a9d-4135-8680-ed31bb1c1ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:54.938887 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37e875-5a9d-4135-8680-ed31bb1c1ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:54.939688 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37e875-5a9d-4135-8680-ed31bb1c1ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:54.944529 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37e875-5a9d-4135-8680-ed31bb1c1ab1 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:54.972417 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 880/1775] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:54 2021] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:54.976578 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37e875-5a9d-4135-8680-ed31bb1c1ab1 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:54.979832 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe69c79-0586-433f-9a40-b7e00daf35d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e510d3b81b9545c6aeff8043375fff53, user_id=83d046db359b4008a4fdb8c32ad8e84a, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:54.983399 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe69c79-0586-433f-9a40-b7e00daf35d4 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:54.990681 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37e875-5a9d-4135-8680-ed31bb1c1ab1 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:55.006392 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e83d1-35a7-4049-92df-aa586e5fc4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:55.007030 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 896/1776] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:54 2021] PUT /identity/v3/projects/e510d3b81b9545c6aeff8043375fff53/users/83d046db359b4008a4fdb8c32ad8e84a/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:55.008839 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e83d1-35a7-4049-92df-aa586e5fc4f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:55.009241 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e83d1-35a7-4049-92df-aa586e5fc4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:55.010874 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e83d1-35a7-4049-92df-aa586e5fc4f6 admin admin] PATH_INFO: `/v3/projects/2e83dfe1aa274510b7e7d48f56e60571/users/2c9f9df4c81e4541bd927670fbc653d0/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:55.014470 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe69c79-0586-433f-9a40-b7e00daf35d4 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:55.016080 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e83d1-35a7-4049-92df-aa586e5fc4f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e83dfe1aa274510b7e7d48f56e60571, user_id=2c9f9df4c81e4541bd927670fbc653d0, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:55.029909 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e83d1-35a7-4049-92df-aa586e5fc4f6 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:55.044827 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 881/1777] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:54 2021] PUT /identity/v3/projects/2e83dfe1aa274510b7e7d48f56e60571/users/2c9f9df4c81e4541bd927670fbc653d0/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:39:55.056713 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd744e-c446-4a45-abce-154341cb952f None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:55.057153 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd744e-c446-4a45-abce-154341cb952f None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:55.057418 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd744e-c446-4a45-abce-154341cb952f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:55.135030 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-53fd744e-c446-4a45-abce-154341cb952f None None] MFA Rules not processed for user `2c9f9df4c81e4541bd927670fbc653d0`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:55.138598 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-53fd744e-c446-4a45-abce-154341cb952f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:55.197139 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe69c79-0586-433f-9a40-b7e00daf35d4 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:55.286038 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 882/1778] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:55 2021] POST /identity/v3/auth/tokens => generated 3761 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:55.292219 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd744e-c446-4a45-abce-154341cb952f None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:55.297440 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-53fd744e-c446-4a45-abce-154341cb952f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:55.317881 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c22934-fee0-4c8f-9e5a-64ba6de27718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:55.318459 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c22934-fee0-4c8f-9e5a-64ba6de27718 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:55.318761 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c22934-fee0-4c8f-9e5a-64ba6de27718 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:55.319047 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c22934-fee0-4c8f-9e5a-64ba6de27718 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:55.319760 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c22934-fee0-4c8f-9e5a-64ba6de27718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:55.321415 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c22934-fee0-4c8f-9e5a-64ba6de27718 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:55.336353 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 897/1779] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:55 2021] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:55.341378 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c22934-fee0-4c8f-9e5a-64ba6de27718 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:55.357448 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c22934-fee0-4c8f-9e5a-64ba6de27718 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:55.373205 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e299ca-7b32-47a1-8b80-8c59dc340e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:55.374058 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e299ca-7b32-47a1-8b80-8c59dc340e14 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:55.374352 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e299ca-7b32-47a1-8b80-8c59dc340e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:55.374639 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e299ca-7b32-47a1-8b80-8c59dc340e14 admin admin] PATH_INFO: `/v3/projects/e510d3b81b9545c6aeff8043375fff53/users/83d046db359b4008a4fdb8c32ad8e84a/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:55.378330 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e299ca-7b32-47a1-8b80-8c59dc340e14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e510d3b81b9545c6aeff8043375fff53, user_id=83d046db359b4008a4fdb8c32ad8e84a, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:55.381774 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e299ca-7b32-47a1-8b80-8c59dc340e14 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:55.418572 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd744e-c446-4a45-abce-154341cb952f None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:55.443285 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 898/1780] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:55 2021] PUT /identity/v3/projects/e510d3b81b9545c6aeff8043375fff53/users/83d046db359b4008a4fdb8c32ad8e84a/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:55.446216 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e10f4-94f6-407c-af95-cfe028ac199a None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:55.446838 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e10f4-94f6-407c-af95-cfe028ac199a None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:55.447910 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e10f4-94f6-407c-af95-cfe028ac199a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:55.518357 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-c81e10f4-94f6-407c-af95-cfe028ac199a None None] MFA Rules not processed for user `83d046db359b4008a4fdb8c32ad8e84a`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:55.520931 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-c81e10f4-94f6-407c-af95-cfe028ac199a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:55.570661 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b66e7a-5cf1-4720-9eff-7ec615e3aced service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:55.571857 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b66e7a-5cf1-4720-9eff-7ec615e3aced service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:55.573126 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b66e7a-5cf1-4720-9eff-7ec615e3aced service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:55.573571 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b66e7a-5cf1-4720-9eff-7ec615e3aced service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:55.704949 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b66e7a-5cf1-4720-9eff-7ec615e3aced service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:55.707484 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b66e7a-5cf1-4720-9eff-7ec615e3aced service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:55.738438 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 883/1781] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:55 2021] GET /identity/v3/auth/tokens => generated 3761 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:39:55.741461 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 899/1782] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:55 2021] POST /identity/v3/auth/tokens => generated 3773 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:55.791928 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b66e7a-5cf1-4720-9eff-7ec615e3aced service cinder] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:55.794970 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e5b66e7a-5cf1-4720-9eff-7ec615e3aced service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:55.811784 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b66e7a-5cf1-4720-9eff-7ec615e3aced service cinder] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:55.816210 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f768b-488e-41d5-9538-a68d2ae2dabd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:55.817200 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f768b-488e-41d5-9538-a68d2ae2dabd service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:55.817662 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f768b-488e-41d5-9538-a68d2ae2dabd service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:55.818202 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f768b-488e-41d5-9538-a68d2ae2dabd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:55.830698 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f768b-488e-41d5-9538-a68d2ae2dabd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:55.832520 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f768b-488e-41d5-9538-a68d2ae2dabd service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:55.858432 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 884/1783] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:55 2021] GET /identity/v3/auth/tokens => generated 3773 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:55.959761 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e10f4-94f6-407c-af95-cfe028ac199a None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:56.081617 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e10f4-94f6-407c-af95-cfe028ac199a None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:56.087787 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f82f82-3f04-4d1a-8068-bc45aa213c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:56.089385 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f82f82-3f04-4d1a-8068-bc45aa213c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:56.089848 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f82f82-3f04-4d1a-8068-bc45aa213c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:56.090302 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f82f82-3f04-4d1a-8068-bc45aa213c01 admin admin] PATH_INFO: `/v3/users/33fb2f8120714e6799f217ffcb6a3859` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:56.091628 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f82f82-3f04-4d1a-8068-bc45aa213c01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33fb2f8120714e6799f217ffcb6a3859)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:56.097861 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f82f82-3f04-4d1a-8068-bc45aa213c01 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:56.192420 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f768b-488e-41d5-9538-a68d2ae2dabd service cinder] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:56.204235 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f768b-488e-41d5-9538-a68d2ae2dabd service cinder] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:56.208959 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6e6b9-c5d3-4bf4-b84c-ad5b23410af6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:56.209691 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6e6b9-c5d3-4bf4-b84c-ad5b23410af6 service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:56.210122 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6e6b9-c5d3-4bf4-b84c-ad5b23410af6 service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:56.210275 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6e6b9-c5d3-4bf4-b84c-ad5b23410af6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:56.226814 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-c2f82f82-3f04-4d1a-8068-bc45aa213c01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33fb2f8120714e6799f217ffcb6a3859'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:56.229529 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-c2f82f82-3f04-4d1a-8068-bc45aa213c01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33fb2f8120714e6799f217ffcb6a3859'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:56.249576 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-c2f82f82-3f04-4d1a-8068-bc45aa213c01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33fb2f8120714e6799f217ffcb6a3859'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:56.260573 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-c2f82f82-3f04-4d1a-8068-bc45aa213c01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33fb2f8120714e6799f217ffcb6a3859'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:56.282261 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-c2f82f82-3f04-4d1a-8068-bc45aa213c01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33fb2f8120714e6799f217ffcb6a3859'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:56.288211 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 900/1784] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:55 2021] DELETE /identity/v3/users/33fb2f8120714e6799f217ffcb6a3859 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:56.289754 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a4281-9c95-4d8d-b43b-1328d82807fd None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:56.290106 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a4281-9c95-4d8d-b43b-1328d82807fd None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:56.290391 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a4281-9c95-4d8d-b43b-1328d82807fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:56.326380 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-f39a4281-9c95-4d8d-b43b-1328d82807fd None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:56.328504 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-f39a4281-9c95-4d8d-b43b-1328d82807fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:56.350956 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6e6b9-c5d3-4bf4-b84c-ad5b23410af6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:56.354295 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6e6b9-c5d3-4bf4-b84c-ad5b23410af6 service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:56.389151 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 885/1785] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:56 2021] GET /identity/v3/auth/tokens => generated 3706 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:39:56.571153 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 901/1786] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:56.597402 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6e6b9-c5d3-4bf4-b84c-ad5b23410af6 service cinder] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:56.600019 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-39b6e6b9-c5d3-4bf4-b84c-ad5b23410af6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:56.751911 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6e6b9-c5d3-4bf4-b84c-ad5b23410af6 service cinder] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:56.919595 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07ffb2-7cad-4ff8-bf3f-7699b7be6e00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:56.920314 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07ffb2-7cad-4ff8-bf3f-7699b7be6e00 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:56.920738 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07ffb2-7cad-4ff8-bf3f-7699b7be6e00 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:56.921127 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07ffb2-7cad-4ff8-bf3f-7699b7be6e00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:56.940301 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07ffb2-7cad-4ff8-bf3f-7699b7be6e00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:56.944082 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07ffb2-7cad-4ff8-bf3f-7699b7be6e00 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:56.971794 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 886/1787] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:58.122996 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063eddb9-3d27-4c0e-a6ad-bd9a0711338e None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:58.123527 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063eddb9-3d27-4c0e-a6ad-bd9a0711338e None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:58.123601 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063eddb9-3d27-4c0e-a6ad-bd9a0711338e None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:58.125527 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 902/1788] 10.222.0.64 () {54 vars in 921 bytes} [Thu Dec 16 14:39:58 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:39:58.140435 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81428d83-c2cc-49bb-8d7c-48d6dca94a9a None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:58.140435 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81428d83-c2cc-49bb-8d7c-48d6dca94a9a None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:58.141327 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81428d83-c2cc-49bb-8d7c-48d6dca94a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:58.192094 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-81428d83-c2cc-49bb-8d7c-48d6dca94a9a None None] MFA Rules not processed for user `8e416527de444ef1b744da062ee1e7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:58.194176 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-81428d83-c2cc-49bb-8d7c-48d6dca94a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:58.258360 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063eddb9-3d27-4c0e-a6ad-bd9a0711338e None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:58.261189 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-063eddb9-3d27-4c0e-a6ad-bd9a0711338e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:58.295454 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063eddb9-3d27-4c0e-a6ad-bd9a0711338e None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:58.308650 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc11075-729e-4c24-a593-0d5f2aa23b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:58.309490 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc11075-729e-4c24-a593-0d5f2aa23b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:58.309827 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc11075-729e-4c24-a593-0d5f2aa23b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:58.310120 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc11075-729e-4c24-a593-0d5f2aa23b27 admin admin] PATH_INFO: `/v3/projects/8d71ad92eb884237bc8eb9416c2512be` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:58.313132 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc11075-729e-4c24-a593-0d5f2aa23b27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d71ad92eb884237bc8eb9416c2512be)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:58.315318 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc11075-729e-4c24-a593-0d5f2aa23b27 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:58.399940 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 887/1789] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Dec 16 14:39:58 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:58.448375 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-7bc11075-729e-4c24-a593-0d5f2aa23b27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d71ad92eb884237bc8eb9416c2512be', 'request_id': 'req-7bc11075-729e-4c24-a593-0d5f2aa23b27'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:58.455193 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-7bc11075-729e-4c24-a593-0d5f2aa23b27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d71ad92eb884237bc8eb9416c2512be', 'request_id': 'req-7bc11075-729e-4c24-a593-0d5f2aa23b27'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:58.468888 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-7bc11075-729e-4c24-a593-0d5f2aa23b27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d71ad92eb884237bc8eb9416c2512be', 'request_id': 'req-7bc11075-729e-4c24-a593-0d5f2aa23b27'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:58.492594 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-7bc11075-729e-4c24-a593-0d5f2aa23b27 admin admin] The token cache is being invalidate because project 8d71ad92eb884237bc8eb9416c2512be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:58.493085 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-7bc11075-729e-4c24-a593-0d5f2aa23b27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:58.493843 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-7bc11075-729e-4c24-a593-0d5f2aa23b27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:58.496817 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 903/1790] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:58 2021] DELETE /identity/v3/projects/8d71ad92eb884237bc8eb9416c2512be => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:58.501334 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81428d83-c2cc-49bb-8d7c-48d6dca94a9a None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:58.521790 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81428d83-c2cc-49bb-8d7c-48d6dca94a9a None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:58.705523 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5942150-ed17-4073-8109-2d0883278b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:58.706355 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5942150-ed17-4073-8109-2d0883278b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:58.706644 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5942150-ed17-4073-8109-2d0883278b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:58.706980 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5942150-ed17-4073-8109-2d0883278b43 admin admin] PATH_INFO: `/v3/users/2c9f9df4c81e4541bd927670fbc653d0` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:58.714343 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5942150-ed17-4073-8109-2d0883278b43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c9f9df4c81e4541bd927670fbc653d0)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:58.716600 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5942150-ed17-4073-8109-2d0883278b43 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:58.852772 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc11075-729e-4c24-a593-0d5f2aa23b27 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:58.854249 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-7bc11075-729e-4c24-a593-0d5f2aa23b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:58.882948 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-c5942150-ed17-4073-8109-2d0883278b43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c9f9df4c81e4541bd927670fbc653d0'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:58.883905 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-c5942150-ed17-4073-8109-2d0883278b43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c9f9df4c81e4541bd927670fbc653d0'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:58.918837 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-c5942150-ed17-4073-8109-2d0883278b43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c9f9df4c81e4541bd927670fbc653d0'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:58.931017 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-c5942150-ed17-4073-8109-2d0883278b43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c9f9df4c81e4541bd927670fbc653d0'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:58.948716 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-c5942150-ed17-4073-8109-2d0883278b43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c9f9df4c81e4541bd927670fbc653d0'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:58.989656 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 888/1791] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:58 2021] DELETE /identity/v3/users/2c9f9df4c81e4541bd927670fbc653d0 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:59.060544 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5942150-ed17-4073-8109-2d0883278b43 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:59.063310 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-c5942150-ed17-4073-8109-2d0883278b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:59.116846 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc11075-729e-4c24-a593-0d5f2aa23b27 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:59.220201 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d80630-cedb-44ca-9e15-38d7a11029e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:59.222038 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d80630-cedb-44ca-9e15-38d7a11029e1 service nova] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:59.224346 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d80630-cedb-44ca-9e15-38d7a11029e1 service nova] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:59.230402 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d80630-cedb-44ca-9e15-38d7a11029e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:59.235665 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-16d80630-cedb-44ca-9e15-38d7a11029e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:59.275392 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d80630-cedb-44ca-9e15-38d7a11029e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:59.277472 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d80630-cedb-44ca-9e15-38d7a11029e1 service nova] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:59.304927 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 904/1792] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:58 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:39:59.345533 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5942150-ed17-4073-8109-2d0883278b43 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:59.355291 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de1252-eace-46d3-85a9-ee2c18ad7b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:59.357010 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de1252-eace-46d3-85a9-ee2c18ad7b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:59.357518 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de1252-eace-46d3-85a9-ee2c18ad7b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:59.358078 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de1252-eace-46d3-85a9-ee2c18ad7b0e admin admin] PATH_INFO: `/v3/users/8908b192b95d43e59eccd9585c196f24` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:59.360559 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de1252-eace-46d3-85a9-ee2c18ad7b0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8908b192b95d43e59eccd9585c196f24)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:59.364816 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de1252-eace-46d3-85a9-ee2c18ad7b0e admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:39:59.529300 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-49de1252-eace-46d3-85a9-ee2c18ad7b0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8908b192b95d43e59eccd9585c196f24'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:59.530323 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-49de1252-eace-46d3-85a9-ee2c18ad7b0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8908b192b95d43e59eccd9585c196f24'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:59.564927 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-49de1252-eace-46d3-85a9-ee2c18ad7b0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8908b192b95d43e59eccd9585c196f24'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:59.589060 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-49de1252-eace-46d3-85a9-ee2c18ad7b0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8908b192b95d43e59eccd9585c196f24'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:59.605675 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-49de1252-eace-46d3-85a9-ee2c18ad7b0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8908b192b95d43e59eccd9585c196f24'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:59.619869 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 889/1793] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:59 2021] DELETE /identity/v3/users/8908b192b95d43e59eccd9585c196f24 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:59.625171 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539900ae-9fdc-40d7-9b18-bb056cf952b8 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:59.625470 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539900ae-9fdc-40d7-9b18-bb056cf952b8 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:59.626003 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539900ae-9fdc-40d7-9b18-bb056cf952b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:59.672108 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-539900ae-9fdc-40d7-9b18-bb056cf952b8 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:59.673672 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-539900ae-9fdc-40d7-9b18-bb056cf952b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:59.889995 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 905/1794] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:39:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:59.990911 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de1252-eace-46d3-85a9-ee2c18ad7b0e admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:59.994723 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-49de1252-eace-46d3-85a9-ee2c18ad7b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:00.093171 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de1252-eace-46d3-85a9-ee2c18ad7b0e admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:00.098365 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a8ede-e497-4011-90d3-d41839cff9ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:00.098986 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a8ede-e497-4011-90d3-d41839cff9ef service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:00.099291 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a8ede-e497-4011-90d3-d41839cff9ef service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:00.099567 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a8ede-e497-4011-90d3-d41839cff9ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:00.127907 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a8ede-e497-4011-90d3-d41839cff9ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:00.129725 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a8ede-e497-4011-90d3-d41839cff9ef service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:00.141259 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 890/1795] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:59 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:00.366798 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539900ae-9fdc-40d7-9b18-bb056cf952b8 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:00.368720 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-539900ae-9fdc-40d7-9b18-bb056cf952b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:00.380288 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539900ae-9fdc-40d7-9b18-bb056cf952b8 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:00.385114 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04435f-60c5-4fe6-8fff-a98d74f46812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:00.385917 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04435f-60c5-4fe6-8fff-a98d74f46812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:00.386387 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04435f-60c5-4fe6-8fff-a98d74f46812 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:00.386667 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04435f-60c5-4fe6-8fff-a98d74f46812 admin admin] PATH_INFO: `/v3/projects/2e83dfe1aa274510b7e7d48f56e60571` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:00.388016 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04435f-60c5-4fe6-8fff-a98d74f46812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e83dfe1aa274510b7e7d48f56e60571)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:00.391427 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04435f-60c5-4fe6-8fff-a98d74f46812 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:00.478400 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ab04435f-60c5-4fe6-8fff-a98d74f46812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e83dfe1aa274510b7e7d48f56e60571', 'request_id': 'req-ab04435f-60c5-4fe6-8fff-a98d74f46812'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:00.486750 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ab04435f-60c5-4fe6-8fff-a98d74f46812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e83dfe1aa274510b7e7d48f56e60571', 'request_id': 'req-ab04435f-60c5-4fe6-8fff-a98d74f46812'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:00.507446 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ab04435f-60c5-4fe6-8fff-a98d74f46812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e83dfe1aa274510b7e7d48f56e60571', 'request_id': 'req-ab04435f-60c5-4fe6-8fff-a98d74f46812'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:00.525334 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ab04435f-60c5-4fe6-8fff-a98d74f46812 admin admin] The token cache is being invalidate because project 2e83dfe1aa274510b7e7d48f56e60571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:00.525899 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ab04435f-60c5-4fe6-8fff-a98d74f46812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:00.526492 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ab04435f-60c5-4fe6-8fff-a98d74f46812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:00.531189 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 906/1796] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:00 2021] DELETE /identity/v3/projects/2e83dfe1aa274510b7e7d48f56e60571 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:00.534214 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633df71f-36f6-4044-93be-1897871986e6 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:00.534692 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633df71f-36f6-4044-93be-1897871986e6 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:00.534869 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633df71f-36f6-4044-93be-1897871986e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:00.582088 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-633df71f-36f6-4044-93be-1897871986e6 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:00.583451 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-633df71f-36f6-4044-93be-1897871986e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:00.705646 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 891/1797] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:00.713356 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634f9b5-cbe3-4810-ad6b-0412875df602 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:00.713449 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634f9b5-cbe3-4810-ad6b-0412875df602 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:00.713923 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634f9b5-cbe3-4810-ad6b-0412875df602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:00.741038 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-b634f9b5-cbe3-4810-ad6b-0412875df602 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:00.742555 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-b634f9b5-cbe3-4810-ad6b-0412875df602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:00.752291 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 907/1798] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:00.756581 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633df71f-36f6-4044-93be-1897871986e6 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:00.766909 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633df71f-36f6-4044-93be-1897871986e6 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:00.776158 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109fd37-446f-4397-9854-8b97990fd83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:00.777047 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109fd37-446f-4397-9854-8b97990fd83a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:00.778691 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109fd37-446f-4397-9854-8b97990fd83a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:00.779384 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109fd37-446f-4397-9854-8b97990fd83a admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:00.781383 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109fd37-446f-4397-9854-8b97990fd83a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:40:00.781704 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109fd37-446f-4397-9854-8b97990fd83a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:00.783341 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109fd37-446f-4397-9854-8b97990fd83a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:00.815730 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634f9b5-cbe3-4810-ad6b-0412875df602 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:00.838266 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 892/1799] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:40:00.845263 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634f9b5-cbe3-4810-ad6b-0412875df602 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:00.854535 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbb738-c09d-42a7-b1e0-f4e00954d0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:00.855394 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbb738-c09d-42a7-b1e0-f4e00954d0f3 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:00.855839 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbb738-c09d-42a7-b1e0-f4e00954d0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:00.856364 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbb738-c09d-42a7-b1e0-f4e00954d0f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:00.857246 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbb738-c09d-42a7-b1e0-f4e00954d0f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:00.871386 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbb738-c09d-42a7-b1e0-f4e00954d0f3 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:00.905451 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109fd37-446f-4397-9854-8b97990fd83a admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:00.907852 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-a109fd37-446f-4397-9854-8b97990fd83a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:00.945028 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 908/1800] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:00 2021] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:40:00.945587 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109fd37-446f-4397-9854-8b97990fd83a admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:00.945830 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbb738-c09d-42a7-b1e0-f4e00954d0f3 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:01.050289 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cb73f-2ccf-4cb2-b483-b6492e4e24d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:01.052380 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cb73f-2ccf-4cb2-b483-b6492e4e24d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:01.053051 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cb73f-2ccf-4cb2-b483-b6492e4e24d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:01.053678 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cb73f-2ccf-4cb2-b483-b6492e4e24d5 admin admin] PATH_INFO: `/v3/users/5f2371d05fb84fe5b77001e2caf9e26c` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:01.056973 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3cb73f-2ccf-4cb2-b483-b6492e4e24d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f2371d05fb84fe5b77001e2caf9e26c)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:01.059392 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3cb73f-2ccf-4cb2-b483-b6492e4e24d5 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:01.060146 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbb738-c09d-42a7-b1e0-f4e00954d0f3 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:01.067037 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184d173-d2e2-4281-a619-70f6756218d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:01.067764 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184d173-d2e2-4281-a619-70f6756218d2 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:01.068258 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184d173-d2e2-4281-a619-70f6756218d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:01.068629 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184d173-d2e2-4281-a619-70f6756218d2 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:01.069575 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184d173-d2e2-4281-a619-70f6756218d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:01.072367 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184d173-d2e2-4281-a619-70f6756218d2 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:01.115936 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 909/1801] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:00 2021] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:01.116759 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184d173-d2e2-4281-a619-70f6756218d2 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:01.130750 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184d173-d2e2-4281-a619-70f6756218d2 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:01.136638 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8053e8a-9366-4285-88cb-62bc734b792b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:01.137260 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8053e8a-9366-4285-88cb-62bc734b792b admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:01.137664 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8053e8a-9366-4285-88cb-62bc734b792b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:01.137961 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8053e8a-9366-4285-88cb-62bc734b792b admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:01.138915 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8053e8a-9366-4285-88cb-62bc734b792b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:01.140979 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8053e8a-9366-4285-88cb-62bc734b792b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:01.142866 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-2a3cb73f-2ccf-4cb2-b483-b6492e4e24d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f2371d05fb84fe5b77001e2caf9e26c'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:01.143591 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-2a3cb73f-2ccf-4cb2-b483-b6492e4e24d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f2371d05fb84fe5b77001e2caf9e26c'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:01.159718 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 910/1802] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:01 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:01.160851 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-2a3cb73f-2ccf-4cb2-b483-b6492e4e24d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f2371d05fb84fe5b77001e2caf9e26c'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:01.160967 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8053e8a-9366-4285-88cb-62bc734b792b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:01.177988 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-2a3cb73f-2ccf-4cb2-b483-b6492e4e24d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f2371d05fb84fe5b77001e2caf9e26c'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:01.178459 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8053e8a-9366-4285-88cb-62bc734b792b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:01.180539 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2527e69-834d-4ab9-9a70-8254e0dd283b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:01.181148 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2527e69-834d-4ab9-9a70-8254e0dd283b admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:01.181454 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2527e69-834d-4ab9-9a70-8254e0dd283b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:01.181856 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2527e69-834d-4ab9-9a70-8254e0dd283b admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:01.182443 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2527e69-834d-4ab9-9a70-8254e0dd283b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:01.183839 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-2a3cb73f-2ccf-4cb2-b483-b6492e4e24d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f2371d05fb84fe5b77001e2caf9e26c'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:01.184107 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2527e69-834d-4ab9-9a70-8254e0dd283b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:01.191370 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 893/1803] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:00 2021] DELETE /identity/v3/users/5f2371d05fb84fe5b77001e2caf9e26c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:01.195654 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a09f4-6da1-49c9-83c9-c0c9b7ff73f4 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:01.196051 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a09f4-6da1-49c9-83c9-c0c9b7ff73f4 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:01.196340 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a09f4-6da1-49c9-83c9-c0c9b7ff73f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:01.230615 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 911/1804] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:01 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:01.232275 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2527e69-834d-4ab9-9a70-8254e0dd283b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:01.233987 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-d2527e69-834d-4ab9-9a70-8254e0dd283b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:01.241029 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-496a09f4-6da1-49c9-83c9-c0c9b7ff73f4 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:01.243761 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-496a09f4-6da1-49c9-83c9-c0c9b7ff73f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:01.248775 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2527e69-834d-4ab9-9a70-8254e0dd283b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:01.342879 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 894/1805] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:01.352706 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a09f4-6da1-49c9-83c9-c0c9b7ff73f4 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:01.354326 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-496a09f4-6da1-49c9-83c9-c0c9b7ff73f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:01.365217 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32655c9-5977-405d-89d3-7d7ff25997b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:01.366661 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32655c9-5977-405d-89d3-7d7ff25997b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:01.367143 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32655c9-5977-405d-89d3-7d7ff25997b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:01.368044 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32655c9-5977-405d-89d3-7d7ff25997b3 admin admin] PATH_INFO: `/v3/projects/470952c1567f46e79fca4d8ce8467a73/users/60123f44842340ed8bd8fc88c7debca9/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:01.379385 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a09f4-6da1-49c9-83c9-c0c9b7ff73f4 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:01.404040 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225917b6-e001-47a6-8252-aa65784e3a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:01.405194 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225917b6-e001-47a6-8252-aa65784e3a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:01.405609 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32655c9-5977-405d-89d3-7d7ff25997b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=470952c1567f46e79fca4d8ce8467a73, user_id=60123f44842340ed8bd8fc88c7debca9, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:01.405872 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225917b6-e001-47a6-8252-aa65784e3a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:01.413259 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225917b6-e001-47a6-8252-aa65784e3a4b admin admin] PATH_INFO: `/v3/projects/98332976af014a5181e467f387b45a17` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:01.415015 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225917b6-e001-47a6-8252-aa65784e3a4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=98332976af014a5181e467f387b45a17)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:01.415132 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32655c9-5977-405d-89d3-7d7ff25997b3 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:01.417357 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225917b6-e001-47a6-8252-aa65784e3a4b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:01.441447 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 912/1806] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:01 2021] PUT /identity/v3/projects/470952c1567f46e79fca4d8ce8467a73/users/60123f44842340ed8bd8fc88c7debca9/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:01.452138 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9a7f0-a382-4467-8d1b-9dd3ae5080c3 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:01.452443 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9a7f0-a382-4467-8d1b-9dd3ae5080c3 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:01.452740 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9a7f0-a382-4467-8d1b-9dd3ae5080c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:01.541588 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-225917b6-e001-47a6-8252-aa65784e3a4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98332976af014a5181e467f387b45a17', 'request_id': 'req-225917b6-e001-47a6-8252-aa65784e3a4b'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:01.551694 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-90d9a7f0-a382-4467-8d1b-9dd3ae5080c3 None None] MFA Rules not processed for user `60123f44842340ed8bd8fc88c7debca9`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:01.552957 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-90d9a7f0-a382-4467-8d1b-9dd3ae5080c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:01.566685 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-225917b6-e001-47a6-8252-aa65784e3a4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98332976af014a5181e467f387b45a17', 'request_id': 'req-225917b6-e001-47a6-8252-aa65784e3a4b'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:01.581110 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-225917b6-e001-47a6-8252-aa65784e3a4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98332976af014a5181e467f387b45a17', 'request_id': 'req-225917b6-e001-47a6-8252-aa65784e3a4b'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:01.614190 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-225917b6-e001-47a6-8252-aa65784e3a4b admin admin] The token cache is being invalidate because project 98332976af014a5181e467f387b45a17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:01.614680 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-225917b6-e001-47a6-8252-aa65784e3a4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:01.618143 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-225917b6-e001-47a6-8252-aa65784e3a4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:01.623322 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 895/1807] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:01 2021] DELETE /identity/v3/projects/98332976af014a5181e467f387b45a17 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:01.631192 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225917b6-e001-47a6-8252-aa65784e3a4b admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:01.638488 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-225917b6-e001-47a6-8252-aa65784e3a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:01.764659 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 913/1808] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:01 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:01.766315 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219dd80-8f1c-4fc4-9575-db6acddbd5ff None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:01.769659 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219dd80-8f1c-4fc4-9575-db6acddbd5ff None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:01.769971 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219dd80-8f1c-4fc4-9575-db6acddbd5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:01.828843 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225917b6-e001-47a6-8252-aa65784e3a4b admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:01.854217 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2c714-9446-4ad7-8f06-2ef6e5fd586d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:01.854558 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-e219dd80-8f1c-4fc4-9575-db6acddbd5ff None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:01.855419 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2c714-9446-4ad7-8f06-2ef6e5fd586d service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:01.856394 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e219dd80-8f1c-4fc4-9575-db6acddbd5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:01.857225 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2c714-9446-4ad7-8f06-2ef6e5fd586d service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:01.857774 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2c714-9446-4ad7-8f06-2ef6e5fd586d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:01.861751 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-42e2c714-9446-4ad7-8f06-2ef6e5fd586d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:01.973824 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 914/1809] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:01.975116 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219dd80-8f1c-4fc4-9575-db6acddbd5ff None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:01.976902 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e219dd80-8f1c-4fc4-9575-db6acddbd5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:02.008176 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2c714-9446-4ad7-8f06-2ef6e5fd586d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:02.010783 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219dd80-8f1c-4fc4-9575-db6acddbd5ff None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:02.013134 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2c714-9446-4ad7-8f06-2ef6e5fd586d service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:02.022676 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13346a-5972-4292-9e30-d80efc3565bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:02.023717 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13346a-5972-4292-9e30-d80efc3565bf admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:02.024016 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13346a-5972-4292-9e30-d80efc3565bf admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:02.024315 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13346a-5972-4292-9e30-d80efc3565bf admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:02.026522 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13346a-5972-4292-9e30-d80efc3565bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:02.028691 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13346a-5972-4292-9e30-d80efc3565bf admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:02.034148 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 896/1810] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:01 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:02.036159 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f374f83-a054-4392-8438-e4445fce5157 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:02.036477 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f374f83-a054-4392-8438-e4445fce5157 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:02.036743 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f374f83-a054-4392-8438-e4445fce5157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:02.076347 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-5f374f83-a054-4392-8438-e4445fce5157 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:02.081385 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 915/1811] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:01 2021] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:02.085254 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13346a-5972-4292-9e30-d80efc3565bf admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:02.088079 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-5f374f83-a054-4392-8438-e4445fce5157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:02.183355 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 897/1812] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:02.187704 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f374f83-a054-4392-8438-e4445fce5157 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:02.195887 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13346a-5972-4292-9e30-d80efc3565bf admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:02.199968 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f374f83-a054-4392-8438-e4445fce5157 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:02.205121 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea071e-134c-4ea0-a9f9-7ceb969231a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:02.205773 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea071e-134c-4ea0-a9f9-7ceb969231a8 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:02.206070 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea071e-134c-4ea0-a9f9-7ceb969231a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:02.206356 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea071e-134c-4ea0-a9f9-7ceb969231a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:02.207214 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea071e-134c-4ea0-a9f9-7ceb969231a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:40:02.207754 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea071e-134c-4ea0-a9f9-7ceb969231a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:02.209416 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea071e-134c-4ea0-a9f9-7ceb969231a8 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:02.209907 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb777a-d088-486e-9ae6-d587b6438c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:02.210751 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb777a-d088-486e-9ae6-d587b6438c33 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:02.211048 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb777a-d088-486e-9ae6-d587b6438c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:02.211342 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb777a-d088-486e-9ae6-d587b6438c33 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:02.214166 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb777a-d088-486e-9ae6-d587b6438c33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:02.216837 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb777a-d088-486e-9ae6-d587b6438c33 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:02.236269 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 898/1813] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:40:02.241979 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea071e-134c-4ea0-a9f9-7ceb969231a8 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:02.253933 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 916/1814] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:02 2021] POST /identity/v3/users => generated 296 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:40:02.257463 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb777a-d088-486e-9ae6-d587b6438c33 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:02.267161 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea071e-134c-4ea0-a9f9-7ceb969231a8 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:02.275340 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb777a-d088-486e-9ae6-d587b6438c33 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:02.275472 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3c579-daa5-4d29-b9a6-5034699c5aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:02.276892 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3c579-daa5-4d29-b9a6-5034699c5aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:02.277429 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3c579-daa5-4d29-b9a6-5034699c5aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:02.278116 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3c579-daa5-4d29-b9a6-5034699c5aa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:02.279386 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd3c579-daa5-4d29-b9a6-5034699c5aa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:02.281711 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5c66e-0321-4811-8ca1-90fd0ca92db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:02.282524 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5c66e-0321-4811-8ca1-90fd0ca92db0 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:02.282996 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5c66e-0321-4811-8ca1-90fd0ca92db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:02.283478 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5c66e-0321-4811-8ca1-90fd0ca92db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:02.283813 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd3c579-daa5-4d29-b9a6-5034699c5aa7 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:02.284965 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5c66e-0321-4811-8ca1-90fd0ca92db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:02.286949 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5c66e-0321-4811-8ca1-90fd0ca92db0 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:02.301199 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 917/1815] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:02 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:02.305710 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5c66e-0321-4811-8ca1-90fd0ca92db0 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:02.324707 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5c66e-0321-4811-8ca1-90fd0ca92db0 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:02.327431 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 899/1816] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:02 2021] POST /identity/v3/projects => generated 389 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:02.331819 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3c579-daa5-4d29-b9a6-5034699c5aa7 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:02.424967 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3c579-daa5-4d29-b9a6-5034699c5aa7 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:02.431872 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28445a4e-52a8-4967-96b8-08b1278430fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:02.432695 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28445a4e-52a8-4967-96b8-08b1278430fe admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:02.433199 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28445a4e-52a8-4967-96b8-08b1278430fe admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:02.433701 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28445a4e-52a8-4967-96b8-08b1278430fe admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:02.434640 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28445a4e-52a8-4967-96b8-08b1278430fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:02.436938 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28445a4e-52a8-4967-96b8-08b1278430fe admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:02.456349 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d026ff-27fb-40db-8e70-0a38f4dbe4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:02.458007 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d026ff-27fb-40db-8e70-0a38f4dbe4c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:02.458657 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d026ff-27fb-40db-8e70-0a38f4dbe4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:02.459252 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d026ff-27fb-40db-8e70-0a38f4dbe4c0 admin admin] PATH_INFO: `/v3/projects/4094adf5cb944f1aa9cf865c283ee367/users/17efa170e35e4f85adb1a8ae94e93841/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:02.463594 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 900/1817] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:02 2021] POST /identity/v3/users => generated 295 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:40:02.464605 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28445a4e-52a8-4967-96b8-08b1278430fe admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:02.475536 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28445a4e-52a8-4967-96b8-08b1278430fe admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:02.482105 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8989d-a798-460b-bc08-99693e225481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:02.482791 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8989d-a798-460b-bc08-99693e225481 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:02.483154 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8989d-a798-460b-bc08-99693e225481 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:02.483508 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8989d-a798-460b-bc08-99693e225481 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:02.484460 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8989d-a798-460b-bc08-99693e225481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:02.486723 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8989d-a798-460b-bc08-99693e225481 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:02.495794 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d026ff-27fb-40db-8e70-0a38f4dbe4c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4094adf5cb944f1aa9cf865c283ee367, user_id=17efa170e35e4f85adb1a8ae94e93841, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:02.499768 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 901/1818] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:02 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:02.500862 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d026ff-27fb-40db-8e70-0a38f4dbe4c0 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:02.505091 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8989d-a798-460b-bc08-99693e225481 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:02.540267 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8989d-a798-460b-bc08-99693e225481 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:02.560223 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 918/1819] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:02 2021] PUT /identity/v3/projects/4094adf5cb944f1aa9cf865c283ee367/users/17efa170e35e4f85adb1a8ae94e93841/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:02.561910 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d026ff-27fb-40db-8e70-0a38f4dbe4c0 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:02.619688 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679a720-9a8a-49ae-a2ae-f731a1f17af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:02.620317 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679a720-9a8a-49ae-a2ae-f731a1f17af3 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:02.620735 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679a720-9a8a-49ae-a2ae-f731a1f17af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:02.620975 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679a720-9a8a-49ae-a2ae-f731a1f17af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:02.621692 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679a720-9a8a-49ae-a2ae-f731a1f17af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:02.623303 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679a720-9a8a-49ae-a2ae-f731a1f17af3 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:02.639020 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 902/1820] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:02 2021] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:02.639980 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679a720-9a8a-49ae-a2ae-f731a1f17af3 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:02.670763 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679a720-9a8a-49ae-a2ae-f731a1f17af3 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:02.687465 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea91a73-9924-40be-8960-c485b12b59ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:02.689811 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea91a73-9924-40be-8960-c485b12b59ea admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:02.690118 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea91a73-9924-40be-8960-c485b12b59ea admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:02.690413 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea91a73-9924-40be-8960-c485b12b59ea admin admin] PATH_INFO: `/v3/projects/c5d5f36fd7db4192b0fe77d2bf9c969c/users/58aad16a83be43709b98a92357f064d0/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:02.698922 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d026ff-27fb-40db-8e70-0a38f4dbe4c0 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:02.703681 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9929b-cb12-4f0a-bfad-70c053ddb588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:02.704302 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9929b-cb12-4f0a-bfad-70c053ddb588 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:02.704594 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9929b-cb12-4f0a-bfad-70c053ddb588 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:02.704916 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9929b-cb12-4f0a-bfad-70c053ddb588 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:02.705634 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9929b-cb12-4f0a-bfad-70c053ddb588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:02.707265 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9929b-cb12-4f0a-bfad-70c053ddb588 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:02.721585 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 919/1821] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:02 2021] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:40:02.725259 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9929b-cb12-4f0a-bfad-70c053ddb588 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:02.735394 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea91a73-9924-40be-8960-c485b12b59ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5d5f36fd7db4192b0fe77d2bf9c969c, user_id=58aad16a83be43709b98a92357f064d0, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:02.736115 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9929b-cb12-4f0a-bfad-70c053ddb588 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:02.746953 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea91a73-9924-40be-8960-c485b12b59ea admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:02.747132 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e1e5a-10db-481a-9b9e-741ea1cc7e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:02.747132 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e1e5a-10db-481a-9b9e-741ea1cc7e84 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:02.747132 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e1e5a-10db-481a-9b9e-741ea1cc7e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:02.747132 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e1e5a-10db-481a-9b9e-741ea1cc7e84 admin admin] PATH_INFO: `/v3/projects/4094adf5cb944f1aa9cf865c283ee367/users/17efa170e35e4f85adb1a8ae94e93841/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:02.747462 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e1e5a-10db-481a-9b9e-741ea1cc7e84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4094adf5cb944f1aa9cf865c283ee367, user_id=17efa170e35e4f85adb1a8ae94e93841, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:02.747819 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e1e5a-10db-481a-9b9e-741ea1cc7e84 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:02.760444 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 920/1822] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:02 2021] PUT /identity/v3/projects/4094adf5cb944f1aa9cf865c283ee367/users/17efa170e35e4f85adb1a8ae94e93841/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:02.772884 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 903/1823] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:02 2021] PUT /identity/v3/projects/c5d5f36fd7db4192b0fe77d2bf9c969c/users/58aad16a83be43709b98a92357f064d0/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:02.776046 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e70675-798f-4156-b4fe-27a0de2aa1b3 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:02.777866 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d5196-2a38-4fad-b723-146cba49e0d3 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:02.778130 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d5196-2a38-4fad-b723-146cba49e0d3 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:02.778904 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d5196-2a38-4fad-b723-146cba49e0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:02.780892 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e70675-798f-4156-b4fe-27a0de2aa1b3 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:02.781222 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e70675-798f-4156-b4fe-27a0de2aa1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:02.874012 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-98e70675-798f-4156-b4fe-27a0de2aa1b3 None None] MFA Rules not processed for user `17efa170e35e4f85adb1a8ae94e93841`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:02.878472 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-98e70675-798f-4156-b4fe-27a0de2aa1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:02.895373 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-ef0d5196-2a38-4fad-b723-146cba49e0d3 None None] MFA Rules not processed for user `58aad16a83be43709b98a92357f064d0`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:02.898488 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-ef0d5196-2a38-4fad-b723-146cba49e0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:03.098738 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 921/1824] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:02 2021] POST /identity/v3/auth/tokens => generated 3753 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:03.101968 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e70675-798f-4156-b4fe-27a0de2aa1b3 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:03.108592 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 904/1825] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:02 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:03.111034 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-98e70675-798f-4156-b4fe-27a0de2aa1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:03.122648 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d5196-2a38-4fad-b723-146cba49e0d3 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:03.255195 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e70675-798f-4156-b4fe-27a0de2aa1b3 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:03.261741 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e6017-219e-4cb7-9744-13c20540839f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:03.262579 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e6017-219e-4cb7-9744-13c20540839f admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:03.262848 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e6017-219e-4cb7-9744-13c20540839f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:03.263138 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e6017-219e-4cb7-9744-13c20540839f admin admin] PATH_INFO: `/v3/projects/240e1d9727694fafaabfa278fbe4cfd0` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:03.264876 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e6017-219e-4cb7-9744-13c20540839f admin admin] RBAC: Authorizing `identity:delete_project(project_id=240e1d9727694fafaabfa278fbe4cfd0)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:03.267056 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e6017-219e-4cb7-9744-13c20540839f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:03.287906 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d5196-2a38-4fad-b723-146cba49e0d3 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:03.296149 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb086c-ace1-40fa-b934-b9b15eb4c56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:03.296912 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb086c-ace1-40fa-b934-b9b15eb4c56e admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:03.297302 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb086c-ace1-40fa-b934-b9b15eb4c56e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:03.297680 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb086c-ace1-40fa-b934-b9b15eb4c56e admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:03.298538 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb086c-ace1-40fa-b934-b9b15eb4c56e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:03.300517 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb086c-ace1-40fa-b934-b9b15eb4c56e admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:03.344839 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 905/1826] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:03 2021] POST /identity/v3/projects => generated 387 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:03.347225 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb086c-ace1-40fa-b934-b9b15eb4c56e admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:03.352497 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-954e6017-219e-4cb7-9744-13c20540839f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '240e1d9727694fafaabfa278fbe4cfd0', 'request_id': 'req-954e6017-219e-4cb7-9744-13c20540839f'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:03.356103 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-44eb086c-ace1-40fa-b934-b9b15eb4c56e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:03.368019 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-954e6017-219e-4cb7-9744-13c20540839f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '240e1d9727694fafaabfa278fbe4cfd0', 'request_id': 'req-954e6017-219e-4cb7-9744-13c20540839f'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:03.381688 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-954e6017-219e-4cb7-9744-13c20540839f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '240e1d9727694fafaabfa278fbe4cfd0', 'request_id': 'req-954e6017-219e-4cb7-9744-13c20540839f'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:03.404333 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-954e6017-219e-4cb7-9744-13c20540839f admin admin] The token cache is being invalidate because project 240e1d9727694fafaabfa278fbe4cfd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:03.404819 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-954e6017-219e-4cb7-9744-13c20540839f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:03.405589 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-954e6017-219e-4cb7-9744-13c20540839f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:03.408497 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 922/1827] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:03 2021] DELETE /identity/v3/projects/240e1d9727694fafaabfa278fbe4cfd0 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:03.409117 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e6017-219e-4cb7-9744-13c20540839f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:03.412362 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-954e6017-219e-4cb7-9744-13c20540839f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:03.457638 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb086c-ace1-40fa-b934-b9b15eb4c56e admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:03.486076 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc0919-a85b-40a7-89cf-a0b282be9561 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:03.487454 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc0919-a85b-40a7-89cf-a0b282be9561 service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:03.487892 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc0919-a85b-40a7-89cf-a0b282be9561 service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:03.488462 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc0919-a85b-40a7-89cf-a0b282be9561 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:03.493381 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-4cdc0919-a85b-40a7-89cf-a0b282be9561 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:03.558088 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e6017-219e-4cb7-9744-13c20540839f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:03.642655 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c5a7b-c11e-4c3d-80cb-de8a63a89a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:03.643679 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c5a7b-c11e-4c3d-80cb-de8a63a89a50 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:03.644121 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c5a7b-c11e-4c3d-80cb-de8a63a89a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:03.644555 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c5a7b-c11e-4c3d-80cb-de8a63a89a50 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:03.645627 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c5a7b-c11e-4c3d-80cb-de8a63a89a50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:03.648762 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c5a7b-c11e-4c3d-80cb-de8a63a89a50 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:03.665875 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc0919-a85b-40a7-89cf-a0b282be9561 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:03.673628 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc0919-a85b-40a7-89cf-a0b282be9561 service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:03.684117 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 923/1828] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:03 2021] POST /identity/v3/users => generated 300 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:03.684581 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 906/1829] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:03 2021] GET /identity/v3/auth/tokens => generated 3753 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:03.686123 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc0919-a85b-40a7-89cf-a0b282be9561 service cinder] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:03.687803 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-4cdc0919-a85b-40a7-89cf-a0b282be9561 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:03.700695 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c5a7b-c11e-4c3d-80cb-de8a63a89a50 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:03.706010 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-431c5a7b-c11e-4c3d-80cb-de8a63a89a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:03.706162 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc0919-a85b-40a7-89cf-a0b282be9561 service cinder] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:03.715038 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b8238-ec32-472e-ad90-60e5296055b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:03.716472 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b8238-ec32-472e-ad90-60e5296055b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:03.717112 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b8238-ec32-472e-ad90-60e5296055b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:03.717230 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b8238-ec32-472e-ad90-60e5296055b7 admin admin] PATH_INFO: `/v3/users/3072edefeac94f9ebb5c2b7fd3b736dd` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:03.719561 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b8238-ec32-472e-ad90-60e5296055b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3072edefeac94f9ebb5c2b7fd3b736dd)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:03.722571 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b8238-ec32-472e-ad90-60e5296055b7 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:03.737270 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c5a7b-c11e-4c3d-80cb-de8a63a89a50 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:03.747956 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce566e88-248d-42c7-87e3-25200e446a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:03.748732 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce566e88-248d-42c7-87e3-25200e446a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:03.749046 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce566e88-248d-42c7-87e3-25200e446a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:03.749329 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce566e88-248d-42c7-87e3-25200e446a1e admin admin] PATH_INFO: `/v3/users/f6d65180799d4a7184cdc1593e14f066` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:03.754184 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce566e88-248d-42c7-87e3-25200e446a1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6d65180799d4a7184cdc1593e14f066)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:03.758086 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce566e88-248d-42c7-87e3-25200e446a1e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:03.836103 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-a58b8238-ec32-472e-ad90-60e5296055b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3072edefeac94f9ebb5c2b7fd3b736dd'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:03.842313 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-a58b8238-ec32-472e-ad90-60e5296055b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3072edefeac94f9ebb5c2b7fd3b736dd'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:03.883947 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-a58b8238-ec32-472e-ad90-60e5296055b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3072edefeac94f9ebb5c2b7fd3b736dd'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:03.898752 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ce566e88-248d-42c7-87e3-25200e446a1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6d65180799d4a7184cdc1593e14f066'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:03.903853 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ce566e88-248d-42c7-87e3-25200e446a1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6d65180799d4a7184cdc1593e14f066'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:03.921100 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-a58b8238-ec32-472e-ad90-60e5296055b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3072edefeac94f9ebb5c2b7fd3b736dd'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:03.954795 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ce566e88-248d-42c7-87e3-25200e446a1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6d65180799d4a7184cdc1593e14f066'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:03.956605 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-a58b8238-ec32-472e-ad90-60e5296055b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3072edefeac94f9ebb5c2b7fd3b736dd'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:03.982987 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 907/1830] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:03 2021] DELETE /identity/v3/users/3072edefeac94f9ebb5c2b7fd3b736dd => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:03.988221 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ce566e88-248d-42c7-87e3-25200e446a1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6d65180799d4a7184cdc1593e14f066'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:03.989870 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b8238-ec32-472e-ad90-60e5296055b7 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:03.994985 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-a58b8238-ec32-472e-ad90-60e5296055b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:04.015263 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ce566e88-248d-42c7-87e3-25200e446a1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6d65180799d4a7184cdc1593e14f066'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:04.039964 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 924/1831] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:03 2021] DELETE /identity/v3/users/f6d65180799d4a7184cdc1593e14f066 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:04.054069 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203da3e6-ee32-4ccf-94ed-eb733e2ae913 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:04.058599 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203da3e6-ee32-4ccf-94ed-eb733e2ae913 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:04.058967 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203da3e6-ee32-4ccf-94ed-eb733e2ae913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:04.117621 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-203da3e6-ee32-4ccf-94ed-eb733e2ae913 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:04.119521 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-203da3e6-ee32-4ccf-94ed-eb733e2ae913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:04.195388 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b8238-ec32-472e-ad90-60e5296055b7 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:04.304627 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 925/1832] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:04.343653 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203da3e6-ee32-4ccf-94ed-eb733e2ae913 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:04.345195 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-203da3e6-ee32-4ccf-94ed-eb733e2ae913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:04.364083 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0580693-4b99-465e-a81f-39d4dc2c2050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:04.365016 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0580693-4b99-465e-a81f-39d4dc2c2050 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:04.365544 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0580693-4b99-465e-a81f-39d4dc2c2050 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:04.366114 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0580693-4b99-465e-a81f-39d4dc2c2050 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:04.369396 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0580693-4b99-465e-a81f-39d4dc2c2050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:04.371335 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0580693-4b99-465e-a81f-39d4dc2c2050 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:04.389689 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 908/1833] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:03 2021] GET /identity/v3/roles => generated 1420 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:04.391390 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0580693-4b99-465e-a81f-39d4dc2c2050 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:04.395379 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-b0580693-4b99-465e-a81f-39d4dc2c2050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:04.413215 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0580693-4b99-465e-a81f-39d4dc2c2050 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:04.422148 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1a0cf-140e-451d-95b9-276dc98a0569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:04.423561 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1a0cf-140e-451d-95b9-276dc98a0569 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:04.424070 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1a0cf-140e-451d-95b9-276dc98a0569 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:04.425182 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1a0cf-140e-451d-95b9-276dc98a0569 admin admin] PATH_INFO: `/v3/projects/c7edaf82c7384a2b91165c91c4d70c65/users/6257cd2553804c57b772495aa0f5b3d1/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:04.489591 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1a0cf-140e-451d-95b9-276dc98a0569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7edaf82c7384a2b91165c91c4d70c65, user_id=6257cd2553804c57b772495aa0f5b3d1, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:04.492271 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1a0cf-140e-451d-95b9-276dc98a0569 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:04.546136 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 909/1834] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:04 2021] PUT /identity/v3/projects/c7edaf82c7384a2b91165c91c4d70c65/users/6257cd2553804c57b772495aa0f5b3d1/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:04.546136 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1a0cf-140e-451d-95b9-276dc98a0569 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:04.550350 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-d9d1a0cf-140e-451d-95b9-276dc98a0569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:04.590354 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203da3e6-ee32-4ccf-94ed-eb733e2ae913 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:04.730178 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1a0cf-140e-451d-95b9-276dc98a0569 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:04.732728 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92059e52-bf54-4320-a688-3626f82f7d72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:04.733467 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92059e52-bf54-4320-a688-3626f82f7d72 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:04.733833 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92059e52-bf54-4320-a688-3626f82f7d72 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:04.734197 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92059e52-bf54-4320-a688-3626f82f7d72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:04.741570 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306dc5c-213a-45e3-b239-58bc67f6d4ee tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17efa170e35e4f85adb1a8ae94e93841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4094adf5cb944f1aa9cf865c283ee367', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:04.743915 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306dc5c-213a-45e3-b239-58bc67f6d4ee tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:04.744423 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306dc5c-213a-45e3-b239-58bc67f6d4ee tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:04.746630 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306dc5c-213a-45e3-b239-58bc67f6d4ee tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:04.751035 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306dc5c-213a-45e3-b239-58bc67f6d4ee tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:40:04.751662 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306dc5c-213a-45e3-b239-58bc67f6d4ee tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:04.758331 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306dc5c-213a-45e3-b239-58bc67f6d4ee tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:04.800922 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 910/1835] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:40:04.803477 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306dc5c-213a-45e3-b239-58bc67f6d4ee tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:04.895048 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92059e52-bf54-4320-a688-3626f82f7d72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:04.896550 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92059e52-bf54-4320-a688-3626f82f7d72 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:04.923818 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 926/1836] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:04 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:04.925009 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92059e52-bf54-4320-a688-3626f82f7d72 service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:04.950211 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92059e52-bf54-4320-a688-3626f82f7d72 service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:04.957651 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cd2ea-b933-4d06-a86e-73abfc864d3b tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17efa170e35e4f85adb1a8ae94e93841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4094adf5cb944f1aa9cf865c283ee367', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:04.958386 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cd2ea-b933-4d06-a86e-73abfc864d3b tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:04.958613 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cd2ea-b933-4d06-a86e-73abfc864d3b tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:04.959186 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cd2ea-b933-4d06-a86e-73abfc864d3b tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:04.959498 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cd2ea-b933-4d06-a86e-73abfc864d3b tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:04.961550 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cd2ea-b933-4d06-a86e-73abfc864d3b tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:04.974303 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306dc5c-213a-45e3-b239-58bc67f6d4ee tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:04.990531 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb927b5a-3f81-4bc9-898a-c6df3303e785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:04.991163 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb927b5a-3f81-4bc9-898a-c6df3303e785 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:04.991454 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb927b5a-3f81-4bc9-898a-c6df3303e785 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:04.991739 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb927b5a-3f81-4bc9-898a-c6df3303e785 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:04.992455 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb927b5a-3f81-4bc9-898a-c6df3303e785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:04.994156 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb927b5a-3f81-4bc9-898a-c6df3303e785 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:05.008858 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 911/1837] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:04 2021] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:05.013238 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb927b5a-3f81-4bc9-898a-c6df3303e785 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:05.027155 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb927b5a-3f81-4bc9-898a-c6df3303e785 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:05.031222 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 927/1838] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:04 2021] POST /identity/v3/projects => generated 354 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:05.035653 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cd2ea-b933-4d06-a86e-73abfc864d3b tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:05.036932 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa668d56-7af2-48d0-8783-325fd7e5a126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:05.038062 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa668d56-7af2-48d0-8783-325fd7e5a126 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:05.038531 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa668d56-7af2-48d0-8783-325fd7e5a126 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:05.038989 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa668d56-7af2-48d0-8783-325fd7e5a126 admin admin] PATH_INFO: `/v3/projects/c7edaf82c7384a2b91165c91c4d70c65/users/6257cd2553804c57b772495aa0f5b3d1/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:05.043034 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa668d56-7af2-48d0-8783-325fd7e5a126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7edaf82c7384a2b91165c91c4d70c65, user_id=6257cd2553804c57b772495aa0f5b3d1, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:05.047199 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa668d56-7af2-48d0-8783-325fd7e5a126 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:05.073002 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 912/1839] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:05 2021] PUT /identity/v3/projects/c7edaf82c7384a2b91165c91c4d70c65/users/6257cd2553804c57b772495aa0f5b3d1/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:05.084659 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fbd06-0296-4df1-b0c8-6fdf772b4fa5 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:05.084988 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fbd06-0296-4df1-b0c8-6fdf772b4fa5 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:05.085259 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fbd06-0296-4df1-b0c8-6fdf772b4fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:05.149378 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-1f0fbd06-0296-4df1-b0c8-6fdf772b4fa5 None None] MFA Rules not processed for user `6257cd2553804c57b772495aa0f5b3d1`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:05.154324 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-1f0fbd06-0296-4df1-b0c8-6fdf772b4fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:05.182099 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cd2ea-b933-4d06-a86e-73abfc864d3b tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:05.267487 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 913/1840] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:05 2021] POST /identity/v3/auth/tokens => generated 3761 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:05.267487 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fbd06-0296-4df1-b0c8-6fdf772b4fa5 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:05.267750 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-1f0fbd06-0296-4df1-b0c8-6fdf772b4fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:05.285670 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b416fc4-4610-4f96-8eb3-80c121645d6a tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17efa170e35e4f85adb1a8ae94e93841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4094adf5cb944f1aa9cf865c283ee367', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:05.286525 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b416fc4-4610-4f96-8eb3-80c121645d6a tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:05.286956 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b416fc4-4610-4f96-8eb3-80c121645d6a tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:05.287696 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b416fc4-4610-4f96-8eb3-80c121645d6a tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:05.289858 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b416fc4-4610-4f96-8eb3-80c121645d6a tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:40:05.289858 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b416fc4-4610-4f96-8eb3-80c121645d6a tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:05.291342 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b416fc4-4610-4f96-8eb3-80c121645d6a tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:05.311516 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 928/1841] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:40:05.311516 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b416fc4-4610-4f96-8eb3-80c121645d6a tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:05.312610 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-1b416fc4-4610-4f96-8eb3-80c121645d6a tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:05.411991 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b416fc4-4610-4f96-8eb3-80c121645d6a tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:05.417102 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745b572-05a3-4232-9ba7-ff649a519547 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:05.418011 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745b572-05a3-4232-9ba7-ff649a519547 service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:05.418432 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745b572-05a3-4232-9ba7-ff649a519547 service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:05.418659 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fbd06-0296-4df1-b0c8-6fdf772b4fa5 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:05.418908 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745b572-05a3-4232-9ba7-ff649a519547 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:05.423626 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d3138-b545-4d5a-8dbb-0d07410a1fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:05.424553 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d3138-b545-4d5a-8dbb-0d07410a1fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:05.424879 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d3138-b545-4d5a-8dbb-0d07410a1fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:05.425228 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d3138-b545-4d5a-8dbb-0d07410a1fd5 admin admin] PATH_INFO: `/v3/projects/a9df4f468c1740dba748fa30cc0cff0a` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:05.427057 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d3138-b545-4d5a-8dbb-0d07410a1fd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9df4f468c1740dba748fa30cc0cff0a)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:05.430594 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d3138-b545-4d5a-8dbb-0d07410a1fd5 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:05.438112 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6745b572-05a3-4232-9ba7-ff649a519547 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:05.441327 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6745b572-05a3-4232-9ba7-ff649a519547 service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:05.455598 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 929/1842] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:05 2021] GET /identity/v3/auth/tokens => generated 3761 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:05.456251 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745b572-05a3-4232-9ba7-ff649a519547 service cinder] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:05.470872 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745b572-05a3-4232-9ba7-ff649a519547 service cinder] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:05.478411 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e25eb-7cc2-481a-9b2d-3f3076bab44d tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17efa170e35e4f85adb1a8ae94e93841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4094adf5cb944f1aa9cf865c283ee367', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:05.479090 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e25eb-7cc2-481a-9b2d-3f3076bab44d tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:05.479390 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e25eb-7cc2-481a-9b2d-3f3076bab44d tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:05.479682 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e25eb-7cc2-481a-9b2d-3f3076bab44d tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] PATH_INFO: `/v3/projects/950686305703462a8dadb2079a4d0ade` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:05.481586 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e25eb-7cc2-481a-9b2d-3f3076bab44d tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] RBAC: Authorizing `identity:delete_project(project_id=950686305703462a8dadb2079a4d0ade)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:05.483598 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e25eb-7cc2-481a-9b2d-3f3076bab44d tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:05.543288 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-101d3138-b545-4d5a-8dbb-0d07410a1fd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9df4f468c1740dba748fa30cc0cff0a', 'request_id': 'req-101d3138-b545-4d5a-8dbb-0d07410a1fd5'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:05.564170 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-101d3138-b545-4d5a-8dbb-0d07410a1fd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9df4f468c1740dba748fa30cc0cff0a', 'request_id': 'req-101d3138-b545-4d5a-8dbb-0d07410a1fd5'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:05.569122 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-4a9e25eb-7cc2-481a-9b2d-3f3076bab44d tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '950686305703462a8dadb2079a4d0ade', 'request_id': 'req-4a9e25eb-7cc2-481a-9b2d-3f3076bab44d'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:05.578193 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-4a9e25eb-7cc2-481a-9b2d-3f3076bab44d tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '950686305703462a8dadb2079a4d0ade', 'request_id': 'req-4a9e25eb-7cc2-481a-9b2d-3f3076bab44d'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:05.578693 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-101d3138-b545-4d5a-8dbb-0d07410a1fd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9df4f468c1740dba748fa30cc0cff0a', 'request_id': 'req-101d3138-b545-4d5a-8dbb-0d07410a1fd5'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:05.597617 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-101d3138-b545-4d5a-8dbb-0d07410a1fd5 admin admin] The token cache is being invalidate because project a9df4f468c1740dba748fa30cc0cff0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:05.597976 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-101d3138-b545-4d5a-8dbb-0d07410a1fd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:05.599290 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-101d3138-b545-4d5a-8dbb-0d07410a1fd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:05.601137 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 914/1843] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:05 2021] DELETE /identity/v3/projects/a9df4f468c1740dba748fa30cc0cff0a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:05.606859 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-4a9e25eb-7cc2-481a-9b2d-3f3076bab44d tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '950686305703462a8dadb2079a4d0ade', 'request_id': 'req-4a9e25eb-7cc2-481a-9b2d-3f3076bab44d'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:05.607582 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d3138-b545-4d5a-8dbb-0d07410a1fd5 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:05.609334 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-101d3138-b545-4d5a-8dbb-0d07410a1fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:05.643933 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-4a9e25eb-7cc2-481a-9b2d-3f3076bab44d tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] The token cache is being invalidate because project 950686305703462a8dadb2079a4d0ade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:05.644412 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-4a9e25eb-7cc2-481a-9b2d-3f3076bab44d tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:05.645512 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-4a9e25eb-7cc2-481a-9b2d-3f3076bab44d tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:05.652125 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 930/1844] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:05 2021] DELETE /identity/v3/projects/950686305703462a8dadb2079a4d0ade => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:05.652125 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e25eb-7cc2-481a-9b2d-3f3076bab44d tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:05.652369 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-4a9e25eb-7cc2-481a-9b2d-3f3076bab44d tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:05.757985 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d3138-b545-4d5a-8dbb-0d07410a1fd5 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:05.826329 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e25eb-7cc2-481a-9b2d-3f3076bab44d tempest-VolumeQuotaClassesTest-998027188 tempest-VolumeQuotaClassesTest-998027188-project-admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:05.833586 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae63cd3-d85b-45bf-ab49-4c863c3e33f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:05.834783 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae63cd3-d85b-45bf-ab49-4c863c3e33f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:05.835184 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae63cd3-d85b-45bf-ab49-4c863c3e33f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:05.835605 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae63cd3-d85b-45bf-ab49-4c863c3e33f0 admin admin] PATH_INFO: `/v3/projects/d6c6965ef3444ea7a421f56e18d95a1e` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:05.838130 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae63cd3-d85b-45bf-ab49-4c863c3e33f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c6965ef3444ea7a421f56e18d95a1e)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:05.840054 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae63cd3-d85b-45bf-ab49-4c863c3e33f0 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:05.865423 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c0672-4d34-4888-8379-e27292d0b222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:05.867410 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c0672-4d34-4888-8379-e27292d0b222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:05.868082 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c0672-4d34-4888-8379-e27292d0b222 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:05.869862 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c0672-4d34-4888-8379-e27292d0b222 admin admin] PATH_INFO: `/v3/users/ef4d60cf2c664439a90c7834e7357ed4` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:05.872886 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c0672-4d34-4888-8379-e27292d0b222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef4d60cf2c664439a90c7834e7357ed4)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:05.877779 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c0672-4d34-4888-8379-e27292d0b222 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:05.940036 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-0ae63cd3-d85b-45bf-ab49-4c863c3e33f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c6965ef3444ea7a421f56e18d95a1e', 'request_id': 'req-0ae63cd3-d85b-45bf-ab49-4c863c3e33f0'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:05.956595 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-0ae63cd3-d85b-45bf-ab49-4c863c3e33f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c6965ef3444ea7a421f56e18d95a1e', 'request_id': 'req-0ae63cd3-d85b-45bf-ab49-4c863c3e33f0'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:05.975041 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-0ae63cd3-d85b-45bf-ab49-4c863c3e33f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c6965ef3444ea7a421f56e18d95a1e', 'request_id': 'req-0ae63cd3-d85b-45bf-ab49-4c863c3e33f0'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:06.006792 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-0ae63cd3-d85b-45bf-ab49-4c863c3e33f0 admin admin] The token cache is being invalidate because project d6c6965ef3444ea7a421f56e18d95a1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:06.009739 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-0ae63cd3-d85b-45bf-ab49-4c863c3e33f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:06.010567 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b98c0672-4d34-4888-8379-e27292d0b222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef4d60cf2c664439a90c7834e7357ed4'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:06.011253 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-0ae63cd3-d85b-45bf-ab49-4c863c3e33f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:06.011667 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b98c0672-4d34-4888-8379-e27292d0b222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef4d60cf2c664439a90c7834e7357ed4'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:06.014130 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 931/1845] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:05 2021] DELETE /identity/v3/projects/d6c6965ef3444ea7a421f56e18d95a1e => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:06.016490 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cee73-e742-499e-ba6a-abede531e563 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:06.016889 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cee73-e742-499e-ba6a-abede531e563 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:06.017933 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cee73-e742-499e-ba6a-abede531e563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:06.057557 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b98c0672-4d34-4888-8379-e27292d0b222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef4d60cf2c664439a90c7834e7357ed4'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:06.069968 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-0a2cee73-e742-499e-ba6a-abede531e563 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:06.071249 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-0a2cee73-e742-499e-ba6a-abede531e563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:06.072956 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b98c0672-4d34-4888-8379-e27292d0b222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef4d60cf2c664439a90c7834e7357ed4'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:06.086781 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b98c0672-4d34-4888-8379-e27292d0b222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef4d60cf2c664439a90c7834e7357ed4'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:06.095418 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 915/1846] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:05 2021] DELETE /identity/v3/users/ef4d60cf2c664439a90c7834e7357ed4 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:06.098883 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c0672-4d34-4888-8379-e27292d0b222 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:06.101201 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-b98c0672-4d34-4888-8379-e27292d0b222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:06.221576 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 932/1847] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:06.222435 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cee73-e742-499e-ba6a-abede531e563 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:06.229180 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-0a2cee73-e742-499e-ba6a-abede531e563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:06.241053 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c0672-4d34-4888-8379-e27292d0b222 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:06.247219 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cee73-e742-499e-ba6a-abede531e563 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:06.254491 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90361043-4a40-4ac2-a863-60240f55458c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:06.255602 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90361043-4a40-4ac2-a863-60240f55458c admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:06.255874 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90361043-4a40-4ac2-a863-60240f55458c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:06.256194 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90361043-4a40-4ac2-a863-60240f55458c admin admin] PATH_INFO: `/v3/users/58aad16a83be43709b98a92357f064d0` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:06.258169 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90361043-4a40-4ac2-a863-60240f55458c admin admin] RBAC: Authorizing `identity:delete_user(user_id=58aad16a83be43709b98a92357f064d0)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:06.261305 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90361043-4a40-4ac2-a863-60240f55458c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:06.263628 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72935d12-f3e2-46c9-86f9-a19e82ed996a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:06.264475 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72935d12-f3e2-46c9-86f9-a19e82ed996a admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:06.264768 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72935d12-f3e2-46c9-86f9-a19e82ed996a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:06.265086 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72935d12-f3e2-46c9-86f9-a19e82ed996a admin admin] PATH_INFO: `/v3/users/83d046db359b4008a4fdb8c32ad8e84a` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:06.266982 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72935d12-f3e2-46c9-86f9-a19e82ed996a admin admin] RBAC: Authorizing `identity:delete_user(user_id=83d046db359b4008a4fdb8c32ad8e84a)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:06.270469 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72935d12-f3e2-46c9-86f9-a19e82ed996a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:06.349858 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-90361043-4a40-4ac2-a863-60240f55458c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58aad16a83be43709b98a92357f064d0'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:06.350670 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-90361043-4a40-4ac2-a863-60240f55458c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58aad16a83be43709b98a92357f064d0'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:06.371524 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-90361043-4a40-4ac2-a863-60240f55458c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58aad16a83be43709b98a92357f064d0'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:06.373479 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-72935d12-f3e2-46c9-86f9-a19e82ed996a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83d046db359b4008a4fdb8c32ad8e84a'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:06.374831 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-72935d12-f3e2-46c9-86f9-a19e82ed996a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83d046db359b4008a4fdb8c32ad8e84a'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:06.390561 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-90361043-4a40-4ac2-a863-60240f55458c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58aad16a83be43709b98a92357f064d0'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:06.403116 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-72935d12-f3e2-46c9-86f9-a19e82ed996a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83d046db359b4008a4fdb8c32ad8e84a'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:06.413002 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-90361043-4a40-4ac2-a863-60240f55458c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58aad16a83be43709b98a92357f064d0'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:06.420207 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-72935d12-f3e2-46c9-86f9-a19e82ed996a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83d046db359b4008a4fdb8c32ad8e84a'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:06.430809 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 916/1848] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:06 2021] DELETE /identity/v3/users/58aad16a83be43709b98a92357f064d0 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:06.430809 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02a374-b931-4a32-a80f-5fb23e89ef75 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:06.431485 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02a374-b931-4a32-a80f-5fb23e89ef75 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:06.431884 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02a374-b931-4a32-a80f-5fb23e89ef75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:06.435170 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-72935d12-f3e2-46c9-86f9-a19e82ed996a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83d046db359b4008a4fdb8c32ad8e84a'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:06.444261 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 933/1849] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:06 2021] DELETE /identity/v3/users/83d046db359b4008a4fdb8c32ad8e84a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:06.446457 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72935d12-f3e2-46c9-86f9-a19e82ed996a admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:06.448698 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-72935d12-f3e2-46c9-86f9-a19e82ed996a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:06.473007 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-0d02a374-b931-4a32-a80f-5fb23e89ef75 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:06.475165 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-0d02a374-b931-4a32-a80f-5fb23e89ef75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:06.570735 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72935d12-f3e2-46c9-86f9-a19e82ed996a admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:06.576532 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558bac6-7636-4474-814f-f62ce882be68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:06.577405 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558bac6-7636-4474-814f-f62ce882be68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:06.577702 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558bac6-7636-4474-814f-f62ce882be68 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:06.577986 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558bac6-7636-4474-814f-f62ce882be68 admin admin] PATH_INFO: `/v3/users/60123f44842340ed8bd8fc88c7debca9` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:06.579400 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558bac6-7636-4474-814f-f62ce882be68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60123f44842340ed8bd8fc88c7debca9)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:06.581437 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558bac6-7636-4474-814f-f62ce882be68 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:06.595740 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 917/1850] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:06.608677 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930db4b6-ed7d-42f5-a0d2-d32218a82367 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:06.609008 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930db4b6-ed7d-42f5-a0d2-d32218a82367 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:06.609491 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930db4b6-ed7d-42f5-a0d2-d32218a82367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:06.645027 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-930db4b6-ed7d-42f5-a0d2-d32218a82367 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:06.645027 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-930db4b6-ed7d-42f5-a0d2-d32218a82367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:06.653826 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 918/1851] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:06.658928 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-e558bac6-7636-4474-814f-f62ce882be68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60123f44842340ed8bd8fc88c7debca9'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:06.659607 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e17d7-e324-42c9-84af-fdcdc5f73092 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:06.659755 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-e558bac6-7636-4474-814f-f62ce882be68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60123f44842340ed8bd8fc88c7debca9'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:06.659903 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e17d7-e324-42c9-84af-fdcdc5f73092 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:06.659903 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e17d7-e324-42c9-84af-fdcdc5f73092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:06.670454 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-e558bac6-7636-4474-814f-f62ce882be68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60123f44842340ed8bd8fc88c7debca9'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:06.681201 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-e558bac6-7636-4474-814f-f62ce882be68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60123f44842340ed8bd8fc88c7debca9'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:06.690799 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-407e17d7-e324-42c9-84af-fdcdc5f73092 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:06.692250 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-407e17d7-e324-42c9-84af-fdcdc5f73092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:06.692560 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-e558bac6-7636-4474-814f-f62ce882be68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60123f44842340ed8bd8fc88c7debca9'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:06.702329 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 919/1852] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:06.702627 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 934/1853] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:06 2021] DELETE /identity/v3/users/60123f44842340ed8bd8fc88c7debca9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:06.703452 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e17d7-e324-42c9-84af-fdcdc5f73092 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:06.703782 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558bac6-7636-4474-814f-f62ce882be68 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:06.709041 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-407e17d7-e324-42c9-84af-fdcdc5f73092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:06.709664 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e558bac6-7636-4474-814f-f62ce882be68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:06.800659 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558bac6-7636-4474-814f-f62ce882be68 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:06.806683 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d756cd-393f-4145-a663-296e8def5d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:06.807303 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d756cd-393f-4145-a663-296e8def5d33 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:06.807597 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d756cd-393f-4145-a663-296e8def5d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:06.807934 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d756cd-393f-4145-a663-296e8def5d33 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:06.808597 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d756cd-393f-4145-a663-296e8def5d33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:40:06.808960 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d756cd-393f-4145-a663-296e8def5d33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:06.810591 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d756cd-393f-4145-a663-296e8def5d33 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:06.826556 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e17d7-e324-42c9-84af-fdcdc5f73092 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:06.841669 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 935/1854] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:40:06.842984 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b6589-45e9-4ff9-9f94-5695a4bdd859 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:06.843278 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b6589-45e9-4ff9-9f94-5695a4bdd859 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:06.845766 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b6589-45e9-4ff9-9f94-5695a4bdd859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:06.896930 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-651b6589-45e9-4ff9-9f94-5695a4bdd859 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:06.898396 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-651b6589-45e9-4ff9-9f94-5695a4bdd859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:06.906411 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b8987-0288-4a28-9ce3-5b1b9ca642ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:06.907381 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b8987-0288-4a28-9ce3-5b1b9ca642ee service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:06.907631 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b8987-0288-4a28-9ce3-5b1b9ca642ee service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:06.908024 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b8987-0288-4a28-9ce3-5b1b9ca642ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:06.910226 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e64b8987-0288-4a28-9ce3-5b1b9ca642ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:06.916755 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 936/1855] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:06.917636 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b6589-45e9-4ff9-9f94-5695a4bdd859 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:06.927659 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b8987-0288-4a28-9ce3-5b1b9ca642ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:06.929135 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b8987-0288-4a28-9ce3-5b1b9ca642ee service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:06.937847 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b6589-45e9-4ff9-9f94-5695a4bdd859 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:06.940913 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 920/1856] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:06.942036 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b8987-0288-4a28-9ce3-5b1b9ca642ee service neutron] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:06.949407 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06191b3a-f107-4da6-8fc8-77df0f7bff33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:06.950122 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06191b3a-f107-4da6-8fc8-77df0f7bff33 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:06.950490 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06191b3a-f107-4da6-8fc8-77df0f7bff33 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:06.950992 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06191b3a-f107-4da6-8fc8-77df0f7bff33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:06.959690 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b8987-0288-4a28-9ce3-5b1b9ca642ee service neutron] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:06.967005 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03fa27-0fdc-4ef5-8062-882989218eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:06.967830 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03fa27-0fdc-4ef5-8062-882989218eff admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:06.967946 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06191b3a-f107-4da6-8fc8-77df0f7bff33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:06.968388 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03fa27-0fdc-4ef5-8062-882989218eff admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:06.968770 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03fa27-0fdc-4ef5-8062-882989218eff admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:06.969872 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03fa27-0fdc-4ef5-8062-882989218eff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:06.970620 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06191b3a-f107-4da6-8fc8-77df0f7bff33 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:06.972083 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03fa27-0fdc-4ef5-8062-882989218eff admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:06.995110 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 937/1857] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:06.996033 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06191b3a-f107-4da6-8fc8-77df0f7bff33 service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:07.024854 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 921/1858] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:06 2021] POST /identity/v3/projects => generated 365 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:07.025033 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06191b3a-f107-4da6-8fc8-77df0f7bff33 service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:07.026736 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03fa27-0fdc-4ef5-8062-882989218eff admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:07.088062 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273003d8-57cb-49f1-b027-5727d3d24d31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:07.088896 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273003d8-57cb-49f1-b027-5727d3d24d31 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:07.088896 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273003d8-57cb-49f1-b027-5727d3d24d31 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:07.089174 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273003d8-57cb-49f1-b027-5727d3d24d31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:07.115251 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03fa27-0fdc-4ef5-8062-882989218eff admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:07.123380 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172aa34-cc0f-466e-8729-0771eac41d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:07.124537 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172aa34-cc0f-466e-8729-0771eac41d8b admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:07.125063 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172aa34-cc0f-466e-8729-0771eac41d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:07.125358 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172aa34-cc0f-466e-8729-0771eac41d8b admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:07.126024 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172aa34-cc0f-466e-8729-0771eac41d8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:07.128583 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172aa34-cc0f-466e-8729-0771eac41d8b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:07.161883 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 922/1859] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:07 2021] POST /identity/v3/users => generated 283 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:07.164324 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172aa34-cc0f-466e-8729-0771eac41d8b admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:07.166097 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273003d8-57cb-49f1-b027-5727d3d24d31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:07.167545 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273003d8-57cb-49f1-b027-5727d3d24d31 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:07.177617 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 938/1860] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:07.177823 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172aa34-cc0f-466e-8729-0771eac41d8b admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:07.183410 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5831de-cb93-4e30-a6ba-a73f4e45509d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:07.184071 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5831de-cb93-4e30-a6ba-a73f4e45509d admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:07.184384 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5831de-cb93-4e30-a6ba-a73f4e45509d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:07.184670 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5831de-cb93-4e30-a6ba-a73f4e45509d admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:07.185505 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5831de-cb93-4e30-a6ba-a73f4e45509d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:07.187754 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5831de-cb93-4e30-a6ba-a73f4e45509d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:07.200270 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 923/1861] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:07 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:07.204515 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273003d8-57cb-49f1-b027-5727d3d24d31 service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:07.218316 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273003d8-57cb-49f1-b027-5727d3d24d31 service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:07.223206 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078d83c-05d7-4cf9-8ceb-864c6c2e55e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:07.223895 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078d83c-05d7-4cf9-8ceb-864c6c2e55e4 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:07.224076 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078d83c-05d7-4cf9-8ceb-864c6c2e55e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:07.224364 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078d83c-05d7-4cf9-8ceb-864c6c2e55e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:07.225146 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078d83c-05d7-4cf9-8ceb-864c6c2e55e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:07.227213 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078d83c-05d7-4cf9-8ceb-864c6c2e55e4 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:07.238819 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 939/1862] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:07 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:07.243064 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5831de-cb93-4e30-a6ba-a73f4e45509d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:07.254334 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5831de-cb93-4e30-a6ba-a73f4e45509d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:07.260372 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f98b36-2407-4a2b-a5d5-66c5b2513d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:07.261253 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f98b36-2407-4a2b-a5d5-66c5b2513d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:07.261540 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f98b36-2407-4a2b-a5d5-66c5b2513d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:07.261831 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f98b36-2407-4a2b-a5d5-66c5b2513d01 admin admin] PATH_INFO: `/v3/projects/2b5ba948094d41159b4d9db29fe48107/users/fd759baff19e454fa9efb37082eeb817/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:07.283093 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f98b36-2407-4a2b-a5d5-66c5b2513d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b5ba948094d41159b4d9db29fe48107, user_id=fd759baff19e454fa9efb37082eeb817, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:07.286015 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f98b36-2407-4a2b-a5d5-66c5b2513d01 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:07.299609 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 924/1863] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:07 2021] PUT /identity/v3/projects/2b5ba948094d41159b4d9db29fe48107/users/fd759baff19e454fa9efb37082eeb817/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:07.310205 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff006457-55b6-427a-ab5b-fe84a62d774d None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:07.310508 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff006457-55b6-427a-ab5b-fe84a62d774d None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:07.311035 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff006457-55b6-427a-ab5b-fe84a62d774d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:07.350644 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-ff006457-55b6-427a-ab5b-fe84a62d774d None None] MFA Rules not processed for user `fd759baff19e454fa9efb37082eeb817`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:07.352026 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-ff006457-55b6-427a-ab5b-fe84a62d774d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:07.438284 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 940/1864] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:07 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:07.439932 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f98b36-2407-4a2b-a5d5-66c5b2513d01 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:07.573286 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f98b36-2407-4a2b-a5d5-66c5b2513d01 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:07.578205 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d4414-3eca-46a0-ae22-a9a27d014c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:07.578813 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d4414-3eca-46a0-ae22-a9a27d014c99 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:07.579150 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d4414-3eca-46a0-ae22-a9a27d014c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:07.579442 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d4414-3eca-46a0-ae22-a9a27d014c99 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:07.580092 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d4414-3eca-46a0-ae22-a9a27d014c99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:07.582217 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d4414-3eca-46a0-ae22-a9a27d014c99 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:07.598915 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff006457-55b6-427a-ab5b-fe84a62d774d None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:07.599981 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-ff006457-55b6-427a-ab5b-fe84a62d774d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:07.628873 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 925/1865] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:07 2021] POST /identity/v3/projects => generated 367 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:07.631306 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d4414-3eca-46a0-ae22-a9a27d014c99 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:07.637708 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff006457-55b6-427a-ab5b-fe84a62d774d None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:07.734991 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d4414-3eca-46a0-ae22-a9a27d014c99 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:07.740863 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7e350-5d95-462a-999b-cd684286c4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:07.741616 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7e350-5d95-462a-999b-cd684286c4de admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:07.742009 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7e350-5d95-462a-999b-cd684286c4de admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:07.742370 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7e350-5d95-462a-999b-cd684286c4de admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:07.744269 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7e350-5d95-462a-999b-cd684286c4de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:07.746789 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7e350-5d95-462a-999b-cd684286c4de admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:07.776131 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 926/1866] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:07 2021] POST /identity/v3/users => generated 290 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:07.781216 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7e350-5d95-462a-999b-cd684286c4de admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:07.806471 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8bcff-ffdf-4dd6-a072-94fafedafd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:07.807262 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8bcff-ffdf-4dd6-a072-94fafedafd09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:07.807611 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8bcff-ffdf-4dd6-a072-94fafedafd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:07.807823 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8bcff-ffdf-4dd6-a072-94fafedafd09 admin admin] PATH_INFO: `/v3/projects/e510d3b81b9545c6aeff8043375fff53` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:07.812650 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7e350-5d95-462a-999b-cd684286c4de admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:07.820267 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90bede-4d57-4a03-9224-b9928381eb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:07.822485 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90bede-4d57-4a03-9224-b9928381eb71 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:07.823142 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90bede-4d57-4a03-9224-b9928381eb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:07.823436 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90bede-4d57-4a03-9224-b9928381eb71 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:07.824400 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8bcff-ffdf-4dd6-a072-94fafedafd09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e510d3b81b9545c6aeff8043375fff53)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:07.824832 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90bede-4d57-4a03-9224-b9928381eb71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:07.828556 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90bede-4d57-4a03-9224-b9928381eb71 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:07.834666 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8bcff-ffdf-4dd6-a072-94fafedafd09 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:07.846846 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 927/1867] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:07 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:07.852450 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90bede-4d57-4a03-9224-b9928381eb71 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:07.882092 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90bede-4d57-4a03-9224-b9928381eb71 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:07.921348 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f90db9-473b-4335-8879-e4bab108bc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:07.922509 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f90db9-473b-4335-8879-e4bab108bc9a admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:07.922908 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f90db9-473b-4335-8879-e4bab108bc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:07.923741 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f90db9-473b-4335-8879-e4bab108bc9a admin admin] PATH_INFO: `/v3/projects/09eb9697f867422f9fe28371e49c3d2e/users/a07bdc3c0c2b48a8b9afc451ff813b2a/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:07.982184 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f90db9-473b-4335-8879-e4bab108bc9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=09eb9697f867422f9fe28371e49c3d2e, user_id=a07bdc3c0c2b48a8b9afc451ff813b2a, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:07.985062 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f90db9-473b-4335-8879-e4bab108bc9a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:07.988619 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-01f8bcff-ffdf-4dd6-a072-94fafedafd09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e510d3b81b9545c6aeff8043375fff53', 'request_id': 'req-01f8bcff-ffdf-4dd6-a072-94fafedafd09'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:07.998450 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-01f8bcff-ffdf-4dd6-a072-94fafedafd09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e510d3b81b9545c6aeff8043375fff53', 'request_id': 'req-01f8bcff-ffdf-4dd6-a072-94fafedafd09'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.011266 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-01f8bcff-ffdf-4dd6-a072-94fafedafd09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e510d3b81b9545c6aeff8043375fff53', 'request_id': 'req-01f8bcff-ffdf-4dd6-a072-94fafedafd09'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.014064 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 928/1868] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:07 2021] PUT /identity/v3/projects/09eb9697f867422f9fe28371e49c3d2e/users/a07bdc3c0c2b48a8b9afc451ff813b2a/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:08.015263 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f90db9-473b-4335-8879-e4bab108bc9a admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:08.019197 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-f6f90db9-473b-4335-8879-e4bab108bc9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:08.076910 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-01f8bcff-ffdf-4dd6-a072-94fafedafd09 admin admin] The token cache is being invalidate because project e510d3b81b9545c6aeff8043375fff53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:08.077234 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-01f8bcff-ffdf-4dd6-a072-94fafedafd09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.079179 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-01f8bcff-ffdf-4dd6-a072-94fafedafd09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.082104 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 941/1869] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:07 2021] DELETE /identity/v3/projects/e510d3b81b9545c6aeff8043375fff53 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:08.084280 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8bcff-ffdf-4dd6-a072-94fafedafd09 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:08.089028 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-01f8bcff-ffdf-4dd6-a072-94fafedafd09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:08.159008 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f90db9-473b-4335-8879-e4bab108bc9a admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:08.164287 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839eb0a3-ab12-4eab-81a8-0a0f9485c212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:08.165832 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839eb0a3-ab12-4eab-81a8-0a0f9485c212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:08.166124 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839eb0a3-ab12-4eab-81a8-0a0f9485c212 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:08.166407 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839eb0a3-ab12-4eab-81a8-0a0f9485c212 admin admin] PATH_INFO: `/v3/projects/34c82c7bffc34edcb45ea448ef76b027` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:08.167561 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839eb0a3-ab12-4eab-81a8-0a0f9485c212 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34c82c7bffc34edcb45ea448ef76b027)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:08.169680 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839eb0a3-ab12-4eab-81a8-0a0f9485c212 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:08.260551 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8bcff-ffdf-4dd6-a072-94fafedafd09 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:08.266263 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68936f09-61f5-431a-a8ad-ce87660657cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:08.267261 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68936f09-61f5-431a-a8ad-ce87660657cb admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:08.267730 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68936f09-61f5-431a-a8ad-ce87660657cb admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:08.274685 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68936f09-61f5-431a-a8ad-ce87660657cb admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:08.276402 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68936f09-61f5-431a-a8ad-ce87660657cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:08.278650 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68936f09-61f5-431a-a8ad-ce87660657cb admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:08.303585 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 942/1870] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:08 2021] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:08.305207 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902403b-584f-4398-be12-0563d0e88bcf None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:08.306332 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902403b-584f-4398-be12-0563d0e88bcf None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:08.306779 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902403b-584f-4398-be12-0563d0e88bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:08.319604 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-839eb0a3-ab12-4eab-81a8-0a0f9485c212 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34c82c7bffc34edcb45ea448ef76b027', 'request_id': 'req-839eb0a3-ab12-4eab-81a8-0a0f9485c212'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.331932 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-0902403b-584f-4398-be12-0563d0e88bcf None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:08.333387 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-0902403b-584f-4398-be12-0563d0e88bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:08.334392 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-839eb0a3-ab12-4eab-81a8-0a0f9485c212 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34c82c7bffc34edcb45ea448ef76b027', 'request_id': 'req-839eb0a3-ab12-4eab-81a8-0a0f9485c212'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.340807 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-839eb0a3-ab12-4eab-81a8-0a0f9485c212 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34c82c7bffc34edcb45ea448ef76b027', 'request_id': 'req-839eb0a3-ab12-4eab-81a8-0a0f9485c212'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.357880 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-839eb0a3-ab12-4eab-81a8-0a0f9485c212 admin admin] The token cache is being invalidate because project 34c82c7bffc34edcb45ea448ef76b027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:08.359686 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-839eb0a3-ab12-4eab-81a8-0a0f9485c212 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.361093 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-839eb0a3-ab12-4eab-81a8-0a0f9485c212 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.363380 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 929/1871] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:08 2021] DELETE /identity/v3/projects/34c82c7bffc34edcb45ea448ef76b027 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:08.364392 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839eb0a3-ab12-4eab-81a8-0a0f9485c212 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:08.369906 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-839eb0a3-ab12-4eab-81a8-0a0f9485c212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:08.423101 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 943/1872] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:08.423975 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902403b-584f-4398-be12-0563d0e88bcf None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:08.425441 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-0902403b-584f-4398-be12-0563d0e88bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:08.451088 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902403b-584f-4398-be12-0563d0e88bcf None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:08.464120 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839eb0a3-ab12-4eab-81a8-0a0f9485c212 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:08.465405 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c932388-9f7b-470d-8e63-b64998215759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:08.466207 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c932388-9f7b-470d-8e63-b64998215759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:08.466619 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c932388-9f7b-470d-8e63-b64998215759 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:08.466905 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c932388-9f7b-470d-8e63-b64998215759 admin admin] PATH_INFO: `/v3/projects/470952c1567f46e79fca4d8ce8467a73` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:08.469058 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c932388-9f7b-470d-8e63-b64998215759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=470952c1567f46e79fca4d8ce8467a73)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:08.470963 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c932388-9f7b-470d-8e63-b64998215759 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:08.476812 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e21868-ebbd-41f7-af4c-53bfdce53f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:08.478961 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e21868-ebbd-41f7-af4c-53bfdce53f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:08.481379 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e21868-ebbd-41f7-af4c-53bfdce53f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:08.481900 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e21868-ebbd-41f7-af4c-53bfdce53f80 admin admin] PATH_INFO: `/v3/projects/c5d5f36fd7db4192b0fe77d2bf9c969c` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:08.483860 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e21868-ebbd-41f7-af4c-53bfdce53f80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5d5f36fd7db4192b0fe77d2bf9c969c)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:08.486409 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e21868-ebbd-41f7-af4c-53bfdce53f80 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:08.546496 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-7c932388-9f7b-470d-8e63-b64998215759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '470952c1567f46e79fca4d8ce8467a73', 'request_id': 'req-7c932388-9f7b-470d-8e63-b64998215759'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.556677 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-91e21868-ebbd-41f7-af4c-53bfdce53f80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5d5f36fd7db4192b0fe77d2bf9c969c', 'request_id': 'req-91e21868-ebbd-41f7-af4c-53bfdce53f80'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.563416 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-7c932388-9f7b-470d-8e63-b64998215759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '470952c1567f46e79fca4d8ce8467a73', 'request_id': 'req-7c932388-9f7b-470d-8e63-b64998215759'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.569682 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-91e21868-ebbd-41f7-af4c-53bfdce53f80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5d5f36fd7db4192b0fe77d2bf9c969c', 'request_id': 'req-91e21868-ebbd-41f7-af4c-53bfdce53f80'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.576392 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-91e21868-ebbd-41f7-af4c-53bfdce53f80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5d5f36fd7db4192b0fe77d2bf9c969c', 'request_id': 'req-91e21868-ebbd-41f7-af4c-53bfdce53f80'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.577720 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-7c932388-9f7b-470d-8e63-b64998215759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '470952c1567f46e79fca4d8ce8467a73', 'request_id': 'req-7c932388-9f7b-470d-8e63-b64998215759'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.597974 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-7c932388-9f7b-470d-8e63-b64998215759 admin admin] The token cache is being invalidate because project 470952c1567f46e79fca4d8ce8467a73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:08.598629 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-7c932388-9f7b-470d-8e63-b64998215759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.599808 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-7c932388-9f7b-470d-8e63-b64998215759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.600501 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-91e21868-ebbd-41f7-af4c-53bfdce53f80 admin admin] The token cache is being invalidate because project c5d5f36fd7db4192b0fe77d2bf9c969c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:08.600815 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-91e21868-ebbd-41f7-af4c-53bfdce53f80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.601515 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-91e21868-ebbd-41f7-af4c-53bfdce53f80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.601683 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 944/1873] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:08 2021] DELETE /identity/v3/projects/470952c1567f46e79fca4d8ce8467a73 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:08.606124 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c932388-9f7b-470d-8e63-b64998215759 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:08.606271 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 930/1874] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:08 2021] DELETE /identity/v3/projects/c5d5f36fd7db4192b0fe77d2bf9c969c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:08.606963 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e21868-ebbd-41f7-af4c-53bfdce53f80 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:08.607811 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-7c932388-9f7b-470d-8e63-b64998215759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:08.608262 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-91e21868-ebbd-41f7-af4c-53bfdce53f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:08.691631 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e21868-ebbd-41f7-af4c-53bfdce53f80 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:08.695510 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c932388-9f7b-470d-8e63-b64998215759 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:08.696378 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962e333-0165-45ae-b544-6bb60462b520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:08.697819 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962e333-0165-45ae-b544-6bb60462b520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:08.698158 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962e333-0165-45ae-b544-6bb60462b520 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:08.698387 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962e333-0165-45ae-b544-6bb60462b520 admin admin] PATH_INFO: `/v3/users/03900d87ad374237a7ba23019f0167d6` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:08.699510 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962e333-0165-45ae-b544-6bb60462b520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03900d87ad374237a7ba23019f0167d6)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:08.701616 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962e333-0165-45ae-b544-6bb60462b520 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:08.702485 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b098c-d034-4093-a73d-392c20779697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:08.703989 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b098c-d034-4093-a73d-392c20779697 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:08.704294 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b098c-d034-4093-a73d-392c20779697 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:08.704592 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b098c-d034-4093-a73d-392c20779697 admin admin] PATH_INFO: `/v3/projects/09eb9697f867422f9fe28371e49c3d2e/users/a07bdc3c0c2b48a8b9afc451ff813b2a/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:08.706954 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b098c-d034-4093-a73d-392c20779697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09eb9697f867422f9fe28371e49c3d2e, user_id=a07bdc3c0c2b48a8b9afc451ff813b2a, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:08.710113 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b098c-d034-4093-a73d-392c20779697 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:08.732884 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 945/1875] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:08 2021] PUT /identity/v3/projects/09eb9697f867422f9fe28371e49c3d2e/users/a07bdc3c0c2b48a8b9afc451ff813b2a/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:08.734569 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b7176-1257-4cf5-b9ff-f7e548cc7c8e None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:08.734861 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b7176-1257-4cf5-b9ff-f7e548cc7c8e None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:08.735139 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b7176-1257-4cf5-b9ff-f7e548cc7c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:08.761183 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-769b7176-1257-4cf5-b9ff-f7e548cc7c8e None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:08.761935 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-769b7176-1257-4cf5-b9ff-f7e548cc7c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:08.765186 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-3962e333-0165-45ae-b544-6bb60462b520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03900d87ad374237a7ba23019f0167d6'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.766723 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-3962e333-0165-45ae-b544-6bb60462b520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03900d87ad374237a7ba23019f0167d6'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.782315 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-3962e333-0165-45ae-b544-6bb60462b520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03900d87ad374237a7ba23019f0167d6'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.792201 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-3962e333-0165-45ae-b544-6bb60462b520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03900d87ad374237a7ba23019f0167d6'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.833906 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-3962e333-0165-45ae-b544-6bb60462b520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03900d87ad374237a7ba23019f0167d6'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.841665 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 931/1876] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:08 2021] DELETE /identity/v3/users/03900d87ad374237a7ba23019f0167d6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:08.842500 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962e333-0165-45ae-b544-6bb60462b520 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:08.848211 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-3962e333-0165-45ae-b544-6bb60462b520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:08.853550 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 946/1877] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:08.854475 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b7176-1257-4cf5-b9ff-f7e548cc7c8e None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:08.855802 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-769b7176-1257-4cf5-b9ff-f7e548cc7c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:08.877224 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b7176-1257-4cf5-b9ff-f7e548cc7c8e None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:08.976237 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962e333-0165-45ae-b544-6bb60462b520 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:08.980297 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60895ded-1dab-42c1-b301-f7140cc2eda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:08.981228 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60895ded-1dab-42c1-b301-f7140cc2eda5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:08.981412 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456a222-d03f-4b01-a280-5a7e53b97a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:08.981935 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60895ded-1dab-42c1-b301-f7140cc2eda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:08.982225 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456a222-d03f-4b01-a280-5a7e53b97a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:08.982346 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60895ded-1dab-42c1-b301-f7140cc2eda5 admin admin] PATH_INFO: `/v3/users/6257cd2553804c57b772495aa0f5b3d1` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:08.982521 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456a222-d03f-4b01-a280-5a7e53b97a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:08.982813 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456a222-d03f-4b01-a280-5a7e53b97a73 admin admin] PATH_INFO: `/v3/users/17efa170e35e4f85adb1a8ae94e93841` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:08.984432 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456a222-d03f-4b01-a280-5a7e53b97a73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17efa170e35e4f85adb1a8ae94e93841)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:08.984553 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60895ded-1dab-42c1-b301-f7140cc2eda5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6257cd2553804c57b772495aa0f5b3d1)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:08.986631 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456a222-d03f-4b01-a280-5a7e53b97a73 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:08.987253 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60895ded-1dab-42c1-b301-f7140cc2eda5 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:09.050090 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-60895ded-1dab-42c1-b301-f7140cc2eda5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6257cd2553804c57b772495aa0f5b3d1'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:09.050846 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-60895ded-1dab-42c1-b301-f7140cc2eda5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6257cd2553804c57b772495aa0f5b3d1'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:09.053039 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-e456a222-d03f-4b01-a280-5a7e53b97a73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17efa170e35e4f85adb1a8ae94e93841'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:09.054011 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-e456a222-d03f-4b01-a280-5a7e53b97a73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17efa170e35e4f85adb1a8ae94e93841'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:09.065026 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-60895ded-1dab-42c1-b301-f7140cc2eda5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6257cd2553804c57b772495aa0f5b3d1'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:09.069126 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-e456a222-d03f-4b01-a280-5a7e53b97a73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17efa170e35e4f85adb1a8ae94e93841'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:09.073629 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-60895ded-1dab-42c1-b301-f7140cc2eda5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6257cd2553804c57b772495aa0f5b3d1'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:09.080175 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-e456a222-d03f-4b01-a280-5a7e53b97a73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17efa170e35e4f85adb1a8ae94e93841'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:09.082663 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-60895ded-1dab-42c1-b301-f7140cc2eda5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6257cd2553804c57b772495aa0f5b3d1'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:09.090207 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-e456a222-d03f-4b01-a280-5a7e53b97a73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17efa170e35e4f85adb1a8ae94e93841'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:09.090535 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 947/1878] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:08 2021] DELETE /identity/v3/users/6257cd2553804c57b772495aa0f5b3d1 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:09.091817 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b78b3-150a-4ea4-b829-7948033ce4aa None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:09.092112 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b78b3-150a-4ea4-b829-7948033ce4aa None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:09.092549 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b78b3-150a-4ea4-b829-7948033ce4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:09.102212 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 932/1879] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:08 2021] DELETE /identity/v3/users/17efa170e35e4f85adb1a8ae94e93841 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:09.103237 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456a222-d03f-4b01-a280-5a7e53b97a73 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:09.105885 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e456a222-d03f-4b01-a280-5a7e53b97a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:09.158981 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-c34b78b3-150a-4ea4-b829-7948033ce4aa None None] MFA Rules not processed for user `a07bdc3c0c2b48a8b9afc451ff813b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:09.160638 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-c34b78b3-150a-4ea4-b829-7948033ce4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:09.232938 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456a222-d03f-4b01-a280-5a7e53b97a73 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:09.247031 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bab8b-7f99-4090-86f4-53cc9160f4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:09.248901 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bab8b-7f99-4090-86f4-53cc9160f4eb admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:09.249783 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bab8b-7f99-4090-86f4-53cc9160f4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:09.250806 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bab8b-7f99-4090-86f4-53cc9160f4eb admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:09.252502 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bab8b-7f99-4090-86f4-53cc9160f4eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:40:09.253481 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bab8b-7f99-4090-86f4-53cc9160f4eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:09.258321 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bab8b-7f99-4090-86f4-53cc9160f4eb admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:09.281083 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 933/1880] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:40:09.282466 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bab8b-7f99-4090-86f4-53cc9160f4eb admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:09.287238 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 948/1881] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:09 2021] POST /identity/v3/auth/tokens => generated 3741 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:09.298791 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b78b3-150a-4ea4-b829-7948033ce4aa None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:09.300248 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-c34b78b3-150a-4ea4-b829-7948033ce4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:09.301465 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bab8b-7f99-4090-86f4-53cc9160f4eb admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:09.307841 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b05d8-b770-4752-b4ed-699cf22cc0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:09.308749 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b05d8-b770-4752-b4ed-699cf22cc0cb admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:09.309255 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b05d8-b770-4752-b4ed-699cf22cc0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:09.309773 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b05d8-b770-4752-b4ed-699cf22cc0cb admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:09.310660 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b05d8-b770-4752-b4ed-699cf22cc0cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:09.312964 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b05d8-b770-4752-b4ed-699cf22cc0cb admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:09.358852 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 934/1882] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:09 2021] POST /identity/v3/projects => generated 381 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:09.361807 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b05d8-b770-4752-b4ed-699cf22cc0cb admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:09.433142 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b78b3-150a-4ea4-b829-7948033ce4aa None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:09.514584 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b05d8-b770-4752-b4ed-699cf22cc0cb admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:09.527139 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce276fa-3534-440e-a4a3-2004d042cccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:09.527770 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce276fa-3534-440e-a4a3-2004d042cccd admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:09.528059 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce276fa-3534-440e-a4a3-2004d042cccd admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:09.528340 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce276fa-3534-440e-a4a3-2004d042cccd admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:09.529036 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce276fa-3534-440e-a4a3-2004d042cccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:09.530943 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce276fa-3534-440e-a4a3-2004d042cccd admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:09.559666 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32255bee-6aac-4557-8913-cb9da5285b49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:09.560773 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32255bee-6aac-4557-8913-cb9da5285b49 service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:09.561427 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32255bee-6aac-4557-8913-cb9da5285b49 service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:09.562169 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32255bee-6aac-4557-8913-cb9da5285b49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:09.574723 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 935/1883] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:09 2021] POST /identity/v3/users => generated 291 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:09.575576 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce276fa-3534-440e-a4a3-2004d042cccd admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:09.581385 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-1ce276fa-3534-440e-a4a3-2004d042cccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:09.609566 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce276fa-3534-440e-a4a3-2004d042cccd admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:09.614204 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08d6b3-3f1e-4b2b-b6b8-360e1af67f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:09.615003 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08d6b3-3f1e-4b2b-b6b8-360e1af67f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:09.615695 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08d6b3-3f1e-4b2b-b6b8-360e1af67f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:09.615695 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08d6b3-3f1e-4b2b-b6b8-360e1af67f09 admin admin] PATH_INFO: `/v3/projects/a4296a23cc6f43ab835ed853c3fc1565` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:09.617580 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08d6b3-3f1e-4b2b-b6b8-360e1af67f09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4296a23cc6f43ab835ed853c3fc1565)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:09.621269 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08d6b3-3f1e-4b2b-b6b8-360e1af67f09 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:09.677208 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32255bee-6aac-4557-8913-cb9da5285b49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:09.678969 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32255bee-6aac-4557-8913-cb9da5285b49 service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:09.690441 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 949/1884] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:09 2021] GET /identity/v3/auth/tokens => generated 3741 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:40:09.691582 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32255bee-6aac-4557-8913-cb9da5285b49 service cinder] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:09.703086 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32255bee-6aac-4557-8913-cb9da5285b49 service cinder] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:09.728762 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ac08d6b3-3f1e-4b2b-b6b8-360e1af67f09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4296a23cc6f43ab835ed853c3fc1565', 'request_id': 'req-ac08d6b3-3f1e-4b2b-b6b8-360e1af67f09'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:09.778445 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ac08d6b3-3f1e-4b2b-b6b8-360e1af67f09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4296a23cc6f43ab835ed853c3fc1565', 'request_id': 'req-ac08d6b3-3f1e-4b2b-b6b8-360e1af67f09'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:09.780236 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdd540-ac45-4889-8a37-031cb810c651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:09.781930 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdd540-ac45-4889-8a37-031cb810c651 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:09.783416 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdd540-ac45-4889-8a37-031cb810c651 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:09.783710 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdd540-ac45-4889-8a37-031cb810c651 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:09.785299 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cdd540-ac45-4889-8a37-031cb810c651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:09.788123 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cdd540-ac45-4889-8a37-031cb810c651 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:09.789130 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ac08d6b3-3f1e-4b2b-b6b8-360e1af67f09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4296a23cc6f43ab835ed853c3fc1565', 'request_id': 'req-ac08d6b3-3f1e-4b2b-b6b8-360e1af67f09'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:09.820455 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 950/1885] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:09 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:09.824612 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdd540-ac45-4889-8a37-031cb810c651 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:09.851337 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ac08d6b3-3f1e-4b2b-b6b8-360e1af67f09 admin admin] The token cache is being invalidate because project a4296a23cc6f43ab835ed853c3fc1565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:09.851860 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ac08d6b3-3f1e-4b2b-b6b8-360e1af67f09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:09.856751 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ac08d6b3-3f1e-4b2b-b6b8-360e1af67f09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:09.859078 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 936/1886] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:09 2021] DELETE /identity/v3/projects/a4296a23cc6f43ab835ed853c3fc1565 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:09.864032 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdd540-ac45-4889-8a37-031cb810c651 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:09.869262 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768010d-9de6-4d23-a7e4-a079c316343c None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:09.869706 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768010d-9de6-4d23-a7e4-a079c316343c None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:09.870124 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768010d-9de6-4d23-a7e4-a079c316343c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:09.882958 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6c411-ff40-4964-aa88-2ab811b57ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:09.887017 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6c411-ff40-4964-aa88-2ab811b57ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:09.888416 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6c411-ff40-4964-aa88-2ab811b57ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:09.888894 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6c411-ff40-4964-aa88-2ab811b57ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:09.904036 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6c411-ff40-4964-aa88-2ab811b57ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:09.910920 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6c411-ff40-4964-aa88-2ab811b57ee7 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:09.969632 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 951/1887] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:09 2021] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:09.972026 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6c411-ff40-4964-aa88-2ab811b57ee7 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:09.985864 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e8d6c411-ff40-4964-aa88-2ab811b57ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:09.989491 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-e768010d-9de6-4d23-a7e4-a079c316343c None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:09.990698 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e768010d-9de6-4d23-a7e4-a079c316343c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:09.998740 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 937/1888] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:09.999601 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768010d-9de6-4d23-a7e4-a079c316343c None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:10.001011 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e768010d-9de6-4d23-a7e4-a079c316343c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:10.006209 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6c411-ff40-4964-aa88-2ab811b57ee7 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:10.013159 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768010d-9de6-4d23-a7e4-a079c316343c None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:10.016811 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a920b2-c6f5-4108-b2f2-ed8090e92130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:10.017627 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a920b2-c6f5-4108-b2f2-ed8090e92130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:10.017912 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a920b2-c6f5-4108-b2f2-ed8090e92130 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:10.018062 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b15ceb-a5cd-4ed6-a552-3786bdd7e729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:10.018177 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a920b2-c6f5-4108-b2f2-ed8090e92130 admin admin] PATH_INFO: `/v3/projects/c7edaf82c7384a2b91165c91c4d70c65` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:10.018896 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b15ceb-a5cd-4ed6-a552-3786bdd7e729 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:10.019183 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b15ceb-a5cd-4ed6-a552-3786bdd7e729 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:10.019461 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b15ceb-a5cd-4ed6-a552-3786bdd7e729 admin admin] PATH_INFO: `/v3/projects/6c1b5d08ceb440fc8a8ca6c67adfa23c/users/9b21ecb959de4f7eab7b570afe0d065f/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:10.020742 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a920b2-c6f5-4108-b2f2-ed8090e92130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7edaf82c7384a2b91165c91c4d70c65)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:10.026601 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a920b2-c6f5-4108-b2f2-ed8090e92130 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:10.045066 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b15ceb-a5cd-4ed6-a552-3786bdd7e729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c1b5d08ceb440fc8a8ca6c67adfa23c, user_id=9b21ecb959de4f7eab7b570afe0d065f, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:10.048262 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b15ceb-a5cd-4ed6-a552-3786bdd7e729 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:10.065572 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 938/1889] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:09 2021] PUT /identity/v3/projects/6c1b5d08ceb440fc8a8ca6c67adfa23c/users/9b21ecb959de4f7eab7b570afe0d065f/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:10.066572 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b15ceb-a5cd-4ed6-a552-3786bdd7e729 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:10.068837 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-79b15ceb-a5cd-4ed6-a552-3786bdd7e729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:10.142694 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-37a920b2-c6f5-4108-b2f2-ed8090e92130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7edaf82c7384a2b91165c91c4d70c65', 'request_id': 'req-37a920b2-c6f5-4108-b2f2-ed8090e92130'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:10.154157 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-37a920b2-c6f5-4108-b2f2-ed8090e92130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7edaf82c7384a2b91165c91c4d70c65', 'request_id': 'req-37a920b2-c6f5-4108-b2f2-ed8090e92130'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:10.163276 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b15ceb-a5cd-4ed6-a552-3786bdd7e729 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:10.171957 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-37a920b2-c6f5-4108-b2f2-ed8090e92130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7edaf82c7384a2b91165c91c4d70c65', 'request_id': 'req-37a920b2-c6f5-4108-b2f2-ed8090e92130'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:10.192967 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-37a920b2-c6f5-4108-b2f2-ed8090e92130 admin admin] The token cache is being invalidate because project c7edaf82c7384a2b91165c91c4d70c65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:10.193355 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-37a920b2-c6f5-4108-b2f2-ed8090e92130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:10.194118 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-37a920b2-c6f5-4108-b2f2-ed8090e92130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:10.195680 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 952/1890] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:09 2021] DELETE /identity/v3/projects/c7edaf82c7384a2b91165c91c4d70c65 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:10.197584 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a920b2-c6f5-4108-b2f2-ed8090e92130 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:10.201285 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-37a920b2-c6f5-4108-b2f2-ed8090e92130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:10.264969 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faece341-4bb3-4d1a-9418-68edda3da98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:10.266098 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faece341-4bb3-4d1a-9418-68edda3da98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:10.266393 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faece341-4bb3-4d1a-9418-68edda3da98c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:10.266863 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faece341-4bb3-4d1a-9418-68edda3da98c admin admin] PATH_INFO: `/v3/projects/4094adf5cb944f1aa9cf865c283ee367` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:10.268112 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faece341-4bb3-4d1a-9418-68edda3da98c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4094adf5cb944f1aa9cf865c283ee367)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:10.270023 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faece341-4bb3-4d1a-9418-68edda3da98c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:10.283330 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a920b2-c6f5-4108-b2f2-ed8090e92130 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:10.287229 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5ec4a-6dd1-47fd-893d-7a56d01f1da5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:10.287836 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5ec4a-6dd1-47fd-893d-7a56d01f1da5 service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:10.288117 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5ec4a-6dd1-47fd-893d-7a56d01f1da5 service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:10.288394 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5ec4a-6dd1-47fd-893d-7a56d01f1da5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:10.290320 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-0bc5ec4a-6dd1-47fd-893d-7a56d01f1da5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:10.329262 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-faece341-4bb3-4d1a-9418-68edda3da98c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4094adf5cb944f1aa9cf865c283ee367', 'request_id': 'req-faece341-4bb3-4d1a-9418-68edda3da98c'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:10.348106 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-faece341-4bb3-4d1a-9418-68edda3da98c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4094adf5cb944f1aa9cf865c283ee367', 'request_id': 'req-faece341-4bb3-4d1a-9418-68edda3da98c'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:10.354780 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-faece341-4bb3-4d1a-9418-68edda3da98c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4094adf5cb944f1aa9cf865c283ee367', 'request_id': 'req-faece341-4bb3-4d1a-9418-68edda3da98c'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:10.365713 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5ec4a-6dd1-47fd-893d-7a56d01f1da5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:10.367168 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5ec4a-6dd1-47fd-893d-7a56d01f1da5 service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:10.369223 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-faece341-4bb3-4d1a-9418-68edda3da98c admin admin] The token cache is being invalidate because project 4094adf5cb944f1aa9cf865c283ee367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:10.369514 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-faece341-4bb3-4d1a-9418-68edda3da98c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:10.370208 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-faece341-4bb3-4d1a-9418-68edda3da98c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:10.371694 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 939/1891] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:10 2021] DELETE /identity/v3/projects/4094adf5cb944f1aa9cf865c283ee367 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:10.372940 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da21f4-f2b8-4086-9627-cf6a243c29fc None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:10.373235 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da21f4-f2b8-4086-9627-cf6a243c29fc None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:10.373681 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da21f4-f2b8-4086-9627-cf6a243c29fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:10.379201 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 953/1892] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:10 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:10.380500 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf612e08-6842-4763-aa20-0b1d28e2609f None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:10.380831 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf612e08-6842-4763-aa20-0b1d28e2609f None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:10.381128 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf612e08-6842-4763-aa20-0b1d28e2609f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:10.404462 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-c1da21f4-f2b8-4086-9627-cf6a243c29fc None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:10.406806 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-c1da21f4-f2b8-4086-9627-cf6a243c29fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:10.425523 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-cf612e08-6842-4763-aa20-0b1d28e2609f None None] MFA Rules not processed for user `9b21ecb959de4f7eab7b570afe0d065f`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:10.427076 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-cf612e08-6842-4763-aa20-0b1d28e2609f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:10.484281 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 940/1893] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:10.486201 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c78553-1846-4a91-b371-19c417b9c6a2 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:10.486608 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c78553-1846-4a91-b371-19c417b9c6a2 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:10.486996 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c78553-1846-4a91-b371-19c417b9c6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:10.509461 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 954/1894] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:10 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:10.510539 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b6bd0-0bc4-4f71-9315-847f7625d6e5 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:10.510743 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-a0c78553-1846-4a91-b371-19c417b9c6a2 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:10.510846 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b6bd0-0bc4-4f71-9315-847f7625d6e5 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:10.511116 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b6bd0-0bc4-4f71-9315-847f7625d6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:10.512164 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-a0c78553-1846-4a91-b371-19c417b9c6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:10.520640 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 941/1895] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:10.521591 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c78553-1846-4a91-b371-19c417b9c6a2 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:10.531302 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c78553-1846-4a91-b371-19c417b9c6a2 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:10.534298 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-281b6bd0-0bc4-4f71-9315-847f7625d6e5 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:10.535464 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-281b6bd0-0bc4-4f71-9315-847f7625d6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:10.536354 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ddd7e-bf6f-46cb-9745-45defd79ea24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:10.537091 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ddd7e-bf6f-46cb-9745-45defd79ea24 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:10.537479 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ddd7e-bf6f-46cb-9745-45defd79ea24 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:10.537862 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ddd7e-bf6f-46cb-9745-45defd79ea24 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:10.538692 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ddd7e-bf6f-46cb-9745-45defd79ea24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:40:10.539098 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ddd7e-bf6f-46cb-9745-45defd79ea24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:10.541317 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ddd7e-bf6f-46cb-9745-45defd79ea24 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:10.543954 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 955/1896] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:10.544505 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b6bd0-0bc4-4f71-9315-847f7625d6e5 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:10.546002 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-281b6bd0-0bc4-4f71-9315-847f7625d6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:10.557578 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b6bd0-0bc4-4f71-9315-847f7625d6e5 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:10.559939 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 942/1897] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:40:10.561305 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8095b-6671-422a-825f-9213317bea81 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:10.561602 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8095b-6671-422a-825f-9213317bea81 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:10.561886 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8095b-6671-422a-825f-9213317bea81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:10.566009 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb01573-9f2d-48bf-8d2f-0b0cb38bb28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:10.566629 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb01573-9f2d-48bf-8d2f-0b0cb38bb28e admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:10.566922 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb01573-9f2d-48bf-8d2f-0b0cb38bb28e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:10.567211 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb01573-9f2d-48bf-8d2f-0b0cb38bb28e admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:10.567858 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb01573-9f2d-48bf-8d2f-0b0cb38bb28e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:10.570318 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb01573-9f2d-48bf-8d2f-0b0cb38bb28e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:10.590925 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-2af8095b-6671-422a-825f-9213317bea81 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:10.592476 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-2af8095b-6671-422a-825f-9213317bea81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:10.601891 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 956/1898] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:10 2021] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:10.602214 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 943/1899] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:10.603702 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8095b-6671-422a-825f-9213317bea81 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:10.603841 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed30960-2e81-44e4-82e9-cf48b7b17d91 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:10.604135 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed30960-2e81-44e4-82e9-cf48b7b17d91 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:10.604427 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed30960-2e81-44e4-82e9-cf48b7b17d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:10.615945 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8095b-6671-422a-825f-9213317bea81 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:10.629931 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-8ed30960-2e81-44e4-82e9-cf48b7b17d91 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:10.631197 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-8ed30960-2e81-44e4-82e9-cf48b7b17d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:10.687780 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a19f8-96b4-4446-95cb-a74dd9aed377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:10.688419 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a19f8-96b4-4446-95cb-a74dd9aed377 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:10.688711 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a19f8-96b4-4446-95cb-a74dd9aed377 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:10.689419 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a19f8-96b4-4446-95cb-a74dd9aed377 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:10.689877 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a19f8-96b4-4446-95cb-a74dd9aed377 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:10.692262 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a19f8-96b4-4446-95cb-a74dd9aed377 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:10.701133 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 957/1900] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:10.702102 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed30960-2e81-44e4-82e9-cf48b7b17d91 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:10.712495 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed30960-2e81-44e4-82e9-cf48b7b17d91 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:10.717455 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6c34e-6ce3-4c15-9370-0e7202b86128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:10.718139 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6c34e-6ce3-4c15-9370-0e7202b86128 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:10.718500 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6c34e-6ce3-4c15-9370-0e7202b86128 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:10.718755 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6c34e-6ce3-4c15-9370-0e7202b86128 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:10.719550 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6c34e-6ce3-4c15-9370-0e7202b86128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:10.722367 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6c34e-6ce3-4c15-9370-0e7202b86128 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:10.723211 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 944/1901] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:10 2021] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:10.723843 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a19f8-96b4-4446-95cb-a74dd9aed377 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:10.753912 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 958/1902] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:10 2021] POST /identity/v3/users => generated 298 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:10.754959 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6c34e-6ce3-4c15-9370-0e7202b86128 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:10.765727 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6c34e-6ce3-4c15-9370-0e7202b86128 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:10.813872 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a19f8-96b4-4446-95cb-a74dd9aed377 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:10.819807 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6186118-75b1-44b7-8023-d797382ae652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:10.820405 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6186118-75b1-44b7-8023-d797382ae652 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:10.820748 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6186118-75b1-44b7-8023-d797382ae652 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:10.821104 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6186118-75b1-44b7-8023-d797382ae652 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:10.821806 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6186118-75b1-44b7-8023-d797382ae652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:40:10.822103 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6186118-75b1-44b7-8023-d797382ae652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:10.823670 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6186118-75b1-44b7-8023-d797382ae652 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:10.848306 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 945/1903] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:40:10.848306 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6186118-75b1-44b7-8023-d797382ae652 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:10.855502 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d90d2-57d9-413e-90ea-f5c3ad8be247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:10.856766 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d90d2-57d9-413e-90ea-f5c3ad8be247 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:10.857106 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6186118-75b1-44b7-8023-d797382ae652 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:10.857569 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d90d2-57d9-413e-90ea-f5c3ad8be247 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:10.857569 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d90d2-57d9-413e-90ea-f5c3ad8be247 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:10.858451 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d90d2-57d9-413e-90ea-f5c3ad8be247 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:40:10.858825 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d90d2-57d9-413e-90ea-f5c3ad8be247 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:10.860732 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d90d2-57d9-413e-90ea-f5c3ad8be247 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:10.871455 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d584a16-ceb6-47cd-b17a-9a3ed406afc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:10.872834 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d584a16-ceb6-47cd-b17a-9a3ed406afc5 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:10.873431 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d584a16-ceb6-47cd-b17a-9a3ed406afc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:10.873896 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d584a16-ceb6-47cd-b17a-9a3ed406afc5 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:10.874750 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d584a16-ceb6-47cd-b17a-9a3ed406afc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:10.875673 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 959/1904] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:40:10.876957 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d90d2-57d9-413e-90ea-f5c3ad8be247 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:10.877994 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d584a16-ceb6-47cd-b17a-9a3ed406afc5 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:10.890811 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d90d2-57d9-413e-90ea-f5c3ad8be247 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:10.896501 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5e3b5-baf7-494a-873e-105d8633b74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:10.897318 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5e3b5-baf7-494a-873e-105d8633b74f admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:10.897618 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5e3b5-baf7-494a-873e-105d8633b74f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:10.898196 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5e3b5-baf7-494a-873e-105d8633b74f admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:10.898905 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5e3b5-baf7-494a-873e-105d8633b74f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:10.901105 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5e3b5-baf7-494a-873e-105d8633b74f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:10.904844 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 946/1905] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:10 2021] POST /identity/v3/users => generated 283 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:10.904844 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d584a16-ceb6-47cd-b17a-9a3ed406afc5 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:10.913637 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d584a16-ceb6-47cd-b17a-9a3ed406afc5 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:10.914671 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 960/1906] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:10 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:10.917972 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5e3b5-baf7-494a-873e-105d8633b74f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:10.919113 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b7b42-efce-4921-978b-9b6d37a515c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:10.919707 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b7b42-efce-4921-978b-9b6d37a515c8 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:10.919999 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b7b42-efce-4921-978b-9b6d37a515c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:10.920394 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b7b42-efce-4921-978b-9b6d37a515c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:10.921084 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b7b42-efce-4921-978b-9b6d37a515c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:10.923029 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b7b42-efce-4921-978b-9b6d37a515c8 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:10.929617 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5e3b5-baf7-494a-873e-105d8633b74f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:10.934432 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c8227-72a8-45c1-ad58-ade58dde7f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:10.935026 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c8227-72a8-45c1-ad58-ade58dde7f8f admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:10.935321 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c8227-72a8-45c1-ad58-ade58dde7f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:10.935605 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c8227-72a8-45c1-ad58-ade58dde7f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:10.936246 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c8227-72a8-45c1-ad58-ade58dde7f8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:10.938239 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c8227-72a8-45c1-ad58-ade58dde7f8f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:10.949797 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 947/1907] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:10 2021] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:10.950721 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b7b42-efce-4921-978b-9b6d37a515c8 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:10.968218 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 961/1908] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:10 2021] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:10.972304 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c8227-72a8-45c1-ad58-ade58dde7f8f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:11.022998 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b7b42-efce-4921-978b-9b6d37a515c8 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:11.043801 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c8227-72a8-45c1-ad58-ade58dde7f8f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:11.049981 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af40406-bb40-47b8-8c87-79d535de7a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:11.051182 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af40406-bb40-47b8-8c87-79d535de7a36 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:11.051631 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af40406-bb40-47b8-8c87-79d535de7a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:11.052078 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af40406-bb40-47b8-8c87-79d535de7a36 admin admin] PATH_INFO: `/v3/projects/cdb27123484e4a6e9de1e522d9a3b275/users/cc5e8f9a198b4235bf39674e3b52694b/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:11.073684 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af40406-bb40-47b8-8c87-79d535de7a36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb27123484e4a6e9de1e522d9a3b275, user_id=cc5e8f9a198b4235bf39674e3b52694b, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:11.076436 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af40406-bb40-47b8-8c87-79d535de7a36 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:11.089422 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b2db4-9dd2-4869-926f-57e543be5148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:11.090037 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b2db4-9dd2-4869-926f-57e543be5148 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:11.090331 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b2db4-9dd2-4869-926f-57e543be5148 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:11.090616 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b2db4-9dd2-4869-926f-57e543be5148 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:11.091344 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b2db4-9dd2-4869-926f-57e543be5148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:11.092725 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 962/1909] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:10 2021] PUT /identity/v3/projects/cdb27123484e4a6e9de1e522d9a3b275/users/cc5e8f9a198b4235bf39674e3b52694b/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:11.093234 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b2db4-9dd2-4869-926f-57e543be5148 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:11.096321 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af40406-bb40-47b8-8c87-79d535de7a36 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:11.106969 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 948/1910] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:10 2021] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:11.106969 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b2db4-9dd2-4869-926f-57e543be5148 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:11.114500 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b2db4-9dd2-4869-926f-57e543be5148 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:11.181173 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af40406-bb40-47b8-8c87-79d535de7a36 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:11.188597 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74132654-8345-4fb0-b6a9-5029845cf9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:11.189247 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74132654-8345-4fb0-b6a9-5029845cf9e1 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:11.189608 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74132654-8345-4fb0-b6a9-5029845cf9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:11.189962 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74132654-8345-4fb0-b6a9-5029845cf9e1 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:11.190675 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74132654-8345-4fb0-b6a9-5029845cf9e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:11.191563 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7fc672-bff2-4216-98a6-554970f32e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:11.192087 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fc672-bff2-4216-98a6-554970f32e51 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:11.192456 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fc672-bff2-4216-98a6-554970f32e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:11.192829 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fc672-bff2-4216-98a6-554970f32e51 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:11.193036 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74132654-8345-4fb0-b6a9-5029845cf9e1 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:11.193949 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7fc672-bff2-4216-98a6-554970f32e51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:11.196574 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7fc672-bff2-4216-98a6-554970f32e51 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:11.221777 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 949/1911] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:11 2021] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:11.221777 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74132654-8345-4fb0-b6a9-5029845cf9e1 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:11.228067 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 963/1912] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:11 2021] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:11.228067 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7fc672-bff2-4216-98a6-554970f32e51 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:11.232672 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74132654-8345-4fb0-b6a9-5029845cf9e1 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:11.240803 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7fc672-bff2-4216-98a6-554970f32e51 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:11.242838 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904078fe-01a3-4da7-97d4-080138d68411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:11.249212 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ce161-e149-4050-b883-0ba7ddc36a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:11.251243 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ce161-e149-4050-b883-0ba7ddc36a3d admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:11.251741 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ce161-e149-4050-b883-0ba7ddc36a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:11.252222 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ce161-e149-4050-b883-0ba7ddc36a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:11.253320 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ce161-e149-4050-b883-0ba7ddc36a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:11.254463 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904078fe-01a3-4da7-97d4-080138d68411 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:11.254821 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904078fe-01a3-4da7-97d4-080138d68411 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:11.255111 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904078fe-01a3-4da7-97d4-080138d68411 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:11.255881 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ce161-e149-4050-b883-0ba7ddc36a3d admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:11.256409 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904078fe-01a3-4da7-97d4-080138d68411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:11.262714 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904078fe-01a3-4da7-97d4-080138d68411 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:11.283231 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 964/1913] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:11 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:11.283231 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ce161-e149-4050-b883-0ba7ddc36a3d admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:11.285496 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 950/1914] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:11 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:11.286670 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904078fe-01a3-4da7-97d4-080138d68411 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:11.303164 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ce161-e149-4050-b883-0ba7ddc36a3d admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:11.306489 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904078fe-01a3-4da7-97d4-080138d68411 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:11.308340 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c6a06-e524-40f3-863f-ead6b70940ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:11.309068 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c6a06-e524-40f3-863f-ead6b70940ca admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:11.309431 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c6a06-e524-40f3-863f-ead6b70940ca admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:11.309847 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c6a06-e524-40f3-863f-ead6b70940ca admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:11.310591 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c6a06-e524-40f3-863f-ead6b70940ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:11.312394 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c6a06-e524-40f3-863f-ead6b70940ca admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:11.317761 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f64c5-e9a6-4d01-ae56-5f96788f288c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:11.318379 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f64c5-e9a6-4d01-ae56-5f96788f288c admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:11.318672 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f64c5-e9a6-4d01-ae56-5f96788f288c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:11.318956 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f64c5-e9a6-4d01-ae56-5f96788f288c admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:11.319899 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f64c5-e9a6-4d01-ae56-5f96788f288c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:11.322079 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f64c5-e9a6-4d01-ae56-5f96788f288c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:11.327214 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 965/1915] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:11 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:11.328211 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c6a06-e524-40f3-863f-ead6b70940ca admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:11.341138 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c6a06-e524-40f3-863f-ead6b70940ca admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:11.354500 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 951/1916] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:11 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:11.355350 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f64c5-e9a6-4d01-ae56-5f96788f288c admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:11.360852 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcffce8-9b52-4bdc-b97b-3de21ebf0d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:11.361701 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcffce8-9b52-4bdc-b97b-3de21ebf0d7a admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:11.361996 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcffce8-9b52-4bdc-b97b-3de21ebf0d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:11.362321 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcffce8-9b52-4bdc-b97b-3de21ebf0d7a admin admin] PATH_INFO: `/v3/projects/96762b8bbb2341fa909c8128d91597e1/users/5bb24a2974224dadbbd4a097b912cbae/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:11.369928 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f64c5-e9a6-4d01-ae56-5f96788f288c admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:11.375617 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ccf47-3fc4-4e14-bd63-1b91cd2118e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:11.376728 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ccf47-3fc4-4e14-bd63-1b91cd2118e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:11.377079 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ccf47-3fc4-4e14-bd63-1b91cd2118e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:11.377403 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ccf47-3fc4-4e14-bd63-1b91cd2118e9 admin admin] PATH_INFO: `/v3/projects/cdb27123484e4a6e9de1e522d9a3b275/users/cc5e8f9a198b4235bf39674e3b52694b/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:11.380015 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ccf47-3fc4-4e14-bd63-1b91cd2118e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb27123484e4a6e9de1e522d9a3b275, user_id=cc5e8f9a198b4235bf39674e3b52694b, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:11.383286 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ccf47-3fc4-4e14-bd63-1b91cd2118e9 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:11.388038 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcffce8-9b52-4bdc-b97b-3de21ebf0d7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=96762b8bbb2341fa909c8128d91597e1, user_id=5bb24a2974224dadbbd4a097b912cbae, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:11.391257 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcffce8-9b52-4bdc-b97b-3de21ebf0d7a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:11.398420 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 952/1917] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:11 2021] PUT /identity/v3/projects/cdb27123484e4a6e9de1e522d9a3b275/users/cc5e8f9a198b4235bf39674e3b52694b/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:11.400684 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ccf47-3fc4-4e14-bd63-1b91cd2118e9 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:11.420322 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 966/1918] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:11 2021] PUT /identity/v3/projects/96762b8bbb2341fa909c8128d91597e1/users/5bb24a2974224dadbbd4a097b912cbae/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:11.421898 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcffce8-9b52-4bdc-b97b-3de21ebf0d7a admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:11.496538 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ccf47-3fc4-4e14-bd63-1b91cd2118e9 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:11.503949 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6afbc-92bf-4f65-8453-429a19467e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:11.505390 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6afbc-92bf-4f65-8453-429a19467e91 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:11.505390 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6afbc-92bf-4f65-8453-429a19467e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:11.505390 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6afbc-92bf-4f65-8453-429a19467e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:11.505964 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6afbc-92bf-4f65-8453-429a19467e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:11.506653 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcffce8-9b52-4bdc-b97b-3de21ebf0d7a admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:11.507526 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6afbc-92bf-4f65-8453-429a19467e91 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:11.513131 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93703e28-4adb-4fbf-a6bf-6f452b8fdeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:11.513131 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93703e28-4adb-4fbf-a6bf-6f452b8fdeaa admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:11.513416 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93703e28-4adb-4fbf-a6bf-6f452b8fdeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:11.513619 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93703e28-4adb-4fbf-a6bf-6f452b8fdeaa admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:11.514269 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93703e28-4adb-4fbf-a6bf-6f452b8fdeaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:11.515910 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93703e28-4adb-4fbf-a6bf-6f452b8fdeaa admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:11.520242 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 953/1919] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:11 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:11.521570 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d965e-7326-41ef-865c-4e0c3422c66e None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:11.521873 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d965e-7326-41ef-865c-4e0c3422c66e None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:11.522163 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d965e-7326-41ef-865c-4e0c3422c66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:11.531114 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 967/1920] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:11 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:11.532657 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbeb49-3f95-4f4a-9b5e-e691757bbade None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:11.532982 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbeb49-3f95-4f4a-9b5e-e691757bbade None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:11.533265 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbeb49-3f95-4f4a-9b5e-e691757bbade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:11.567139 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-ef1d965e-7326-41ef-865c-4e0c3422c66e None None] MFA Rules not processed for user `cc5e8f9a198b4235bf39674e3b52694b`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:11.567139 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-ef1d965e-7326-41ef-865c-4e0c3422c66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:11.579702 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-d2dbeb49-3f95-4f4a-9b5e-e691757bbade None None] MFA Rules not processed for user `5bb24a2974224dadbbd4a097b912cbae`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:11.580932 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-d2dbeb49-3f95-4f4a-9b5e-e691757bbade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:11.682032 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 968/1921] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:11 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:11.683192 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbeb49-3f95-4f4a-9b5e-e691757bbade None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:11.694156 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbeb49-3f95-4f4a-9b5e-e691757bbade None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:11.695499 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 954/1922] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:11 2021] POST /identity/v3/auth/tokens => generated 3757 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:11.699632 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea4361-6269-4244-9bf4-0181b1b6190f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:11.700354 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d965e-7326-41ef-865c-4e0c3422c66e None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:11.700474 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea4361-6269-4244-9bf4-0181b1b6190f admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:11.700751 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea4361-6269-4244-9bf4-0181b1b6190f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:11.701070 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea4361-6269-4244-9bf4-0181b1b6190f admin admin] PATH_INFO: `/v3/projects/3fe050ec298b427788400b05361b8b13/users/fb2f354953e3456e936c4728807f0b18/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:11.710614 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d965e-7326-41ef-865c-4e0c3422c66e None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:11.715424 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf90b70-9ccc-4f13-bd90-a8df0952d0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:11.716336 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf90b70-9ccc-4f13-bd90-a8df0952d0d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:11.716692 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf90b70-9ccc-4f13-bd90-a8df0952d0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:11.717068 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf90b70-9ccc-4f13-bd90-a8df0952d0d3 admin admin] PATH_INFO: `/v3/projects/66e8e3028160445db878134de2706b93/users/7e1c99567ef640ccbaa0eb8dfbd50132/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:11.722305 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea4361-6269-4244-9bf4-0181b1b6190f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fe050ec298b427788400b05361b8b13, user_id=fb2f354953e3456e936c4728807f0b18, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:11.725424 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea4361-6269-4244-9bf4-0181b1b6190f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:11.738642 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf90b70-9ccc-4f13-bd90-a8df0952d0d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e8e3028160445db878134de2706b93, user_id=7e1c99567ef640ccbaa0eb8dfbd50132, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:11.741521 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf90b70-9ccc-4f13-bd90-a8df0952d0d3 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:11.744298 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 969/1923] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:11 2021] PUT /identity/v3/projects/3fe050ec298b427788400b05361b8b13/users/fb2f354953e3456e936c4728807f0b18/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:11.745385 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea4361-6269-4244-9bf4-0181b1b6190f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:11.757207 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 955/1924] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:11 2021] PUT /identity/v3/projects/66e8e3028160445db878134de2706b93/users/7e1c99567ef640ccbaa0eb8dfbd50132/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:11.757947 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf90b70-9ccc-4f13-bd90-a8df0952d0d3 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:11.760291 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-5cf90b70-9ccc-4f13-bd90-a8df0952d0d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:11.836711 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea4361-6269-4244-9bf4-0181b1b6190f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:11.850325 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf90b70-9ccc-4f13-bd90-a8df0952d0d3 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:11.854915 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5340832-187a-431d-b8bf-6555bd019ed0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:11.855887 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5340832-187a-431d-b8bf-6555bd019ed0 service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:11.856645 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5340832-187a-431d-b8bf-6555bd019ed0 service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:11.857181 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5340832-187a-431d-b8bf-6555bd019ed0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:11.915522 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb45d4-4f43-4189-814e-7e610cbf9980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:11.916876 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb45d4-4f43-4189-814e-7e610cbf9980 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:11.917305 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb45d4-4f43-4189-814e-7e610cbf9980 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:11.917724 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb45d4-4f43-4189-814e-7e610cbf9980 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:11.918523 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb45d4-4f43-4189-814e-7e610cbf9980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:11.921277 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb45d4-4f43-4189-814e-7e610cbf9980 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:11.943700 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5340832-187a-431d-b8bf-6555bd019ed0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:11.945557 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5340832-187a-431d-b8bf-6555bd019ed0 service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:11.957370 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 970/1926] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:11 2021] POST /identity/v3/projects => generated 363 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:11.957549 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 956/1926] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:11 2021] GET /identity/v3/auth/tokens => generated 3757 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:11.958842 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327851b-df89-4091-992e-a6c73fc4f42b None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:11.959160 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327851b-df89-4091-992e-a6c73fc4f42b None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:11.959431 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327851b-df89-4091-992e-a6c73fc4f42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:11.960499 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89d482-6e3e-4bb1-93f0-f233069dcab6 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:11.961042 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89d482-6e3e-4bb1-93f0-f233069dcab6 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:11.961548 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89d482-6e3e-4bb1-93f0-f233069dcab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:12.007720 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-7a89d482-6e3e-4bb1-93f0-f233069dcab6 None None] MFA Rules not processed for user `7e1c99567ef640ccbaa0eb8dfbd50132`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:12.009853 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-7a89d482-6e3e-4bb1-93f0-f233069dcab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:12.032446 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-9327851b-df89-4091-992e-a6c73fc4f42b None None] MFA Rules not processed for user `fb2f354953e3456e936c4728807f0b18`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:12.034070 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-9327851b-df89-4091-992e-a6c73fc4f42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:12.125402 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 971/1927] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:11 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:12.126757 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89d482-6e3e-4bb1-93f0-f233069dcab6 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:12.131152 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 957/1928] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:11 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:12.132505 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327851b-df89-4091-992e-a6c73fc4f42b None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:12.207085 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89d482-6e3e-4bb1-93f0-f233069dcab6 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:12.213428 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3394e-3522-4725-8337-955d1fbe1a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:12.214057 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3394e-3522-4725-8337-955d1fbe1a01 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:12.214513 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3394e-3522-4725-8337-955d1fbe1a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:12.214801 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3394e-3522-4725-8337-955d1fbe1a01 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:12.216037 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3394e-3522-4725-8337-955d1fbe1a01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:12.217621 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327851b-df89-4091-992e-a6c73fc4f42b None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:12.218438 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3394e-3522-4725-8337-955d1fbe1a01 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:12.221307 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6da16c-30b2-488e-a4ec-7f6cd9e9ce27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:12.222112 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6da16c-30b2-488e-a4ec-7f6cd9e9ce27 service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:12.222716 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6da16c-30b2-488e-a4ec-7f6cd9e9ce27 service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:12.223018 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6da16c-30b2-488e-a4ec-7f6cd9e9ce27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:12.247660 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 972/1929] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:12 2021] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:12.249540 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3394e-3522-4725-8337-955d1fbe1a01 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:12.262266 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3394e-3522-4725-8337-955d1fbe1a01 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:12.268017 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64192f73-319f-4c07-a010-fb3433b17563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:12.268933 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64192f73-319f-4c07-a010-fb3433b17563 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:12.269377 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64192f73-319f-4c07-a010-fb3433b17563 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:12.269811 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64192f73-319f-4c07-a010-fb3433b17563 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:12.270617 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64192f73-319f-4c07-a010-fb3433b17563 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:12.273132 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64192f73-319f-4c07-a010-fb3433b17563 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:12.308796 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6da16c-30b2-488e-a4ec-7f6cd9e9ce27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:12.310449 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6da16c-30b2-488e-a4ec-7f6cd9e9ce27 service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:12.319432 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 973/1930] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:12 2021] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:12.319432 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64192f73-319f-4c07-a010-fb3433b17563 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:12.325421 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 958/1931] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:12 2021] GET /identity/v3/auth/tokens => generated 3688 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:12.338136 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6da16c-30b2-488e-a4ec-7f6cd9e9ce27 service cinder] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:12.373822 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6da16c-30b2-488e-a4ec-7f6cd9e9ce27 service cinder] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:12.425761 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64192f73-319f-4c07-a010-fb3433b17563 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:12.437900 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8b304-5447-4740-a68f-17acfd338091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:12.439071 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8b304-5447-4740-a68f-17acfd338091 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:12.439513 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8b304-5447-4740-a68f-17acfd338091 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:12.440125 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8b304-5447-4740-a68f-17acfd338091 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:12.441763 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8b304-5447-4740-a68f-17acfd338091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:12.449075 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8b304-5447-4740-a68f-17acfd338091 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:12.515032 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 974/1932] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:12 2021] POST /identity/v3/projects => generated 379 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:12.517088 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8b304-5447-4740-a68f-17acfd338091 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:12.520448 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedecd28-50d3-459a-9284-4fdc5ec99c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:12.521368 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedecd28-50d3-459a-9284-4fdc5ec99c42 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:12.522944 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedecd28-50d3-459a-9284-4fdc5ec99c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:12.523567 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedecd28-50d3-459a-9284-4fdc5ec99c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:12.524838 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedecd28-50d3-459a-9284-4fdc5ec99c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:12.536069 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedecd28-50d3-459a-9284-4fdc5ec99c42 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:12.563814 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 959/1933] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:12 2021] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:12.563814 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedecd28-50d3-459a-9284-4fdc5ec99c42 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:12.572552 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedecd28-50d3-459a-9284-4fdc5ec99c42 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:12.632424 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8b304-5447-4740-a68f-17acfd338091 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:12.638163 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b61df7-3837-499b-bdfc-4110de95d71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:12.638898 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b61df7-3837-499b-bdfc-4110de95d71c admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:12.639442 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b61df7-3837-499b-bdfc-4110de95d71c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:12.639776 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b61df7-3837-499b-bdfc-4110de95d71c admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:12.640568 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b61df7-3837-499b-bdfc-4110de95d71c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:12.643021 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b61df7-3837-499b-bdfc-4110de95d71c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:12.652764 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87c9f6-7c46-4c0c-a4e9-efb5f7e44ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:12.653225 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87c9f6-7c46-4c0c-a4e9-efb5f7e44ebf admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:12.653524 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87c9f6-7c46-4c0c-a4e9-efb5f7e44ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:12.654120 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87c9f6-7c46-4c0c-a4e9-efb5f7e44ebf admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:12.657180 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87c9f6-7c46-4c0c-a4e9-efb5f7e44ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:12.659331 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87c9f6-7c46-4c0c-a4e9-efb5f7e44ebf admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:12.672341 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 975/1934] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:12 2021] POST /identity/v3/users => generated 299 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:12.673180 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b61df7-3837-499b-bdfc-4110de95d71c admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:12.692281 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b61df7-3837-499b-bdfc-4110de95d71c admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:12.703709 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 960/1935] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:12 2021] POST /identity/v3/users => generated 290 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:12.704630 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87c9f6-7c46-4c0c-a4e9-efb5f7e44ebf admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:12.713211 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d976bc-bbaa-4d1b-a109-991099f2dfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:12.717492 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d976bc-bbaa-4d1b-a109-991099f2dfde admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:12.718017 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d976bc-bbaa-4d1b-a109-991099f2dfde admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:12.718801 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d976bc-bbaa-4d1b-a109-991099f2dfde admin admin] PATH_INFO: `/v3/projects/badee23df7a9473ab35c9a573575c3ee/users/5c067a6ebdbc4e419e9aff34aa1c7872/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:12.732240 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87c9f6-7c46-4c0c-a4e9-efb5f7e44ebf admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:12.745693 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d9963-fe91-4c8f-a9ff-390487d29f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:12.746408 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d9963-fe91-4c8f-a9ff-390487d29f7b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:12.746675 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d9963-fe91-4c8f-a9ff-390487d29f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:12.746968 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d9963-fe91-4c8f-a9ff-390487d29f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:12.747812 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d9963-fe91-4c8f-a9ff-390487d29f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:12.749890 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d9963-fe91-4c8f-a9ff-390487d29f7b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:12.757814 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d976bc-bbaa-4d1b-a109-991099f2dfde admin admin] RBAC: Authorizing `identity:create_grant(project_id=badee23df7a9473ab35c9a573575c3ee, user_id=5c067a6ebdbc4e419e9aff34aa1c7872, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:12.762016 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d976bc-bbaa-4d1b-a109-991099f2dfde admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:12.783346 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 976/1936] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:12 2021] PUT /identity/v3/projects/badee23df7a9473ab35c9a573575c3ee/users/5c067a6ebdbc4e419e9aff34aa1c7872/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:12.784290 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d976bc-bbaa-4d1b-a109-991099f2dfde admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:12.823115 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 961/1937] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:12 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:12.826085 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d9963-fe91-4c8f-a9ff-390487d29f7b admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:12.870880 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d9963-fe91-4c8f-a9ff-390487d29f7b admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:12.903471 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d976bc-bbaa-4d1b-a109-991099f2dfde admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:12.919162 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d258068-563e-43a7-8e17-4ed08da7f644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:12.919162 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d258068-563e-43a7-8e17-4ed08da7f644 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:12.919855 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d258068-563e-43a7-8e17-4ed08da7f644 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:12.919855 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d258068-563e-43a7-8e17-4ed08da7f644 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:12.920530 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d258068-563e-43a7-8e17-4ed08da7f644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:12.923688 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d258068-563e-43a7-8e17-4ed08da7f644 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:12.946721 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 977/1938] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:12 2021] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:12.949924 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d258068-563e-43a7-8e17-4ed08da7f644 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:12.972810 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d258068-563e-43a7-8e17-4ed08da7f644 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:12.985904 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e9cbe-7279-488f-8d8c-fb6b0fa5a6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:12.986830 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e9cbe-7279-488f-8d8c-fb6b0fa5a6c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:12.987190 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e9cbe-7279-488f-8d8c-fb6b0fa5a6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:12.987576 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e9cbe-7279-488f-8d8c-fb6b0fa5a6c3 admin admin] PATH_INFO: `/v3/projects/63d7ab99560440b6ae7f6c58c5e078dc/users/7242d1463b114c4c9b79c605c0914766/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:13.016622 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4c18a-b1b9-4625-9aba-f19e97a3ffdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:13.017347 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4c18a-b1b9-4625-9aba-f19e97a3ffdc admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:13.017743 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4c18a-b1b9-4625-9aba-f19e97a3ffdc admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:13.018007 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4c18a-b1b9-4625-9aba-f19e97a3ffdc admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:13.018725 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4c18a-b1b9-4625-9aba-f19e97a3ffdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:13.020882 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4c18a-b1b9-4625-9aba-f19e97a3ffdc admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:13.034439 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e9cbe-7279-488f-8d8c-fb6b0fa5a6c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63d7ab99560440b6ae7f6c58c5e078dc, user_id=7242d1463b114c4c9b79c605c0914766, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:13.036875 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 962/1939] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:12 2021] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:13.037974 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4c18a-b1b9-4625-9aba-f19e97a3ffdc admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:13.041046 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e9cbe-7279-488f-8d8c-fb6b0fa5a6c3 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:13.049535 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4c18a-b1b9-4625-9aba-f19e97a3ffdc admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:13.054590 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db42e9-8cdf-4115-8e0f-74b955956dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:13.055204 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db42e9-8cdf-4115-8e0f-74b955956dfe admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:13.055524 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db42e9-8cdf-4115-8e0f-74b955956dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:13.055814 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db42e9-8cdf-4115-8e0f-74b955956dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:13.056522 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db42e9-8cdf-4115-8e0f-74b955956dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:13.058155 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db42e9-8cdf-4115-8e0f-74b955956dfe admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:13.064356 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 978/1940] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:12 2021] PUT /identity/v3/projects/63d7ab99560440b6ae7f6c58c5e078dc/users/7242d1463b114c4c9b79c605c0914766/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:13.065727 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e9cbe-7279-488f-8d8c-fb6b0fa5a6c3 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:13.076315 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 963/1941] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:13 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:13.077264 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db42e9-8cdf-4115-8e0f-74b955956dfe admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:13.090707 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db42e9-8cdf-4115-8e0f-74b955956dfe admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:13.149563 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e9cbe-7279-488f-8d8c-fb6b0fa5a6c3 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:13.155550 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0957a9-4629-4201-88a5-790ddaea3dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:13.155550 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0957a9-4629-4201-88a5-790ddaea3dda admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:13.155867 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0957a9-4629-4201-88a5-790ddaea3dda admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:13.155867 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0957a9-4629-4201-88a5-790ddaea3dda admin admin] PATH_INFO: `/v3/projects/badee23df7a9473ab35c9a573575c3ee/users/5c067a6ebdbc4e419e9aff34aa1c7872/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:13.157893 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0957a9-4629-4201-88a5-790ddaea3dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=badee23df7a9473ab35c9a573575c3ee, user_id=5c067a6ebdbc4e419e9aff34aa1c7872, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:13.160763 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0957a9-4629-4201-88a5-790ddaea3dda admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:13.172658 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 979/1942] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:13 2021] PUT /identity/v3/projects/badee23df7a9473ab35c9a573575c3ee/users/5c067a6ebdbc4e419e9aff34aa1c7872/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:13.173293 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0957a9-4629-4201-88a5-790ddaea3dda admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:13.188270 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890415e-a415-4c36-a711-f4388a65e210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:13.190034 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890415e-a415-4c36-a711-f4388a65e210 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:13.190034 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890415e-a415-4c36-a711-f4388a65e210 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:13.190034 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890415e-a415-4c36-a711-f4388a65e210 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:13.190374 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890415e-a415-4c36-a711-f4388a65e210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:13.192078 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890415e-a415-4c36-a711-f4388a65e210 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:13.206582 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 964/1943] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:13 2021] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:13.206582 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd471ce4-b295-4193-824e-3b9b76e144ab None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:13.206582 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd471ce4-b295-4193-824e-3b9b76e144ab None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:13.206582 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd471ce4-b295-4193-824e-3b9b76e144ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:13.243959 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-fd471ce4-b295-4193-824e-3b9b76e144ab None None] MFA Rules not processed for user `5c067a6ebdbc4e419e9aff34aa1c7872`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:13.245178 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-fd471ce4-b295-4193-824e-3b9b76e144ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:13.252828 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0957a9-4629-4201-88a5-790ddaea3dda admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:13.257340 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a582b-628c-462f-b791-b1768a92432b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:13.258164 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a582b-628c-462f-b791-b1768a92432b admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:13.258492 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a582b-628c-462f-b791-b1768a92432b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:13.258778 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a582b-628c-462f-b791-b1768a92432b admin admin] PATH_INFO: `/v3/projects/a6518352430f4d7cb3afe77cd0272da5/users/f7e3f41f794c46eeac33bcc8fb997d63/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:13.280108 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a582b-628c-462f-b791-b1768a92432b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6518352430f4d7cb3afe77cd0272da5, user_id=f7e3f41f794c46eeac33bcc8fb997d63, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:13.284157 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a582b-628c-462f-b791-b1768a92432b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:13.300330 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 980/1944] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:13 2021] PUT /identity/v3/projects/a6518352430f4d7cb3afe77cd0272da5/users/f7e3f41f794c46eeac33bcc8fb997d63/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:13.301234 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a582b-628c-462f-b791-b1768a92432b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:13.340146 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 965/1945] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:13 2021] POST /identity/v3/auth/tokens => generated 3737 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:13.341715 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e5195-6ff9-4d44-a2b1-3a4c88bd4073 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:13.342064 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e5195-6ff9-4d44-a2b1-3a4c88bd4073 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:13.342628 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e5195-6ff9-4d44-a2b1-3a4c88bd4073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:13.378762 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a582b-628c-462f-b791-b1768a92432b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:13.389095 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-f57e5195-6ff9-4d44-a2b1-3a4c88bd4073 None None] MFA Rules not processed for user `f7e3f41f794c46eeac33bcc8fb997d63`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:13.389850 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684a59a-8806-4cd2-97d5-444dfa657667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:13.390851 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684a59a-8806-4cd2-97d5-444dfa657667 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:13.391143 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684a59a-8806-4cd2-97d5-444dfa657667 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:13.391434 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684a59a-8806-4cd2-97d5-444dfa657667 admin admin] PATH_INFO: `/v3/projects/63d7ab99560440b6ae7f6c58c5e078dc/users/7242d1463b114c4c9b79c605c0914766/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:13.391653 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-f57e5195-6ff9-4d44-a2b1-3a4c88bd4073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:13.393512 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684a59a-8806-4cd2-97d5-444dfa657667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63d7ab99560440b6ae7f6c58c5e078dc, user_id=7242d1463b114c4c9b79c605c0914766, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:13.396455 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684a59a-8806-4cd2-97d5-444dfa657667 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:13.410380 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 981/1946] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:13 2021] PUT /identity/v3/projects/63d7ab99560440b6ae7f6c58c5e078dc/users/7242d1463b114c4c9b79c605c0914766/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:13.411272 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684a59a-8806-4cd2-97d5-444dfa657667 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:13.481658 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 966/1947] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:13 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:13.483146 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42399994-cee9-4d83-a331-a05d74b3bdb2 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:13.483605 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42399994-cee9-4d83-a331-a05d74b3bdb2 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:13.484072 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42399994-cee9-4d83-a331-a05d74b3bdb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:13.507412 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684a59a-8806-4cd2-97d5-444dfa657667 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:13.512065 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ed5fb-146e-45a7-84ea-b2a772339aa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:13.512917 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ed5fb-146e-45a7-84ea-b2a772339aa5 service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:13.513282 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ed5fb-146e-45a7-84ea-b2a772339aa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:13.513635 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ed5fb-146e-45a7-84ea-b2a772339aa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:13.529195 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-42399994-cee9-4d83-a331-a05d74b3bdb2 None None] MFA Rules not processed for user `7242d1463b114c4c9b79c605c0914766`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:13.530835 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-42399994-cee9-4d83-a331-a05d74b3bdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:13.613358 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ed5fb-146e-45a7-84ea-b2a772339aa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:13.614865 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ed5fb-146e-45a7-84ea-b2a772339aa5 service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:13.627435 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 982/1948] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:13 2021] GET /identity/v3/auth/tokens => generated 3737 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:13.628530 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ed5fb-146e-45a7-84ea-b2a772339aa5 service cinder] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:13.645491 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 967/1949] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:13 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:13.758511 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42399994-cee9-4d83-a331-a05d74b3bdb2 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:13.760287 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-42399994-cee9-4d83-a331-a05d74b3bdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:13.771404 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ed5fb-146e-45a7-84ea-b2a772339aa5 service cinder] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:13.776263 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42399994-cee9-4d83-a331-a05d74b3bdb2 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:13.782999 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b8420-5db0-47aa-bc0b-30ff4a98f783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:13.783541 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b8420-5db0-47aa-bc0b-30ff4a98f783 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:13.783834 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b8420-5db0-47aa-bc0b-30ff4a98f783 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:13.784120 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b8420-5db0-47aa-bc0b-30ff4a98f783 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:13.784804 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b8420-5db0-47aa-bc0b-30ff4a98f783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:13.786723 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b8420-5db0-47aa-bc0b-30ff4a98f783 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:13.788973 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15cb76-37a6-4b9b-a8b6-670aeda84dcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:13.789578 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15cb76-37a6-4b9b-a8b6-670aeda84dcf service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:13.789907 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15cb76-37a6-4b9b-a8b6-670aeda84dcf service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:13.790200 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15cb76-37a6-4b9b-a8b6-670aeda84dcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:13.847721 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 983/1950] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:13 2021] POST /identity/v3/projects => generated 377 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:13.851810 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b8420-5db0-47aa-bc0b-30ff4a98f783 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:13.938019 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af15cb76-37a6-4b9b-a8b6-670aeda84dcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:13.939468 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af15cb76-37a6-4b9b-a8b6-670aeda84dcf service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:13.951294 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 968/1951] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:13 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:40:13.994388 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b8420-5db0-47aa-bc0b-30ff4a98f783 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:14.007067 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15cb76-37a6-4b9b-a8b6-670aeda84dcf service cinder] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:14.009635 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a12e2-2c08-451f-bd3f-5197fd70cbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:14.010267 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a12e2-2c08-451f-bd3f-5197fd70cbb2 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:14.010563 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a12e2-2c08-451f-bd3f-5197fd70cbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:14.010853 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a12e2-2c08-451f-bd3f-5197fd70cbb2 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:14.011507 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a12e2-2c08-451f-bd3f-5197fd70cbb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:14.014614 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a12e2-2c08-451f-bd3f-5197fd70cbb2 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:14.029157 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15cb76-37a6-4b9b-a8b6-670aeda84dcf service cinder] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:14.045242 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 984/1952] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:13 2021] POST /identity/v3/users => generated 295 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:14.048738 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a12e2-2c08-451f-bd3f-5197fd70cbb2 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:14.059995 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a12e2-2c08-451f-bd3f-5197fd70cbb2 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:14.064967 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3aa831-35a8-4966-98df-f9feb327bd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:14.065595 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3aa831-35a8-4966-98df-f9feb327bd7e admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:14.065882 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3aa831-35a8-4966-98df-f9feb327bd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:14.066166 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3aa831-35a8-4966-98df-f9feb327bd7e admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:14.066882 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3aa831-35a8-4966-98df-f9feb327bd7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:14.068499 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3aa831-35a8-4966-98df-f9feb327bd7e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:14.081016 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 985/1953] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:14 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:40:14.085005 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3aa831-35a8-4966-98df-f9feb327bd7e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:14.106900 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63a324-a074-4521-b032-8942ec96e773 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:14.107533 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63a324-a074-4521-b032-8942ec96e773 service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:14.107829 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63a324-a074-4521-b032-8942ec96e773 service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:14.108120 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63a324-a074-4521-b032-8942ec96e773 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:14.123319 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3aa831-35a8-4966-98df-f9feb327bd7e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:14.133016 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec49ff-72a9-4764-8f3b-ff94d077936c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:14.134953 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec49ff-72a9-4764-8f3b-ff94d077936c admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:14.135470 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec49ff-72a9-4764-8f3b-ff94d077936c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:14.135992 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec49ff-72a9-4764-8f3b-ff94d077936c admin admin] PATH_INFO: `/v3/projects/cf6a02ab4a49495aa3958509e2c639dd/users/7ab2013f4cec4f0396e4e5039a844ae3/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:14.187662 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63a324-a074-4521-b032-8942ec96e773 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:14.189132 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63a324-a074-4521-b032-8942ec96e773 service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:14.193407 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec49ff-72a9-4764-8f3b-ff94d077936c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf6a02ab4a49495aa3958509e2c639dd, user_id=7ab2013f4cec4f0396e4e5039a844ae3, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:14.197589 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec49ff-72a9-4764-8f3b-ff94d077936c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:14.201921 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 969/1954] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:14 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:14.222948 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 986/1955] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:14 2021] PUT /identity/v3/projects/cf6a02ab4a49495aa3958509e2c639dd/users/7ab2013f4cec4f0396e4e5039a844ae3/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:14.223155 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63a324-a074-4521-b032-8942ec96e773 service cinder] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:14.236812 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63a324-a074-4521-b032-8942ec96e773 service cinder] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:14.320573 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4da3e4-4b7d-4b22-abef-9fb7d62c6232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:14.321886 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4da3e4-4b7d-4b22-abef-9fb7d62c6232 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:14.322180 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4da3e4-4b7d-4b22-abef-9fb7d62c6232 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:14.322462 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4da3e4-4b7d-4b22-abef-9fb7d62c6232 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:14.323167 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4da3e4-4b7d-4b22-abef-9fb7d62c6232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:14.324756 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4da3e4-4b7d-4b22-abef-9fb7d62c6232 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:14.336575 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 970/1956] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:14 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:40:14.344500 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec49ff-72a9-4764-8f3b-ff94d077936c admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:14.372853 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec49ff-72a9-4764-8f3b-ff94d077936c admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:14.383077 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745ed03-beb4-4c7c-b627-eda89d5fa981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:14.384903 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745ed03-beb4-4c7c-b627-eda89d5fa981 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:14.384903 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745ed03-beb4-4c7c-b627-eda89d5fa981 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:14.385147 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745ed03-beb4-4c7c-b627-eda89d5fa981 admin admin] PATH_INFO: `/v3/projects/cf6a02ab4a49495aa3958509e2c639dd/users/7ab2013f4cec4f0396e4e5039a844ae3/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:14.393252 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745ed03-beb4-4c7c-b627-eda89d5fa981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf6a02ab4a49495aa3958509e2c639dd, user_id=7ab2013f4cec4f0396e4e5039a844ae3, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:14.400895 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745ed03-beb4-4c7c-b627-eda89d5fa981 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:14.428927 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 987/1957] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:14 2021] PUT /identity/v3/projects/cf6a02ab4a49495aa3958509e2c639dd/users/7ab2013f4cec4f0396e4e5039a844ae3/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:14.439682 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8e820-a834-47d9-bb84-c8fc082a4af7 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:14.440139 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8e820-a834-47d9-bb84-c8fc082a4af7 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:14.440544 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8e820-a834-47d9-bb84-c8fc082a4af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:14.528895 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-5bf8e820-a834-47d9-bb84-c8fc082a4af7 None None] MFA Rules not processed for user `7ab2013f4cec4f0396e4e5039a844ae3`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:14.530455 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-5bf8e820-a834-47d9-bb84-c8fc082a4af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:14.697480 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 971/1958] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:14 2021] POST /identity/v3/auth/tokens => generated 3751 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:14.830440 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745ed03-beb4-4c7c-b627-eda89d5fa981 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:14.983397 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745ed03-beb4-4c7c-b627-eda89d5fa981 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:14.987007 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd3842-25fb-4269-bf25-1d59d22821f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:14.987806 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd3842-25fb-4269-bf25-1d59d22821f5 service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:14.988161 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd3842-25fb-4269-bf25-1d59d22821f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:14.988514 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd3842-25fb-4269-bf25-1d59d22821f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:15.001814 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd3842-25fb-4269-bf25-1d59d22821f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:15.004037 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd3842-25fb-4269-bf25-1d59d22821f5 service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:15.028686 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 988/1959] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:14 2021] GET /identity/v3/auth/tokens => generated 3751 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:15.620499 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8e820-a834-47d9-bb84-c8fc082a4af7 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:15.629650 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8e820-a834-47d9-bb84-c8fc082a4af7 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:15.636912 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df203e95-2a0f-45ec-b7c4-f97e1cb2db30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:15.638013 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df203e95-2a0f-45ec-b7c4-f97e1cb2db30 service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:15.638426 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df203e95-2a0f-45ec-b7c4-f97e1cb2db30 service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:15.638808 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df203e95-2a0f-45ec-b7c4-f97e1cb2db30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:15.815091 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df203e95-2a0f-45ec-b7c4-f97e1cb2db30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:15.817050 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df203e95-2a0f-45ec-b7c4-f97e1cb2db30 service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:15.831651 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 972/1960] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:15 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:17.299649 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd3842-25fb-4269-bf25-1d59d22821f5 service cinder] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:17.386064 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd3842-25fb-4269-bf25-1d59d22821f5 service cinder] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:17.400054 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7c126-bcef-4a23-810a-a26465851a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:17.400054 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7c126-bcef-4a23-810a-a26465851a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:17.400054 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7c126-bcef-4a23-810a-a26465851a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:17.400054 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7c126-bcef-4a23-810a-a26465851a43 admin admin] PATH_INFO: `/v3/users/9b21ecb959de4f7eab7b570afe0d065f` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:17.400376 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e7c126-bcef-4a23-810a-a26465851a43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b21ecb959de4f7eab7b570afe0d065f)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:17.400376 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e7c126-bcef-4a23-810a-a26465851a43 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:17.505932 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-d7e7c126-bcef-4a23-810a-a26465851a43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b21ecb959de4f7eab7b570afe0d065f'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:17.509948 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-d7e7c126-bcef-4a23-810a-a26465851a43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b21ecb959de4f7eab7b570afe0d065f'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:17.532068 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-d7e7c126-bcef-4a23-810a-a26465851a43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b21ecb959de4f7eab7b570afe0d065f'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:17.553286 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-d7e7c126-bcef-4a23-810a-a26465851a43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b21ecb959de4f7eab7b570afe0d065f'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:17.573132 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-d7e7c126-bcef-4a23-810a-a26465851a43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b21ecb959de4f7eab7b570afe0d065f'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:17.583951 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 989/1961] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:17 2021] DELETE /identity/v3/users/9b21ecb959de4f7eab7b570afe0d065f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:17.585653 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a1ef8-c6e0-4b30-9e6b-3c6a012eee9c None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:17.586226 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a1ef8-c6e0-4b30-9e6b-3c6a012eee9c None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:17.586226 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a1ef8-c6e0-4b30-9e6b-3c6a012eee9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:17.626411 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-014a1ef8-c6e0-4b30-9e6b-3c6a012eee9c None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:17.627689 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-014a1ef8-c6e0-4b30-9e6b-3c6a012eee9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:17.740353 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 973/1962] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:17.747275 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7c126-bcef-4a23-810a-a26465851a43 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:17.748665 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-d7e7c126-bcef-4a23-810a-a26465851a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:17.829515 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7c126-bcef-4a23-810a-a26465851a43 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:17.833657 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac2838-a4b8-46ad-a665-2082c1f4c2c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:17.834595 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac2838-a4b8-46ad-a665-2082c1f4c2c1 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:17.835057 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac2838-a4b8-46ad-a665-2082c1f4c2c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:17.835490 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac2838-a4b8-46ad-a665-2082c1f4c2c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:17.847770 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac2838-a4b8-46ad-a665-2082c1f4c2c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:17.849440 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac2838-a4b8-46ad-a665-2082c1f4c2c1 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:17.864687 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 990/1963] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:17 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:18.374720 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a1ef8-c6e0-4b30-9e6b-3c6a012eee9c None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:18.376152 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-014a1ef8-c6e0-4b30-9e6b-3c6a012eee9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:18.388724 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a1ef8-c6e0-4b30-9e6b-3c6a012eee9c None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:18.393908 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcf7d3-2dcc-42c4-a843-2045e88d385e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:18.394994 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcf7d3-2dcc-42c4-a843-2045e88d385e admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:18.395342 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcf7d3-2dcc-42c4-a843-2045e88d385e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:18.395634 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcf7d3-2dcc-42c4-a843-2045e88d385e admin admin] PATH_INFO: `/v3/projects/6c1b5d08ceb440fc8a8ca6c67adfa23c` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:18.396911 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bcf7d3-2dcc-42c4-a843-2045e88d385e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c1b5d08ceb440fc8a8ca6c67adfa23c)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:18.399301 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bcf7d3-2dcc-42c4-a843-2045e88d385e admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:18.465355 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-53bcf7d3-2dcc-42c4-a843-2045e88d385e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c1b5d08ceb440fc8a8ca6c67adfa23c', 'request_id': 'req-53bcf7d3-2dcc-42c4-a843-2045e88d385e'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:18.478267 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-53bcf7d3-2dcc-42c4-a843-2045e88d385e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c1b5d08ceb440fc8a8ca6c67adfa23c', 'request_id': 'req-53bcf7d3-2dcc-42c4-a843-2045e88d385e'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:18.484735 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-53bcf7d3-2dcc-42c4-a843-2045e88d385e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c1b5d08ceb440fc8a8ca6c67adfa23c', 'request_id': 'req-53bcf7d3-2dcc-42c4-a843-2045e88d385e'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:18.507014 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-53bcf7d3-2dcc-42c4-a843-2045e88d385e admin admin] The token cache is being invalidate because project 6c1b5d08ceb440fc8a8ca6c67adfa23c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:18.507629 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-53bcf7d3-2dcc-42c4-a843-2045e88d385e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:18.508620 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-53bcf7d3-2dcc-42c4-a843-2045e88d385e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:18.510856 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 974/1964] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:18 2021] DELETE /identity/v3/projects/6c1b5d08ceb440fc8a8ca6c67adfa23c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:18.516862 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac2838-a4b8-46ad-a665-2082c1f4c2c1 service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:18.542931 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac2838-a4b8-46ad-a665-2082c1f4c2c1 service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:18.632722 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bc6bb-e565-4216-99ba-34d195da0fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:18.633771 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bc6bb-e565-4216-99ba-34d195da0fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:18.634149 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bc6bb-e565-4216-99ba-34d195da0fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:18.634484 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bc6bb-e565-4216-99ba-34d195da0fb2 admin admin] PATH_INFO: `/v3/users/cc5e8f9a198b4235bf39674e3b52694b` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:18.635615 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bc6bb-e565-4216-99ba-34d195da0fb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc5e8f9a198b4235bf39674e3b52694b)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:18.637730 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bc6bb-e565-4216-99ba-34d195da0fb2 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:18.714419 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-218bc6bb-e565-4216-99ba-34d195da0fb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc5e8f9a198b4235bf39674e3b52694b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:18.729289 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-218bc6bb-e565-4216-99ba-34d195da0fb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc5e8f9a198b4235bf39674e3b52694b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:18.747012 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-218bc6bb-e565-4216-99ba-34d195da0fb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc5e8f9a198b4235bf39674e3b52694b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:18.758356 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-218bc6bb-e565-4216-99ba-34d195da0fb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc5e8f9a198b4235bf39674e3b52694b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:18.774615 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-218bc6bb-e565-4216-99ba-34d195da0fb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc5e8f9a198b4235bf39674e3b52694b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:18.787270 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 991/1965] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:18 2021] DELETE /identity/v3/users/cc5e8f9a198b4235bf39674e3b52694b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:19.101521 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcf7d3-2dcc-42c4-a843-2045e88d385e admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:19.104206 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-53bcf7d3-2dcc-42c4-a843-2045e88d385e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:19.121504 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcf7d3-2dcc-42c4-a843-2045e88d385e admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:19.242083 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cd468-f2f9-4dc1-a07e-ab307c4f50b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:19.243104 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cd468-f2f9-4dc1-a07e-ab307c4f50b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:19.243393 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cd468-f2f9-4dc1-a07e-ab307c4f50b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:19.243673 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cd468-f2f9-4dc1-a07e-ab307c4f50b7 admin admin] PATH_INFO: `/v3/users/fd759baff19e454fa9efb37082eeb817` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:19.244838 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333cd468-f2f9-4dc1-a07e-ab307c4f50b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd759baff19e454fa9efb37082eeb817)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:19.246766 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333cd468-f2f9-4dc1-a07e-ab307c4f50b7 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:19.270279 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bc6bb-e565-4216-99ba-34d195da0fb2 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:19.271751 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-218bc6bb-e565-4216-99ba-34d195da0fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:19.285457 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bc6bb-e565-4216-99ba-34d195da0fb2 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:19.297043 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fd9e6-fdf7-4fc1-9f11-ef1d7bbc06a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:19.297860 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fd9e6-fdf7-4fc1-9f11-ef1d7bbc06a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:19.298154 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fd9e6-fdf7-4fc1-9f11-ef1d7bbc06a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:19.298443 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fd9e6-fdf7-4fc1-9f11-ef1d7bbc06a7 admin admin] PATH_INFO: `/v3/projects/cdb27123484e4a6e9de1e522d9a3b275` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:19.300259 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fd9e6-fdf7-4fc1-9f11-ef1d7bbc06a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdb27123484e4a6e9de1e522d9a3b275)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:19.302235 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fd9e6-fdf7-4fc1-9f11-ef1d7bbc06a7 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:19.349639 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-333cd468-f2f9-4dc1-a07e-ab307c4f50b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd759baff19e454fa9efb37082eeb817'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:19.350310 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-333cd468-f2f9-4dc1-a07e-ab307c4f50b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd759baff19e454fa9efb37082eeb817'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:19.360613 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-9b2fd9e6-fdf7-4fc1-9f11-ef1d7bbc06a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdb27123484e4a6e9de1e522d9a3b275', 'request_id': 'req-9b2fd9e6-fdf7-4fc1-9f11-ef1d7bbc06a7'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:19.365310 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-333cd468-f2f9-4dc1-a07e-ab307c4f50b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd759baff19e454fa9efb37082eeb817'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:19.370464 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-9b2fd9e6-fdf7-4fc1-9f11-ef1d7bbc06a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdb27123484e4a6e9de1e522d9a3b275', 'request_id': 'req-9b2fd9e6-fdf7-4fc1-9f11-ef1d7bbc06a7'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:19.374982 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-333cd468-f2f9-4dc1-a07e-ab307c4f50b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd759baff19e454fa9efb37082eeb817'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:19.378803 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-9b2fd9e6-fdf7-4fc1-9f11-ef1d7bbc06a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdb27123484e4a6e9de1e522d9a3b275', 'request_id': 'req-9b2fd9e6-fdf7-4fc1-9f11-ef1d7bbc06a7'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:19.384622 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-333cd468-f2f9-4dc1-a07e-ab307c4f50b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd759baff19e454fa9efb37082eeb817'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:19.392865 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 975/1966] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:19 2021] DELETE /identity/v3/users/fd759baff19e454fa9efb37082eeb817 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:19.395752 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9807f-ae7f-41e3-8606-e411cc9871d0 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:19.396402 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-9b2fd9e6-fdf7-4fc1-9f11-ef1d7bbc06a7 admin admin] The token cache is being invalidate because project cdb27123484e4a6e9de1e522d9a3b275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:19.396517 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9807f-ae7f-41e3-8606-e411cc9871d0 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:19.396704 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-9b2fd9e6-fdf7-4fc1-9f11-ef1d7bbc06a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:19.396832 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9807f-ae7f-41e3-8606-e411cc9871d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:19.397707 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-9b2fd9e6-fdf7-4fc1-9f11-ef1d7bbc06a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:19.400136 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 992/1967] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:19 2021] DELETE /identity/v3/projects/cdb27123484e4a6e9de1e522d9a3b275 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:19.405552 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd00e37-832a-4248-a0ec-be6ad4ad6ad3 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:19.406013 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd00e37-832a-4248-a0ec-be6ad4ad6ad3 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:19.406377 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd00e37-832a-4248-a0ec-be6ad4ad6ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:19.427897 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-49e9807f-ae7f-41e3-8606-e411cc9871d0 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:19.429176 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-49e9807f-ae7f-41e3-8606-e411cc9871d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:19.430089 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-9dd00e37-832a-4248-a0ec-be6ad4ad6ad3 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:19.431437 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-9dd00e37-832a-4248-a0ec-be6ad4ad6ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:19.503665 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 976/1968] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:19.504681 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 993/1969] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:19.514236 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97d323-dba0-4fc7-9571-b4e61aa9e13c None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:19.514453 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97d323-dba0-4fc7-9571-b4e61aa9e13c None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:19.514735 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97d323-dba0-4fc7-9571-b4e61aa9e13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:19.519397 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd00e37-832a-4248-a0ec-be6ad4ad6ad3 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:19.520818 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-9dd00e37-832a-4248-a0ec-be6ad4ad6ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:19.538340 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-ed97d323-dba0-4fc7-9571-b4e61aa9e13c None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:19.539480 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-ed97d323-dba0-4fc7-9571-b4e61aa9e13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:19.547193 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 977/1970] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:19.551333 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97d323-dba0-4fc7-9571-b4e61aa9e13c None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:19.560314 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97d323-dba0-4fc7-9571-b4e61aa9e13c None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:19.565672 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e0db9-4219-4f31-a3f3-ac5ba790a5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:19.566417 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e0db9-4219-4f31-a3f3-ac5ba790a5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:19.566718 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e0db9-4219-4f31-a3f3-ac5ba790a5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:19.566999 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e0db9-4219-4f31-a3f3-ac5ba790a5c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:19.567892 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e0db9-4219-4f31-a3f3-ac5ba790a5c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:40:19.568198 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e0db9-4219-4f31-a3f3-ac5ba790a5c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:19.569825 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e0db9-4219-4f31-a3f3-ac5ba790a5c9 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:19.587136 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 978/1971] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:40:19.588226 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e0db9-4219-4f31-a3f3-ac5ba790a5c9 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:19.591421 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd00e37-832a-4248-a0ec-be6ad4ad6ad3 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:19.595150 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f26d0-6b37-4b9d-a546-d46605d886c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:19.595744 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f26d0-6b37-4b9d-a546-d46605d886c5 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:19.596210 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f26d0-6b37-4b9d-a546-d46605d886c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:19.596655 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f26d0-6b37-4b9d-a546-d46605d886c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:19.598442 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e0db9-4219-4f31-a3f3-ac5ba790a5c9 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:19.602927 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b97208-7f5d-4ee9-b8fd-933e63678af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:19.603513 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b97208-7f5d-4ee9-b8fd-933e63678af1 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:19.603801 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b97208-7f5d-4ee9-b8fd-933e63678af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:19.604082 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b97208-7f5d-4ee9-b8fd-933e63678af1 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:19.604715 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b97208-7f5d-4ee9-b8fd-933e63678af1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:19.606650 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b97208-7f5d-4ee9-b8fd-933e63678af1 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:19.608017 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f26d0-6b37-4b9d-a546-d46605d886c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:19.609671 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f26d0-6b37-4b9d-a546-d46605d886c5 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:19.622602 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 994/1972] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:19 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:40:19.640829 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 979/1973] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:19 2021] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:40:19.642566 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f26d0-6b37-4b9d-a546-d46605d886c5 service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:19.654199 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f26d0-6b37-4b9d-a546-d46605d886c5 service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:19.734038 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37c272-e50e-402e-84a9-174ed77d6dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:19.734665 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37c272-e50e-402e-84a9-174ed77d6dac admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:19.734960 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37c272-e50e-402e-84a9-174ed77d6dac admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:19.735245 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37c272-e50e-402e-84a9-174ed77d6dac admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:19.736072 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37c272-e50e-402e-84a9-174ed77d6dac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:19.738051 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37c272-e50e-402e-84a9-174ed77d6dac admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:19.764631 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 995/1974] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:19 2021] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:19.768256 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b97208-7f5d-4ee9-b8fd-933e63678af1 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:19.780832 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b97208-7f5d-4ee9-b8fd-933e63678af1 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:19.788302 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341ad23-0715-4031-a9b7-c8f5a9f88918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:19.789185 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341ad23-0715-4031-a9b7-c8f5a9f88918 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:19.789555 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341ad23-0715-4031-a9b7-c8f5a9f88918 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:19.789987 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341ad23-0715-4031-a9b7-c8f5a9f88918 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:19.791347 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341ad23-0715-4031-a9b7-c8f5a9f88918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:19.793551 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341ad23-0715-4031-a9b7-c8f5a9f88918 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:19.828739 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37c272-e50e-402e-84a9-174ed77d6dac admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:19.829377 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 980/1975] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:19 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:19.840769 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37c272-e50e-402e-84a9-174ed77d6dac admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:19.849482 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6781d-26df-4a0b-a0c0-ef562b8d1217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:19.850301 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6781d-26df-4a0b-a0c0-ef562b8d1217 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:19.850753 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6781d-26df-4a0b-a0c0-ef562b8d1217 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:19.851168 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6781d-26df-4a0b-a0c0-ef562b8d1217 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:19.852051 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6781d-26df-4a0b-a0c0-ef562b8d1217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:19.854417 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6781d-26df-4a0b-a0c0-ef562b8d1217 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:19.878129 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 996/1976] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:19 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:19.881929 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341ad23-0715-4031-a9b7-c8f5a9f88918 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:19.893048 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341ad23-0715-4031-a9b7-c8f5a9f88918 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:19.899268 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d01606-13f7-44ed-ac59-627ac0df7997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:19.900209 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d01606-13f7-44ed-ac59-627ac0df7997 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:19.900571 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d01606-13f7-44ed-ac59-627ac0df7997 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:19.900976 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d01606-13f7-44ed-ac59-627ac0df7997 admin admin] PATH_INFO: `/v3/projects/43d9cbc443184ddfa1c2e82538dfa875/users/1cda59069aa2462b9f3ed18e2503ed30/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:19.922335 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d01606-13f7-44ed-ac59-627ac0df7997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43d9cbc443184ddfa1c2e82538dfa875, user_id=1cda59069aa2462b9f3ed18e2503ed30, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:19.925108 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d01606-13f7-44ed-ac59-627ac0df7997 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:19.939817 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 981/1977] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:19 2021] PUT /identity/v3/projects/43d9cbc443184ddfa1c2e82538dfa875/users/1cda59069aa2462b9f3ed18e2503ed30/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:19.951823 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab59c3c-c006-4b74-84e3-4d8495d2905b None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:19.952281 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab59c3c-c006-4b74-84e3-4d8495d2905b None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:19.952575 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab59c3c-c006-4b74-84e3-4d8495d2905b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:19.989861 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-1ab59c3c-c006-4b74-84e3-4d8495d2905b None None] MFA Rules not processed for user `1cda59069aa2462b9f3ed18e2503ed30`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:19.991039 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-1ab59c3c-c006-4b74-84e3-4d8495d2905b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:20.049360 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d01606-13f7-44ed-ac59-627ac0df7997 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:20.051206 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-a3d01606-13f7-44ed-ac59-627ac0df7997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:20.098467 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 997/1978] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:19 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:20.108716 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab59c3c-c006-4b74-84e3-4d8495d2905b None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:20.145728 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d01606-13f7-44ed-ac59-627ac0df7997 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:20.150721 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b34284-9382-46dc-b30f-8bb72ea06af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:20.151803 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b34284-9382-46dc-b30f-8bb72ea06af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:20.152097 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b34284-9382-46dc-b30f-8bb72ea06af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:20.152377 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b34284-9382-46dc-b30f-8bb72ea06af6 admin admin] PATH_INFO: `/v3/projects/2b5ba948094d41159b4d9db29fe48107` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:20.153519 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b34284-9382-46dc-b30f-8bb72ea06af6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b5ba948094d41159b4d9db29fe48107)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:20.155570 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b34284-9382-46dc-b30f-8bb72ea06af6 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:20.183410 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab59c3c-c006-4b74-84e3-4d8495d2905b None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:20.188915 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739854a-5b71-4b9b-bfc3-c0809ff27c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:20.189532 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739854a-5b71-4b9b-bfc3-c0809ff27c3c admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:20.189988 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739854a-5b71-4b9b-bfc3-c0809ff27c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:20.190246 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739854a-5b71-4b9b-bfc3-c0809ff27c3c admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:20.190971 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739854a-5b71-4b9b-bfc3-c0809ff27c3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:20.192886 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739854a-5b71-4b9b-bfc3-c0809ff27c3c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:20.226306 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b3b34284-9382-46dc-b30f-8bb72ea06af6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b5ba948094d41159b4d9db29fe48107', 'request_id': 'req-b3b34284-9382-46dc-b30f-8bb72ea06af6'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:20.230639 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 998/1979] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:20 2021] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:40:20.234606 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739854a-5b71-4b9b-bfc3-c0809ff27c3c admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:20.252327 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b3b34284-9382-46dc-b30f-8bb72ea06af6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b5ba948094d41159b4d9db29fe48107', 'request_id': 'req-b3b34284-9382-46dc-b30f-8bb72ea06af6'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:20.262016 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b3b34284-9382-46dc-b30f-8bb72ea06af6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b5ba948094d41159b4d9db29fe48107', 'request_id': 'req-b3b34284-9382-46dc-b30f-8bb72ea06af6'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:20.282503 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b3b34284-9382-46dc-b30f-8bb72ea06af6 admin admin] The token cache is being invalidate because project 2b5ba948094d41159b4d9db29fe48107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:20.282885 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b3b34284-9382-46dc-b30f-8bb72ea06af6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:20.283863 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b3b34284-9382-46dc-b30f-8bb72ea06af6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:20.286468 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 982/1980] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:20 2021] DELETE /identity/v3/projects/2b5ba948094d41159b4d9db29fe48107 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:20.292898 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b34284-9382-46dc-b30f-8bb72ea06af6 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:20.295091 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-b3b34284-9382-46dc-b30f-8bb72ea06af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:20.327049 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739854a-5b71-4b9b-bfc3-c0809ff27c3c admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:20.334932 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e453ae-0105-4b18-b370-73077a221495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:20.336018 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e453ae-0105-4b18-b370-73077a221495 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:20.336628 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e453ae-0105-4b18-b370-73077a221495 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:20.337241 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e453ae-0105-4b18-b370-73077a221495 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:20.338422 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e453ae-0105-4b18-b370-73077a221495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:20.349084 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e453ae-0105-4b18-b370-73077a221495 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:20.384283 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 999/1981] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:20 2021] POST /identity/v3/users => generated 296 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:40:20.388319 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e453ae-0105-4b18-b370-73077a221495 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:20.390473 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-c7e453ae-0105-4b18-b370-73077a221495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:20.400776 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b34284-9382-46dc-b30f-8bb72ea06af6 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:20.404248 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e453ae-0105-4b18-b370-73077a221495 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:20.405700 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a954a-7209-40a7-b0e9-89ec6336e199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:20.406506 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a954a-7209-40a7-b0e9-89ec6336e199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:20.406801 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a954a-7209-40a7-b0e9-89ec6336e199 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:20.407086 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a954a-7209-40a7-b0e9-89ec6336e199 admin admin] PATH_INFO: `/v3/users/a07bdc3c0c2b48a8b9afc451ff813b2a` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:20.408264 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a954a-7209-40a7-b0e9-89ec6336e199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a07bdc3c0c2b48a8b9afc451ff813b2a)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:20.410018 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87031ee9-ef40-411c-9d76-794d3c9bfb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:20.410317 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a954a-7209-40a7-b0e9-89ec6336e199 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:20.412698 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87031ee9-ef40-411c-9d76-794d3c9bfb88 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:20.413120 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87031ee9-ef40-411c-9d76-794d3c9bfb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:20.413484 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87031ee9-ef40-411c-9d76-794d3c9bfb88 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:20.414774 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87031ee9-ef40-411c-9d76-794d3c9bfb88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:20.416457 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87031ee9-ef40-411c-9d76-794d3c9bfb88 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:20.428706 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1000/1982] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:20 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:40:20.434260 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87031ee9-ef40-411c-9d76-794d3c9bfb88 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:20.446504 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87031ee9-ef40-411c-9d76-794d3c9bfb88 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:20.459061 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc31097-df9e-4d12-8efc-45b8eb6e84c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:20.459968 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc31097-df9e-4d12-8efc-45b8eb6e84c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:20.460583 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc31097-df9e-4d12-8efc-45b8eb6e84c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:20.461016 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc31097-df9e-4d12-8efc-45b8eb6e84c1 admin admin] PATH_INFO: `/v3/projects/0c0c001812904a9898386125b0f2b7cb/users/4063cce9ea0c44c1b1be501e324ff90e/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:20.466633 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-087a954a-7209-40a7-b0e9-89ec6336e199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a07bdc3c0c2b48a8b9afc451ff813b2a'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:20.467428 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-087a954a-7209-40a7-b0e9-89ec6336e199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a07bdc3c0c2b48a8b9afc451ff813b2a'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:20.481401 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-087a954a-7209-40a7-b0e9-89ec6336e199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a07bdc3c0c2b48a8b9afc451ff813b2a'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:20.484316 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc31097-df9e-4d12-8efc-45b8eb6e84c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c0c001812904a9898386125b0f2b7cb, user_id=4063cce9ea0c44c1b1be501e324ff90e, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:20.487332 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc31097-df9e-4d12-8efc-45b8eb6e84c1 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:20.489491 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-087a954a-7209-40a7-b0e9-89ec6336e199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a07bdc3c0c2b48a8b9afc451ff813b2a'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:20.499478 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-087a954a-7209-40a7-b0e9-89ec6336e199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a07bdc3c0c2b48a8b9afc451ff813b2a'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:20.501960 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1001/1983] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:20 2021] PUT /identity/v3/projects/0c0c001812904a9898386125b0f2b7cb/users/4063cce9ea0c44c1b1be501e324ff90e/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:20.505874 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc31097-df9e-4d12-8efc-45b8eb6e84c1 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:20.507524 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-9fc31097-df9e-4d12-8efc-45b8eb6e84c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:20.508869 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 983/1984] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:20 2021] DELETE /identity/v3/users/a07bdc3c0c2b48a8b9afc451ff813b2a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:20.593737 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc31097-df9e-4d12-8efc-45b8eb6e84c1 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:20.660457 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71d2ad-23d7-44d9-a4ef-03ea0c63907a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:20.661235 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71d2ad-23d7-44d9-a4ef-03ea0c63907a admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:20.661529 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71d2ad-23d7-44d9-a4ef-03ea0c63907a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:20.661816 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71d2ad-23d7-44d9-a4ef-03ea0c63907a admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:20.662531 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71d2ad-23d7-44d9-a4ef-03ea0c63907a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:20.664142 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71d2ad-23d7-44d9-a4ef-03ea0c63907a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:20.681479 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1002/1985] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:20 2021] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:20.683121 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a954a-7209-40a7-b0e9-89ec6336e199 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:20.693841 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a954a-7209-40a7-b0e9-89ec6336e199 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:20.700269 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cf456-b97c-43d1-a6c6-70af3de0b97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:20.704376 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cf456-b97c-43d1-a6c6-70af3de0b97e admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:20.704715 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cf456-b97c-43d1-a6c6-70af3de0b97e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:20.705024 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cf456-b97c-43d1-a6c6-70af3de0b97e admin admin] PATH_INFO: `/v3/projects/0c0c001812904a9898386125b0f2b7cb/users/4063cce9ea0c44c1b1be501e324ff90e/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:20.710402 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239cf456-b97c-43d1-a6c6-70af3de0b97e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c0c001812904a9898386125b0f2b7cb, user_id=4063cce9ea0c44c1b1be501e324ff90e, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:20.713827 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239cf456-b97c-43d1-a6c6-70af3de0b97e admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:20.727629 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 984/1986] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:20 2021] PUT /identity/v3/projects/0c0c001812904a9898386125b0f2b7cb/users/4063cce9ea0c44c1b1be501e324ff90e/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:20.737244 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b76029-0154-4740-840a-76204989b715 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:20.737540 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b76029-0154-4740-840a-76204989b715 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:20.737825 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b76029-0154-4740-840a-76204989b715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:20.774758 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-a0b76029-0154-4740-840a-76204989b715 None None] MFA Rules not processed for user `4063cce9ea0c44c1b1be501e324ff90e`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:20.775931 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-a0b76029-0154-4740-840a-76204989b715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:20.870774 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1003/1987] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:20 2021] POST /identity/v3/auth/tokens => generated 3753 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:20.881626 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cf456-b97c-43d1-a6c6-70af3de0b97e admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:20.883914 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-239cf456-b97c-43d1-a6c6-70af3de0b97e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:20.898214 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b76029-0154-4740-840a-76204989b715 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:20.900163 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-a0b76029-0154-4740-840a-76204989b715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:20.998148 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cf456-b97c-43d1-a6c6-70af3de0b97e admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:20.999733 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b76029-0154-4740-840a-76204989b715 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:21.001929 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692208a-9a0a-4cb5-9400-4251fd29926f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:21.002623 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692208a-9a0a-4cb5-9400-4251fd29926f service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:21.002986 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692208a-9a0a-4cb5-9400-4251fd29926f service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:21.003343 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692208a-9a0a-4cb5-9400-4251fd29926f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:21.004477 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13004453-bfe3-4807-befd-8e5441399d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:21.005399 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13004453-bfe3-4807-befd-8e5441399d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:21.005763 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13004453-bfe3-4807-befd-8e5441399d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:21.006114 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13004453-bfe3-4807-befd-8e5441399d20 admin admin] PATH_INFO: `/v3/projects/09eb9697f867422f9fe28371e49c3d2e` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:21.007304 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13004453-bfe3-4807-befd-8e5441399d20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09eb9697f867422f9fe28371e49c3d2e)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:21.010288 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13004453-bfe3-4807-befd-8e5441399d20 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:21.014630 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692208a-9a0a-4cb5-9400-4251fd29926f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:21.016772 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692208a-9a0a-4cb5-9400-4251fd29926f service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:21.028653 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 985/1988] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:20 2021] GET /identity/v3/auth/tokens => generated 3753 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:21.079569 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-13004453-bfe3-4807-befd-8e5441399d20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09eb9697f867422f9fe28371e49c3d2e', 'request_id': 'req-13004453-bfe3-4807-befd-8e5441399d20'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:21.091411 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-13004453-bfe3-4807-befd-8e5441399d20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09eb9697f867422f9fe28371e49c3d2e', 'request_id': 'req-13004453-bfe3-4807-befd-8e5441399d20'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:21.107148 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-13004453-bfe3-4807-befd-8e5441399d20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09eb9697f867422f9fe28371e49c3d2e', 'request_id': 'req-13004453-bfe3-4807-befd-8e5441399d20'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:21.131922 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-13004453-bfe3-4807-befd-8e5441399d20 admin admin] The token cache is being invalidate because project 09eb9697f867422f9fe28371e49c3d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:21.132212 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-13004453-bfe3-4807-befd-8e5441399d20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:21.133449 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-13004453-bfe3-4807-befd-8e5441399d20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:21.135192 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1004/1989] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:20 2021] DELETE /identity/v3/projects/09eb9697f867422f9fe28371e49c3d2e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:21.141028 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b897d-623f-4ece-9253-b6c7bf6ef535 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:21.141436 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b897d-623f-4ece-9253-b6c7bf6ef535 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:21.141815 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b897d-623f-4ece-9253-b6c7bf6ef535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:21.165765 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-de4b897d-623f-4ece-9253-b6c7bf6ef535 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:21.166918 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-de4b897d-623f-4ece-9253-b6c7bf6ef535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:21.235616 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 986/1990] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:21.244049 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c51cd-0247-47c1-bf14-9124b2e87d35 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:21.244345 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c51cd-0247-47c1-bf14-9124b2e87d35 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:21.244630 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c51cd-0247-47c1-bf14-9124b2e87d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:21.270426 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-188c51cd-0247-47c1-bf14-9124b2e87d35 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:21.271599 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-188c51cd-0247-47c1-bf14-9124b2e87d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:21.279834 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1005/1991] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:21.284069 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b897d-623f-4ece-9253-b6c7bf6ef535 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:21.294828 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b897d-623f-4ece-9253-b6c7bf6ef535 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:21.299833 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04731364-ef99-4348-b395-803a29cbce51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:21.300568 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04731364-ef99-4348-b395-803a29cbce51 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:21.300967 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04731364-ef99-4348-b395-803a29cbce51 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:21.301352 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04731364-ef99-4348-b395-803a29cbce51 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:21.302100 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04731364-ef99-4348-b395-803a29cbce51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:40:21.302402 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04731364-ef99-4348-b395-803a29cbce51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:21.304381 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04731364-ef99-4348-b395-803a29cbce51 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:21.322200 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 987/1992] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:40:21.326586 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c51cd-0247-47c1-bf14-9124b2e87d35 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:21.339008 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c51cd-0247-47c1-bf14-9124b2e87d35 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:21.343929 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c0b66-8f20-492e-8140-d28f2e18c78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:21.344630 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c0b66-8f20-492e-8140-d28f2e18c78c admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:21.345027 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c0b66-8f20-492e-8140-d28f2e18c78c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:21.345392 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c0b66-8f20-492e-8140-d28f2e18c78c admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:21.346118 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c0b66-8f20-492e-8140-d28f2e18c78c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:21.348100 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c0b66-8f20-492e-8140-d28f2e18c78c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:21.380663 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1006/1993] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:21 2021] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:40:21.385549 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04731364-ef99-4348-b395-803a29cbce51 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:21.400738 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04731364-ef99-4348-b395-803a29cbce51 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:21.474919 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f7b73-5812-42b2-ab3b-aa0012a19a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:21.475903 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f7b73-5812-42b2-ab3b-aa0012a19a14 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:21.476299 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f7b73-5812-42b2-ab3b-aa0012a19a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:21.476726 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f7b73-5812-42b2-ab3b-aa0012a19a14 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:21.477770 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f7b73-5812-42b2-ab3b-aa0012a19a14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:21.480852 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f7b73-5812-42b2-ab3b-aa0012a19a14 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:21.504380 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 988/1994] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:21 2021] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:21.509071 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c0b66-8f20-492e-8140-d28f2e18c78c admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:21.521519 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c0b66-8f20-492e-8140-d28f2e18c78c admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:21.528548 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7a499-458c-424f-b85a-cfc0424d893e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:21.529306 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7a499-458c-424f-b85a-cfc0424d893e admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:21.529724 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7a499-458c-424f-b85a-cfc0424d893e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:21.530112 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7a499-458c-424f-b85a-cfc0424d893e admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:21.531035 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7a499-458c-424f-b85a-cfc0424d893e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:21.532809 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7a499-458c-424f-b85a-cfc0424d893e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:21.550600 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1007/1995] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:21 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:21.555551 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f7b73-5812-42b2-ab3b-aa0012a19a14 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:21.566850 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f7b73-5812-42b2-ab3b-aa0012a19a14 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:21.572091 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb855430-9cf8-4841-abe0-e839301bc41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:21.572766 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb855430-9cf8-4841-abe0-e839301bc41e admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:21.573060 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb855430-9cf8-4841-abe0-e839301bc41e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:21.573342 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb855430-9cf8-4841-abe0-e839301bc41e admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:21.574042 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb855430-9cf8-4841-abe0-e839301bc41e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:21.575600 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb855430-9cf8-4841-abe0-e839301bc41e admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:21.587340 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 989/1996] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:21 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:21.591831 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7a499-458c-424f-b85a-cfc0424d893e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:21.608136 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7a499-458c-424f-b85a-cfc0424d893e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:21.614464 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145f4f6-bbe9-4370-9a32-0ba4ec4571aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:21.615775 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145f4f6-bbe9-4370-9a32-0ba4ec4571aa admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:21.616068 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145f4f6-bbe9-4370-9a32-0ba4ec4571aa admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:21.616360 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145f4f6-bbe9-4370-9a32-0ba4ec4571aa admin admin] PATH_INFO: `/v3/projects/377833d3019d4527b76e0d97e737413b/users/853eb710255b467e99c0cded6976f74f/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:21.638799 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145f4f6-bbe9-4370-9a32-0ba4ec4571aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=377833d3019d4527b76e0d97e737413b, user_id=853eb710255b467e99c0cded6976f74f, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:21.641762 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145f4f6-bbe9-4370-9a32-0ba4ec4571aa admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:21.664683 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1008/1997] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:21 2021] PUT /identity/v3/projects/377833d3019d4527b76e0d97e737413b/users/853eb710255b467e99c0cded6976f74f/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:21.675507 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bdfa9-44fd-46ba-bb0d-d50ae9a5305e None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:21.675507 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bdfa9-44fd-46ba-bb0d-d50ae9a5305e None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:21.675507 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bdfa9-44fd-46ba-bb0d-d50ae9a5305e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:21.705731 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145f4f6-bbe9-4370-9a32-0ba4ec4571aa admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:21.707481 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-4145f4f6-bbe9-4370-9a32-0ba4ec4571aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:21.713490 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-6e0bdfa9-44fd-46ba-bb0d-d50ae9a5305e None None] MFA Rules not processed for user `853eb710255b467e99c0cded6976f74f`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:21.714650 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-6e0bdfa9-44fd-46ba-bb0d-d50ae9a5305e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:21.781177 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145f4f6-bbe9-4370-9a32-0ba4ec4571aa admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:21.785939 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a40092-12b7-4f42-8705-0ea9f6bb72e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:21.786759 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a40092-12b7-4f42-8705-0ea9f6bb72e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:21.787050 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a40092-12b7-4f42-8705-0ea9f6bb72e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:21.787336 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a40092-12b7-4f42-8705-0ea9f6bb72e6 admin admin] PATH_INFO: `/v3/users/1cda59069aa2462b9f3ed18e2503ed30` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:21.788622 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a40092-12b7-4f42-8705-0ea9f6bb72e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cda59069aa2462b9f3ed18e2503ed30)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:21.791087 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a40092-12b7-4f42-8705-0ea9f6bb72e6 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:21.795429 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 990/1998] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:21 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:21.800902 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bdfa9-44fd-46ba-bb0d-d50ae9a5305e None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:21.812296 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bdfa9-44fd-46ba-bb0d-d50ae9a5305e None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:21.817488 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1776f7-c6d0-411b-89b5-20b36c7102ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:21.818101 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1776f7-c6d0-411b-89b5-20b36c7102ca admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:21.818399 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1776f7-c6d0-411b-89b5-20b36c7102ca admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:21.818688 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1776f7-c6d0-411b-89b5-20b36c7102ca admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:21.819342 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1776f7-c6d0-411b-89b5-20b36c7102ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:21.821575 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1776f7-c6d0-411b-89b5-20b36c7102ca admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:21.847547 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-44a40092-12b7-4f42-8705-0ea9f6bb72e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cda59069aa2462b9f3ed18e2503ed30'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:21.848589 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-44a40092-12b7-4f42-8705-0ea9f6bb72e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cda59069aa2462b9f3ed18e2503ed30'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:21.853041 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 991/1999] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:21 2021] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:21.857274 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1776f7-c6d0-411b-89b5-20b36c7102ca admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:21.862957 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-44a40092-12b7-4f42-8705-0ea9f6bb72e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cda59069aa2462b9f3ed18e2503ed30'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:21.872265 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-44a40092-12b7-4f42-8705-0ea9f6bb72e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cda59069aa2462b9f3ed18e2503ed30'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:21.884198 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-44a40092-12b7-4f42-8705-0ea9f6bb72e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cda59069aa2462b9f3ed18e2503ed30'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:21.893251 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1009/2000] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:21 2021] DELETE /identity/v3/users/1cda59069aa2462b9f3ed18e2503ed30 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:21.898069 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1db94f-444c-4592-94eb-6693d1845dfa None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:21.898358 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1db94f-444c-4592-94eb-6693d1845dfa None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:21.898682 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1db94f-444c-4592-94eb-6693d1845dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:21.922788 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-ef1db94f-444c-4592-94eb-6693d1845dfa None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:21.924006 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-ef1db94f-444c-4592-94eb-6693d1845dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:21.934073 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1776f7-c6d0-411b-89b5-20b36c7102ca admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:22.003941 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1010/2001] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:22.011030 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a496f-b26f-447a-99a9-92a5c11fbfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:22.011782 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a496f-b26f-447a-99a9-92a5c11fbfb5 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:22.012015 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1db94f-444c-4592-94eb-6693d1845dfa None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:22.012200 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a496f-b26f-447a-99a9-92a5c11fbfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:22.012573 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a496f-b26f-447a-99a9-92a5c11fbfb5 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:22.013388 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a496f-b26f-447a-99a9-92a5c11fbfb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:22.013813 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-ef1db94f-444c-4592-94eb-6693d1845dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:22.015619 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a496f-b26f-447a-99a9-92a5c11fbfb5 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:22.044059 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 992/2002] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:21 2021] POST /identity/v3/users => generated 298 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:40:22.045464 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a496f-b26f-447a-99a9-92a5c11fbfb5 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:22.047178 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e91a496f-b26f-447a-99a9-92a5c11fbfb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:22.058934 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a496f-b26f-447a-99a9-92a5c11fbfb5 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:22.064015 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2af0e5-2e19-4e50-afe7-c12b7d242a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:22.064652 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2af0e5-2e19-4e50-afe7-c12b7d242a5a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:22.065361 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2af0e5-2e19-4e50-afe7-c12b7d242a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:22.065361 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2af0e5-2e19-4e50-afe7-c12b7d242a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:22.066047 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2af0e5-2e19-4e50-afe7-c12b7d242a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:22.067642 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2af0e5-2e19-4e50-afe7-c12b7d242a5a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:22.079492 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 993/2003] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:22 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:22.084138 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2af0e5-2e19-4e50-afe7-c12b7d242a5a admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:22.094310 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2af0e5-2e19-4e50-afe7-c12b7d242a5a admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:22.096090 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1db94f-444c-4592-94eb-6693d1845dfa None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:22.098718 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b181cc1-60fa-4e9d-98a2-0d149ec2cc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:22.099464 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b181cc1-60fa-4e9d-98a2-0d149ec2cc7b admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:22.099752 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b181cc1-60fa-4e9d-98a2-0d149ec2cc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:22.099863 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494b30b-6e7e-4a70-b559-b4228f957965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:22.100035 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b181cc1-60fa-4e9d-98a2-0d149ec2cc7b admin admin] PATH_INFO: `/v3/projects/fb916a3dd1db47eb873a4ba281c16427/users/238c70adba2348d792d6f3e8302a9c72/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:22.100360 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494b30b-6e7e-4a70-b559-b4228f957965 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:22.100650 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494b30b-6e7e-4a70-b559-b4228f957965 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:22.100969 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494b30b-6e7e-4a70-b559-b4228f957965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:22.111217 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494b30b-6e7e-4a70-b559-b4228f957965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:22.112760 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494b30b-6e7e-4a70-b559-b4228f957965 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:22.122901 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1011/2004] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:22 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:22.124201 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b181cc1-60fa-4e9d-98a2-0d149ec2cc7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb916a3dd1db47eb873a4ba281c16427, user_id=238c70adba2348d792d6f3e8302a9c72, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:22.126907 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b181cc1-60fa-4e9d-98a2-0d149ec2cc7b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:22.142953 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 994/2005] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:22 2021] PUT /identity/v3/projects/fb916a3dd1db47eb873a4ba281c16427/users/238c70adba2348d792d6f3e8302a9c72/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:22.151890 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494b30b-6e7e-4a70-b559-b4228f957965 service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:22.163621 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494b30b-6e7e-4a70-b559-b4228f957965 service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:22.237430 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4675ee3-2d15-4533-adb2-3189b347d078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:22.237848 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4675ee3-2d15-4533-adb2-3189b347d078 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:22.238135 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4675ee3-2d15-4533-adb2-3189b347d078 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:22.238418 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4675ee3-2d15-4533-adb2-3189b347d078 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:22.239117 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4675ee3-2d15-4533-adb2-3189b347d078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:22.241116 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4675ee3-2d15-4533-adb2-3189b347d078 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:22.254108 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1012/2006] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:22 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:22.258231 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b181cc1-60fa-4e9d-98a2-0d149ec2cc7b admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:22.268788 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b181cc1-60fa-4e9d-98a2-0d149ec2cc7b admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:22.274019 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e174dcc-d845-42d2-bc07-1bdfbdb1ee3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:22.274906 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e174dcc-d845-42d2-bc07-1bdfbdb1ee3d admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:22.275287 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e174dcc-d845-42d2-bc07-1bdfbdb1ee3d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:22.275568 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e174dcc-d845-42d2-bc07-1bdfbdb1ee3d admin admin] PATH_INFO: `/v3/projects/fb916a3dd1db47eb873a4ba281c16427/users/238c70adba2348d792d6f3e8302a9c72/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:22.277462 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e174dcc-d845-42d2-bc07-1bdfbdb1ee3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb916a3dd1db47eb873a4ba281c16427, user_id=238c70adba2348d792d6f3e8302a9c72, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:22.280055 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e174dcc-d845-42d2-bc07-1bdfbdb1ee3d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:22.292221 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 995/2007] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:22 2021] PUT /identity/v3/projects/fb916a3dd1db47eb873a4ba281c16427/users/238c70adba2348d792d6f3e8302a9c72/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:22.303825 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cde71-1169-4919-9829-b87cc5820f2e None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:22.304212 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cde71-1169-4919-9829-b87cc5820f2e None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:22.304560 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cde71-1169-4919-9829-b87cc5820f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:22.343610 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-214cde71-1169-4919-9829-b87cc5820f2e None None] MFA Rules not processed for user `238c70adba2348d792d6f3e8302a9c72`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:22.345008 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-214cde71-1169-4919-9829-b87cc5820f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:22.432236 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1013/2008] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:22 2021] POST /identity/v3/auth/tokens => generated 3757 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:22.442263 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e174dcc-d845-42d2-bc07-1bdfbdb1ee3d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:22.444180 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-6e174dcc-d845-42d2-bc07-1bdfbdb1ee3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:22.514840 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e174dcc-d845-42d2-bc07-1bdfbdb1ee3d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:22.518569 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022334c-ce56-4ab9-83b6-bd20b6fcf026 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:22.519224 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022334c-ce56-4ab9-83b6-bd20b6fcf026 service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:22.519611 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022334c-ce56-4ab9-83b6-bd20b6fcf026 service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:22.520011 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022334c-ce56-4ab9-83b6-bd20b6fcf026 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:22.531143 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022334c-ce56-4ab9-83b6-bd20b6fcf026 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:22.532385 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022334c-ce56-4ab9-83b6-bd20b6fcf026 service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:22.542213 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 996/2009] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:22 2021] GET /identity/v3/auth/tokens => generated 3757 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:22.893924 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cde71-1169-4919-9829-b87cc5820f2e None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:22.896139 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-214cde71-1169-4919-9829-b87cc5820f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:23.020613 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cde71-1169-4919-9829-b87cc5820f2e None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:23.026412 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002e6da-8e93-4ce4-8126-4bd31d69327b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:23.027619 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002e6da-8e93-4ce4-8126-4bd31d69327b admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:23.028133 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002e6da-8e93-4ce4-8126-4bd31d69327b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:23.028571 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002e6da-8e93-4ce4-8126-4bd31d69327b admin admin] PATH_INFO: `/v3/projects/43d9cbc443184ddfa1c2e82538dfa875` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:23.029948 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002e6da-8e93-4ce4-8126-4bd31d69327b admin admin] RBAC: Authorizing `identity:delete_project(project_id=43d9cbc443184ddfa1c2e82538dfa875)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:23.032035 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002e6da-8e93-4ce4-8126-4bd31d69327b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:23.045549 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022334c-ce56-4ab9-83b6-bd20b6fcf026 service cinder] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:23.046989 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-4022334c-ce56-4ab9-83b6-bd20b6fcf026 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:23.062915 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022334c-ce56-4ab9-83b6-bd20b6fcf026 service cinder] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:23.073715 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae099b35-9800-4fcb-afb8-9f8b8690f9aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:23.074729 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae099b35-9800-4fcb-afb8-9f8b8690f9aa service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:23.075122 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae099b35-9800-4fcb-afb8-9f8b8690f9aa service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:23.075594 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae099b35-9800-4fcb-afb8-9f8b8690f9aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:23.077722 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-ae099b35-9800-4fcb-afb8-9f8b8690f9aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:23.098749 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-4002e6da-8e93-4ce4-8126-4bd31d69327b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43d9cbc443184ddfa1c2e82538dfa875', 'request_id': 'req-4002e6da-8e93-4ce4-8126-4bd31d69327b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:23.105410 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-4002e6da-8e93-4ce4-8126-4bd31d69327b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43d9cbc443184ddfa1c2e82538dfa875', 'request_id': 'req-4002e6da-8e93-4ce4-8126-4bd31d69327b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:23.121334 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-4002e6da-8e93-4ce4-8126-4bd31d69327b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43d9cbc443184ddfa1c2e82538dfa875', 'request_id': 'req-4002e6da-8e93-4ce4-8126-4bd31d69327b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:23.151684 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-4002e6da-8e93-4ce4-8126-4bd31d69327b admin admin] The token cache is being invalidate because project 43d9cbc443184ddfa1c2e82538dfa875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:23.152331 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-4002e6da-8e93-4ce4-8126-4bd31d69327b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:23.153199 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-4002e6da-8e93-4ce4-8126-4bd31d69327b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:23.155674 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1014/2010] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:22 2021] DELETE /identity/v3/projects/43d9cbc443184ddfa1c2e82538dfa875 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:23.160394 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002e6da-8e93-4ce4-8126-4bd31d69327b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:23.166021 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-4002e6da-8e93-4ce4-8126-4bd31d69327b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:23.171986 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae099b35-9800-4fcb-afb8-9f8b8690f9aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:23.173780 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae099b35-9800-4fcb-afb8-9f8b8690f9aa service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:23.187332 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 997/2011] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:23 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:23.270809 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002e6da-8e93-4ce4-8126-4bd31d69327b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:23.283526 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c10bf-8563-4e1c-b096-3eef3ef910b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:23.284347 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c10bf-8563-4e1c-b096-3eef3ef910b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:23.284639 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c10bf-8563-4e1c-b096-3eef3ef910b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:23.284955 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c10bf-8563-4e1c-b096-3eef3ef910b4 admin admin] PATH_INFO: `/v3/users/4063cce9ea0c44c1b1be501e324ff90e` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:23.290521 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c10bf-8563-4e1c-b096-3eef3ef910b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4063cce9ea0c44c1b1be501e324ff90e)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:23.292582 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c10bf-8563-4e1c-b096-3eef3ef910b4 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:23.352854 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-321c10bf-8563-4e1c-b096-3eef3ef910b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4063cce9ea0c44c1b1be501e324ff90e'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:23.353905 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-321c10bf-8563-4e1c-b096-3eef3ef910b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4063cce9ea0c44c1b1be501e324ff90e'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:23.370868 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-321c10bf-8563-4e1c-b096-3eef3ef910b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4063cce9ea0c44c1b1be501e324ff90e'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:23.381469 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-321c10bf-8563-4e1c-b096-3eef3ef910b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4063cce9ea0c44c1b1be501e324ff90e'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:23.391714 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-321c10bf-8563-4e1c-b096-3eef3ef910b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4063cce9ea0c44c1b1be501e324ff90e'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:23.399838 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1015/2012] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:23 2021] DELETE /identity/v3/users/4063cce9ea0c44c1b1be501e324ff90e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:23.848013 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae099b35-9800-4fcb-afb8-9f8b8690f9aa service cinder] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:23.850831 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-ae099b35-9800-4fcb-afb8-9f8b8690f9aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:23.890861 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae099b35-9800-4fcb-afb8-9f8b8690f9aa service cinder] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:24.028447 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c1d67-e5bf-44a7-92cf-9b6fbeac6358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:24.030595 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c1d67-e5bf-44a7-92cf-9b6fbeac6358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:24.031265 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c1d67-e5bf-44a7-92cf-9b6fbeac6358 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:24.031558 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c1d67-e5bf-44a7-92cf-9b6fbeac6358 admin admin] PATH_INFO: `/v3/users/fb2f354953e3456e936c4728807f0b18` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:24.032986 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c1d67-e5bf-44a7-92cf-9b6fbeac6358 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb2f354953e3456e936c4728807f0b18)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:24.035831 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c1d67-e5bf-44a7-92cf-9b6fbeac6358 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:24.085722 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c10bf-8563-4e1c-b096-3eef3ef910b4 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:24.088162 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-321c10bf-8563-4e1c-b096-3eef3ef910b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:24.104478 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c10bf-8563-4e1c-b096-3eef3ef910b4 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:24.105541 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5c0c1d67-e5bf-44a7-92cf-9b6fbeac6358 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb2f354953e3456e936c4728807f0b18'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:24.106340 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5c0c1d67-e5bf-44a7-92cf-9b6fbeac6358 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb2f354953e3456e936c4728807f0b18'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:24.116814 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105941ec-19c0-42d6-b4c4-b24c11876401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:24.117666 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105941ec-19c0-42d6-b4c4-b24c11876401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:24.118987 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105941ec-19c0-42d6-b4c4-b24c11876401 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:24.119176 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105941ec-19c0-42d6-b4c4-b24c11876401 admin admin] PATH_INFO: `/v3/projects/0c0c001812904a9898386125b0f2b7cb` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:24.120325 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105941ec-19c0-42d6-b4c4-b24c11876401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c0c001812904a9898386125b0f2b7cb)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:24.122319 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105941ec-19c0-42d6-b4c4-b24c11876401 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:24.126095 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5c0c1d67-e5bf-44a7-92cf-9b6fbeac6358 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb2f354953e3456e936c4728807f0b18'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:24.135187 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5c0c1d67-e5bf-44a7-92cf-9b6fbeac6358 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb2f354953e3456e936c4728807f0b18'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:24.143616 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5c0c1d67-e5bf-44a7-92cf-9b6fbeac6358 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb2f354953e3456e936c4728807f0b18'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:24.150907 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 998/2013] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:23 2021] DELETE /identity/v3/users/fb2f354953e3456e936c4728807f0b18 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:24.160982 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7b1b0-d4a1-45fb-9422-64aff7a313b6 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:24.161142 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7b1b0-d4a1-45fb-9422-64aff7a313b6 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:24.161438 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7b1b0-d4a1-45fb-9422-64aff7a313b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:24.181027 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-105941ec-19c0-42d6-b4c4-b24c11876401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c0c001812904a9898386125b0f2b7cb', 'request_id': 'req-105941ec-19c0-42d6-b4c4-b24c11876401'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:24.184135 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-dba7b1b0-d4a1-45fb-9422-64aff7a313b6 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:24.185440 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-dba7b1b0-d4a1-45fb-9422-64aff7a313b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:24.186517 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-105941ec-19c0-42d6-b4c4-b24c11876401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c0c001812904a9898386125b0f2b7cb', 'request_id': 'req-105941ec-19c0-42d6-b4c4-b24c11876401'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:24.194558 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-105941ec-19c0-42d6-b4c4-b24c11876401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c0c001812904a9898386125b0f2b7cb', 'request_id': 'req-105941ec-19c0-42d6-b4c4-b24c11876401'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:24.215788 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-105941ec-19c0-42d6-b4c4-b24c11876401 admin admin] The token cache is being invalidate because project 0c0c001812904a9898386125b0f2b7cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:24.216339 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-105941ec-19c0-42d6-b4c4-b24c11876401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:24.217347 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-105941ec-19c0-42d6-b4c4-b24c11876401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:24.223803 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1016/2014] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:24 2021] DELETE /identity/v3/projects/0c0c001812904a9898386125b0f2b7cb => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:24.233191 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1aabd-7722-4348-9111-d9861fd87ee1 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:24.233537 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1aabd-7722-4348-9111-d9861fd87ee1 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:24.233830 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1aabd-7722-4348-9111-d9861fd87ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:24.259718 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 999/2015] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:24.263291 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-13a1aabd-7722-4348-9111-d9861fd87ee1 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:24.264392 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-13a1aabd-7722-4348-9111-d9861fd87ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:24.270289 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7b1b0-d4a1-45fb-9422-64aff7a313b6 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:24.271745 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-dba7b1b0-d4a1-45fb-9422-64aff7a313b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:24.273121 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1017/2016] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:24.281110 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a10692-c70a-4217-8bae-e51506fe0bbf None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:24.281429 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a10692-c70a-4217-8bae-e51506fe0bbf None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:24.281691 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a10692-c70a-4217-8bae-e51506fe0bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:24.306160 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-c9a10692-c70a-4217-8bae-e51506fe0bbf None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:24.307441 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-c9a10692-c70a-4217-8bae-e51506fe0bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:24.322384 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1018/2017] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:24.326867 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a10692-c70a-4217-8bae-e51506fe0bbf None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:24.336350 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a10692-c70a-4217-8bae-e51506fe0bbf None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:24.341212 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe6a04-2553-493a-87f9-579e231fbb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:24.341920 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe6a04-2553-493a-87f9-579e231fbb4e admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:24.342262 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe6a04-2553-493a-87f9-579e231fbb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:24.342558 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe6a04-2553-493a-87f9-579e231fbb4e admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:24.343443 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe6a04-2553-493a-87f9-579e231fbb4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:40:24.343628 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe6a04-2553-493a-87f9-579e231fbb4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:24.345374 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe6a04-2553-493a-87f9-579e231fbb4e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:24.349518 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7b1b0-d4a1-45fb-9422-64aff7a313b6 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:24.354173 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249764f-d187-4cc2-877e-14257bfc4f2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:24.354928 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249764f-d187-4cc2-877e-14257bfc4f2b service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:24.355434 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249764f-d187-4cc2-877e-14257bfc4f2b service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:24.361168 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249764f-d187-4cc2-877e-14257bfc4f2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:24.364686 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1019/2018] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:40:24.365235 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe6a04-2553-493a-87f9-579e231fbb4e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:24.375738 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe6a04-2553-493a-87f9-579e231fbb4e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:24.378688 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249764f-d187-4cc2-877e-14257bfc4f2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:24.380373 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7204d-2832-4f01-a613-18ea13f917de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:24.380810 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249764f-d187-4cc2-877e-14257bfc4f2b service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:24.380994 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7204d-2832-4f01-a613-18ea13f917de admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:24.381275 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7204d-2832-4f01-a613-18ea13f917de admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:24.381560 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7204d-2832-4f01-a613-18ea13f917de admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:24.382215 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7204d-2832-4f01-a613-18ea13f917de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:24.384677 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7204d-2832-4f01-a613-18ea13f917de admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:24.405400 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1000/2019] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:24 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:40:24.420397 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1020/2020] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:24 2021] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:24.424794 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249764f-d187-4cc2-877e-14257bfc4f2b service neutron] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:24.439263 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249764f-d187-4cc2-877e-14257bfc4f2b service neutron] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:24.500837 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7204d-2832-4f01-a613-18ea13f917de admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:24.509659 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-47a7204d-2832-4f01-a613-18ea13f917de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:24.534204 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f399f-7471-40ec-9d75-a6ffcfe950ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:24.535429 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f399f-7471-40ec-9d75-a6ffcfe950ee admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:24.535753 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f399f-7471-40ec-9d75-a6ffcfe950ee admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:24.536205 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f399f-7471-40ec-9d75-a6ffcfe950ee admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:24.536896 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f399f-7471-40ec-9d75-a6ffcfe950ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:24.539794 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f399f-7471-40ec-9d75-a6ffcfe950ee admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:24.573718 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1001/2021] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:24 2021] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:40:24.580045 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f399f-7471-40ec-9d75-a6ffcfe950ee admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:24.608357 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f399f-7471-40ec-9d75-a6ffcfe950ee admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:24.613855 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f07c2-75ee-428c-b874-b53207894a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:24.615321 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f07c2-75ee-428c-b874-b53207894a4a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:24.615685 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f07c2-75ee-428c-b874-b53207894a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:24.616166 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f07c2-75ee-428c-b874-b53207894a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:24.616894 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f07c2-75ee-428c-b874-b53207894a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:24.619120 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f07c2-75ee-428c-b874-b53207894a4a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:24.619447 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7204d-2832-4f01-a613-18ea13f917de admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:24.627735 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c4add-7cfb-44de-a94f-47740583c23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:24.629178 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c4add-7cfb-44de-a94f-47740583c23e admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:24.629763 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c4add-7cfb-44de-a94f-47740583c23e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:24.630389 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1002/2022] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:24 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:24.630505 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c4add-7cfb-44de-a94f-47740583c23e admin admin] PATH_INFO: `/v3/users/853eb710255b467e99c0cded6976f74f` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:24.632425 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c4add-7cfb-44de-a94f-47740583c23e admin admin] RBAC: Authorizing `identity:delete_user(user_id=853eb710255b467e99c0cded6976f74f)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:24.634269 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f07c2-75ee-428c-b874-b53207894a4a admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:24.636462 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c4add-7cfb-44de-a94f-47740583c23e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:24.646020 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f07c2-75ee-428c-b874-b53207894a4a admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:24.655391 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3b00f-ef4f-405d-ab0c-72b7e81410f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:24.656619 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3b00f-ef4f-405d-ab0c-72b7e81410f8 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:24.657041 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3b00f-ef4f-405d-ab0c-72b7e81410f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:24.657661 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3b00f-ef4f-405d-ab0c-72b7e81410f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:24.659288 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3b00f-ef4f-405d-ab0c-72b7e81410f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:24.661390 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3b00f-ef4f-405d-ab0c-72b7e81410f8 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:24.681873 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1003/2023] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:24 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:40:24.683607 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3b00f-ef4f-405d-ab0c-72b7e81410f8 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:24.699582 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3b00f-ef4f-405d-ab0c-72b7e81410f8 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:24.701255 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-407c4add-7cfb-44de-a94f-47740583c23e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '853eb710255b467e99c0cded6976f74f'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:24.702447 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-407c4add-7cfb-44de-a94f-47740583c23e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '853eb710255b467e99c0cded6976f74f'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:24.705445 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f3eb9-a1ae-4299-b608-6a855958a470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:24.706535 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f3eb9-a1ae-4299-b608-6a855958a470 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:24.706535 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f3eb9-a1ae-4299-b608-6a855958a470 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:24.706858 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f3eb9-a1ae-4299-b608-6a855958a470 admin admin] PATH_INFO: `/v3/projects/5c7e1fc334a04747b39f7303e3489936/users/5c91dac6f62340f6bf237de81cd71ffe/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:24.720353 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-407c4add-7cfb-44de-a94f-47740583c23e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '853eb710255b467e99c0cded6976f74f'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:24.733741 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f3eb9-a1ae-4299-b608-6a855958a470 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7e1fc334a04747b39f7303e3489936, user_id=5c91dac6f62340f6bf237de81cd71ffe, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:24.737305 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f3eb9-a1ae-4299-b608-6a855958a470 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:24.754429 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-407c4add-7cfb-44de-a94f-47740583c23e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '853eb710255b467e99c0cded6976f74f'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:24.764418 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1004/2024] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:24 2021] PUT /identity/v3/projects/5c7e1fc334a04747b39f7303e3489936/users/5c91dac6f62340f6bf237de81cd71ffe/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:24.766001 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d901546-0d8b-4cc2-b92f-7e3c49331cad None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:24.766357 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d901546-0d8b-4cc2-b92f-7e3c49331cad None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:24.766650 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d901546-0d8b-4cc2-b92f-7e3c49331cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:24.772436 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-407c4add-7cfb-44de-a94f-47740583c23e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '853eb710255b467e99c0cded6976f74f'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:24.783053 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1021/2025] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:24 2021] DELETE /identity/v3/users/853eb710255b467e99c0cded6976f74f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:24.787312 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c8c60-bffe-47b2-97f1-c2b963d2b98d None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:24.787722 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c8c60-bffe-47b2-97f1-c2b963d2b98d None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:24.788155 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c8c60-bffe-47b2-97f1-c2b963d2b98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:24.817859 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-9b9c8c60-bffe-47b2-97f1-c2b963d2b98d None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:24.819066 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-9b9c8c60-bffe-47b2-97f1-c2b963d2b98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:24.820529 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-1d901546-0d8b-4cc2-b92f-7e3c49331cad None None] MFA Rules not processed for user `5c91dac6f62340f6bf237de81cd71ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:24.821964 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-1d901546-0d8b-4cc2-b92f-7e3c49331cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:24.916824 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1022/2026] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:24.925243 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c8c60-bffe-47b2-97f1-c2b963d2b98d None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:24.926996 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-9b9c8c60-bffe-47b2-97f1-c2b963d2b98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:24.971253 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1005/2027] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:24 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:24.986341 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d901546-0d8b-4cc2-b92f-7e3c49331cad None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:24.989708 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-1d901546-0d8b-4cc2-b92f-7e3c49331cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:25.012795 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c8c60-bffe-47b2-97f1-c2b963d2b98d None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:25.016439 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d16dd-87f3-4640-b18b-e4ebd2347ed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:25.017292 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d16dd-87f3-4640-b18b-e4ebd2347ed7 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:25.017582 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d16dd-87f3-4640-b18b-e4ebd2347ed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:25.017862 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d16dd-87f3-4640-b18b-e4ebd2347ed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:25.029500 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d16dd-87f3-4640-b18b-e4ebd2347ed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:25.032097 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d16dd-87f3-4640-b18b-e4ebd2347ed7 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:25.049171 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1023/2028] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:24 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:40:25.050375 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d16dd-87f3-4640-b18b-e4ebd2347ed7 service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:25.052304 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-769d16dd-87f3-4640-b18b-e4ebd2347ed7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:25.066921 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d16dd-87f3-4640-b18b-e4ebd2347ed7 service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:25.073613 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0701d-126c-407e-b7f9-ff9f8ec79495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:25.074871 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0701d-126c-407e-b7f9-ff9f8ec79495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:25.075554 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0701d-126c-407e-b7f9-ff9f8ec79495 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:25.075990 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0701d-126c-407e-b7f9-ff9f8ec79495 admin admin] PATH_INFO: `/v3/projects/3fe050ec298b427788400b05361b8b13` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:25.077370 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0701d-126c-407e-b7f9-ff9f8ec79495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fe050ec298b427788400b05361b8b13)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:25.079875 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0701d-126c-407e-b7f9-ff9f8ec79495 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:25.117030 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d901546-0d8b-4cc2-b92f-7e3c49331cad None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:25.121523 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9a0ec-5b07-4fb5-b9d0-9068cd218ca0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:25.122400 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9a0ec-5b07-4fb5-b9d0-9068cd218ca0 service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:25.122733 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9a0ec-5b07-4fb5-b9d0-9068cd218ca0 service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:25.123128 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9a0ec-5b07-4fb5-b9d0-9068cd218ca0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:25.156122 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9a0ec-5b07-4fb5-b9d0-9068cd218ca0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:25.158017 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9a0ec-5b07-4fb5-b9d0-9068cd218ca0 service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:25.158598 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-01f0701d-126c-407e-b7f9-ff9f8ec79495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fe050ec298b427788400b05361b8b13', 'request_id': 'req-01f0701d-126c-407e-b7f9-ff9f8ec79495'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:25.173393 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1006/2029] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:24 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:25.174683 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-01f0701d-126c-407e-b7f9-ff9f8ec79495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fe050ec298b427788400b05361b8b13', 'request_id': 'req-01f0701d-126c-407e-b7f9-ff9f8ec79495'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:25.182904 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-01f0701d-126c-407e-b7f9-ff9f8ec79495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fe050ec298b427788400b05361b8b13', 'request_id': 'req-01f0701d-126c-407e-b7f9-ff9f8ec79495'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:25.201524 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-01f0701d-126c-407e-b7f9-ff9f8ec79495 admin admin] The token cache is being invalidate because project 3fe050ec298b427788400b05361b8b13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:25.201812 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-01f0701d-126c-407e-b7f9-ff9f8ec79495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:25.202504 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-01f0701d-126c-407e-b7f9-ff9f8ec79495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:25.204006 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1024/2030] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:25 2021] DELETE /identity/v3/projects/3fe050ec298b427788400b05361b8b13 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:25.208764 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9a0ec-5b07-4fb5-b9d0-9068cd218ca0 service cinder] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:25.228494 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9a0ec-5b07-4fb5-b9d0-9068cd218ca0 service cinder] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:25.359173 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a26dba-f700-46aa-a9d4-ee4932e5b72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:25.360064 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a26dba-f700-46aa-a9d4-ee4932e5b72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:25.361980 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a26dba-f700-46aa-a9d4-ee4932e5b72c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:25.362264 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a26dba-f700-46aa-a9d4-ee4932e5b72c admin admin] PATH_INFO: `/v3/users/f7e3f41f794c46eeac33bcc8fb997d63` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:25.365071 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a26dba-f700-46aa-a9d4-ee4932e5b72c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7e3f41f794c46eeac33bcc8fb997d63)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:25.370594 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a26dba-f700-46aa-a9d4-ee4932e5b72c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:25.484754 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-e0a26dba-f700-46aa-a9d4-ee4932e5b72c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7e3f41f794c46eeac33bcc8fb997d63'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:25.485568 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-e0a26dba-f700-46aa-a9d4-ee4932e5b72c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7e3f41f794c46eeac33bcc8fb997d63'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:25.502725 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-e0a26dba-f700-46aa-a9d4-ee4932e5b72c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7e3f41f794c46eeac33bcc8fb997d63'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:25.516133 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-e0a26dba-f700-46aa-a9d4-ee4932e5b72c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7e3f41f794c46eeac33bcc8fb997d63'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:25.526677 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-e0a26dba-f700-46aa-a9d4-ee4932e5b72c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7e3f41f794c46eeac33bcc8fb997d63'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:25.534423 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1007/2031] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:25 2021] DELETE /identity/v3/users/f7e3f41f794c46eeac33bcc8fb997d63 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:25.706556 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0701d-126c-407e-b7f9-ff9f8ec79495 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:25.708463 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-01f0701d-126c-407e-b7f9-ff9f8ec79495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:25.741250 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0701d-126c-407e-b7f9-ff9f8ec79495 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:25.910407 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d22c9-27f5-4cf9-83cd-f5ccb52d1a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:25.911591 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d22c9-27f5-4cf9-83cd-f5ccb52d1a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:25.912022 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d22c9-27f5-4cf9-83cd-f5ccb52d1a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:25.912405 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d22c9-27f5-4cf9-83cd-f5ccb52d1a8c admin admin] PATH_INFO: `/v3/projects/377833d3019d4527b76e0d97e737413b` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:25.914351 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d22c9-27f5-4cf9-83cd-f5ccb52d1a8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=377833d3019d4527b76e0d97e737413b)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:25.918276 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d22c9-27f5-4cf9-83cd-f5ccb52d1a8c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:26.001238 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-e97d22c9-27f5-4cf9-83cd-f5ccb52d1a8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '377833d3019d4527b76e0d97e737413b', 'request_id': 'req-e97d22c9-27f5-4cf9-83cd-f5ccb52d1a8c'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.008683 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-e97d22c9-27f5-4cf9-83cd-f5ccb52d1a8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '377833d3019d4527b76e0d97e737413b', 'request_id': 'req-e97d22c9-27f5-4cf9-83cd-f5ccb52d1a8c'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.017997 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-e97d22c9-27f5-4cf9-83cd-f5ccb52d1a8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '377833d3019d4527b76e0d97e737413b', 'request_id': 'req-e97d22c9-27f5-4cf9-83cd-f5ccb52d1a8c'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.041718 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-e97d22c9-27f5-4cf9-83cd-f5ccb52d1a8c admin admin] The token cache is being invalidate because project 377833d3019d4527b76e0d97e737413b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:26.043584 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-e97d22c9-27f5-4cf9-83cd-f5ccb52d1a8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.043584 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-e97d22c9-27f5-4cf9-83cd-f5ccb52d1a8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.058504 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1025/2032] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:25 2021] DELETE /identity/v3/projects/377833d3019d4527b76e0d97e737413b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:26.062644 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a26dba-f700-46aa-a9d4-ee4932e5b72c admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:26.064017 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e0a26dba-f700-46aa-a9d4-ee4932e5b72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:26.088488 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a26dba-f700-46aa-a9d4-ee4932e5b72c admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:26.168540 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418a46f-641d-4eb7-a41e-2e8491fa5d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:26.169510 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418a46f-641d-4eb7-a41e-2e8491fa5d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:26.169804 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418a46f-641d-4eb7-a41e-2e8491fa5d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:26.170086 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418a46f-641d-4eb7-a41e-2e8491fa5d71 admin admin] PATH_INFO: `/v3/users/238c70adba2348d792d6f3e8302a9c72` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:26.171259 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418a46f-641d-4eb7-a41e-2e8491fa5d71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=238c70adba2348d792d6f3e8302a9c72)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:26.173207 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418a46f-641d-4eb7-a41e-2e8491fa5d71 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:26.233535 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-4418a46f-641d-4eb7-a41e-2e8491fa5d71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '238c70adba2348d792d6f3e8302a9c72'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.235075 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-4418a46f-641d-4eb7-a41e-2e8491fa5d71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '238c70adba2348d792d6f3e8302a9c72'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.245817 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d22c9-27f5-4cf9-83cd-f5ccb52d1a8c admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:26.247428 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e97d22c9-27f5-4cf9-83cd-f5ccb52d1a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:26.254833 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-4418a46f-641d-4eb7-a41e-2e8491fa5d71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '238c70adba2348d792d6f3e8302a9c72'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.262608 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d22c9-27f5-4cf9-83cd-f5ccb52d1a8c admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:26.266467 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-4418a46f-641d-4eb7-a41e-2e8491fa5d71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '238c70adba2348d792d6f3e8302a9c72'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.270144 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10278c-cb0a-491c-b134-db595beeefe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:26.271481 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10278c-cb0a-491c-b134-db595beeefe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:26.272237 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10278c-cb0a-491c-b134-db595beeefe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:26.273293 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10278c-cb0a-491c-b134-db595beeefe4 admin admin] PATH_INFO: `/v3/projects/a6518352430f4d7cb3afe77cd0272da5` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:26.274923 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10278c-cb0a-491c-b134-db595beeefe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6518352430f4d7cb3afe77cd0272da5)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:26.277200 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-4418a46f-641d-4eb7-a41e-2e8491fa5d71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '238c70adba2348d792d6f3e8302a9c72'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.278501 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10278c-cb0a-491c-b134-db595beeefe4 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:26.284918 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1008/2033] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:26 2021] DELETE /identity/v3/users/238c70adba2348d792d6f3e8302a9c72 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:26.351190 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-fe10278c-cb0a-491c-b134-db595beeefe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6518352430f4d7cb3afe77cd0272da5', 'request_id': 'req-fe10278c-cb0a-491c-b134-db595beeefe4'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.364824 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-fe10278c-cb0a-491c-b134-db595beeefe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6518352430f4d7cb3afe77cd0272da5', 'request_id': 'req-fe10278c-cb0a-491c-b134-db595beeefe4'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.379452 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-fe10278c-cb0a-491c-b134-db595beeefe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6518352430f4d7cb3afe77cd0272da5', 'request_id': 'req-fe10278c-cb0a-491c-b134-db595beeefe4'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.399368 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-fe10278c-cb0a-491c-b134-db595beeefe4 admin admin] The token cache is being invalidate because project a6518352430f4d7cb3afe77cd0272da5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:26.399667 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-fe10278c-cb0a-491c-b134-db595beeefe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.400482 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-fe10278c-cb0a-491c-b134-db595beeefe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.402040 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1026/2034] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:26 2021] DELETE /identity/v3/projects/a6518352430f4d7cb3afe77cd0272da5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:26.407355 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418a46f-641d-4eb7-a41e-2e8491fa5d71 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:26.408953 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-4418a46f-641d-4eb7-a41e-2e8491fa5d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:26.493795 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418a46f-641d-4eb7-a41e-2e8491fa5d71 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:26.567306 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89944ca-337a-486f-b882-274e37554384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:26.568154 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89944ca-337a-486f-b882-274e37554384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:26.568452 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89944ca-337a-486f-b882-274e37554384 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:26.568745 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89944ca-337a-486f-b882-274e37554384 admin admin] PATH_INFO: `/v3/users/7ab2013f4cec4f0396e4e5039a844ae3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:26.569925 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89944ca-337a-486f-b882-274e37554384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ab2013f4cec4f0396e4e5039a844ae3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:26.572417 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89944ca-337a-486f-b882-274e37554384 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:26.628318 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-f89944ca-337a-486f-b882-274e37554384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ab2013f4cec4f0396e4e5039a844ae3'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.629126 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-f89944ca-337a-486f-b882-274e37554384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ab2013f4cec4f0396e4e5039a844ae3'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.643168 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-f89944ca-337a-486f-b882-274e37554384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ab2013f4cec4f0396e4e5039a844ae3'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.654088 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-f89944ca-337a-486f-b882-274e37554384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ab2013f4cec4f0396e4e5039a844ae3'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.663941 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-f89944ca-337a-486f-b882-274e37554384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ab2013f4cec4f0396e4e5039a844ae3'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.670251 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1009/2035] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:26 2021] DELETE /identity/v3/users/7ab2013f4cec4f0396e4e5039a844ae3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:26.753122 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10278c-cb0a-491c-b134-db595beeefe4 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:26.754932 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-fe10278c-cb0a-491c-b134-db595beeefe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:26.769375 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10278c-cb0a-491c-b134-db595beeefe4 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:26.861431 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10e68e-6f9c-472d-a017-b0ecb7674999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:26.862681 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10e68e-6f9c-472d-a017-b0ecb7674999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:26.863477 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10e68e-6f9c-472d-a017-b0ecb7674999 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:26.864057 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10e68e-6f9c-472d-a017-b0ecb7674999 admin admin] PATH_INFO: `/v3/projects/fb916a3dd1db47eb873a4ba281c16427` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:26.865733 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10e68e-6f9c-472d-a017-b0ecb7674999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb916a3dd1db47eb873a4ba281c16427)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:26.868578 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10e68e-6f9c-472d-a017-b0ecb7674999 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:26.932483 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-cf10e68e-6f9c-472d-a017-b0ecb7674999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb916a3dd1db47eb873a4ba281c16427', 'request_id': 'req-cf10e68e-6f9c-472d-a017-b0ecb7674999'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.937927 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-cf10e68e-6f9c-472d-a017-b0ecb7674999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb916a3dd1db47eb873a4ba281c16427', 'request_id': 'req-cf10e68e-6f9c-472d-a017-b0ecb7674999'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.945960 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-cf10e68e-6f9c-472d-a017-b0ecb7674999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb916a3dd1db47eb873a4ba281c16427', 'request_id': 'req-cf10e68e-6f9c-472d-a017-b0ecb7674999'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.978171 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-cf10e68e-6f9c-472d-a017-b0ecb7674999 admin admin] The token cache is being invalidate because project fb916a3dd1db47eb873a4ba281c16427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:26.978458 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-cf10e68e-6f9c-472d-a017-b0ecb7674999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.979110 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-cf10e68e-6f9c-472d-a017-b0ecb7674999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.981284 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1027/2036] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:26 2021] DELETE /identity/v3/projects/fb916a3dd1db47eb873a4ba281c16427 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:26.987536 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9680f7c-25ac-4e65-86a8-9cb4d72d17d8 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:26.988449 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9680f7c-25ac-4e65-86a8-9cb4d72d17d8 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:26.988743 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9680f7c-25ac-4e65-86a8-9cb4d72d17d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:27.016946 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-a9680f7c-25ac-4e65-86a8-9cb4d72d17d8 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:27.018199 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-a9680f7c-25ac-4e65-86a8-9cb4d72d17d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:27.112431 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1010/2037] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:27.121066 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb13edd-7d47-4976-8692-9eb10fc3b0eb None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:27.121370 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb13edd-7d47-4976-8692-9eb10fc3b0eb None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:27.121716 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb13edd-7d47-4976-8692-9eb10fc3b0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:27.176924 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9680f7c-25ac-4e65-86a8-9cb4d72d17d8 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:27.178329 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-a9680f7c-25ac-4e65-86a8-9cb4d72d17d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:27.182199 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-8bb13edd-7d47-4976-8692-9eb10fc3b0eb None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:27.183856 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-8bb13edd-7d47-4976-8692-9eb10fc3b0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:27.190721 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9680f7c-25ac-4e65-86a8-9cb4d72d17d8 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:27.196524 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8410268-e658-4c55-91fc-57a3f684c95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:27.197106 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1028/2038] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:27.197444 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8410268-e658-4c55-91fc-57a3f684c95d admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:27.197732 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8410268-e658-4c55-91fc-57a3f684c95d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:27.198172 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8410268-e658-4c55-91fc-57a3f684c95d admin admin] PATH_INFO: `/v3/projects/cf6a02ab4a49495aa3958509e2c639dd` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:27.199524 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8410268-e658-4c55-91fc-57a3f684c95d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf6a02ab4a49495aa3958509e2c639dd)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:27.200609 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb13edd-7d47-4976-8692-9eb10fc3b0eb None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:27.201853 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8410268-e658-4c55-91fc-57a3f684c95d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:27.212439 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb13edd-7d47-4976-8692-9eb10fc3b0eb None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:27.218341 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8c306-b47f-41dc-95ba-533edacd6476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:27.229456 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8c306-b47f-41dc-95ba-533edacd6476 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:27.229886 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8c306-b47f-41dc-95ba-533edacd6476 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:27.232049 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8c306-b47f-41dc-95ba-533edacd6476 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:27.232918 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8c306-b47f-41dc-95ba-533edacd6476 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:40:27.235705 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8c306-b47f-41dc-95ba-533edacd6476 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:27.239410 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8c306-b47f-41dc-95ba-533edacd6476 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:27.267067 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1029/2039] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:40:27.271796 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8c306-b47f-41dc-95ba-533edacd6476 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:27.279611 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-c8410268-e658-4c55-91fc-57a3f684c95d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf6a02ab4a49495aa3958509e2c639dd', 'request_id': 'req-c8410268-e658-4c55-91fc-57a3f684c95d'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:27.282949 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8c306-b47f-41dc-95ba-533edacd6476 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:27.309152 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-c8410268-e658-4c55-91fc-57a3f684c95d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf6a02ab4a49495aa3958509e2c639dd', 'request_id': 'req-c8410268-e658-4c55-91fc-57a3f684c95d'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:27.326137 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-c8410268-e658-4c55-91fc-57a3f684c95d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf6a02ab4a49495aa3958509e2c639dd', 'request_id': 'req-c8410268-e658-4c55-91fc-57a3f684c95d'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:27.353894 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-c8410268-e658-4c55-91fc-57a3f684c95d admin admin] The token cache is being invalidate because project cf6a02ab4a49495aa3958509e2c639dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:27.354233 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-c8410268-e658-4c55-91fc-57a3f684c95d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:27.358522 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-c8410268-e658-4c55-91fc-57a3f684c95d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:27.360088 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1011/2040] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:27 2021] DELETE /identity/v3/projects/cf6a02ab4a49495aa3958509e2c639dd => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:27.368881 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c70448-cd67-4bc9-99b6-25f5eacd369a None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:27.369185 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c70448-cd67-4bc9-99b6-25f5eacd369a None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:27.369460 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c70448-cd67-4bc9-99b6-25f5eacd369a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:27.379259 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb268e8-41b3-45bd-a94f-bc1f4b2ef30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:27.380379 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb268e8-41b3-45bd-a94f-bc1f4b2ef30f admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:27.381723 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb268e8-41b3-45bd-a94f-bc1f4b2ef30f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:27.396045 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb268e8-41b3-45bd-a94f-bc1f4b2ef30f admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:27.396839 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb268e8-41b3-45bd-a94f-bc1f4b2ef30f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:27.403870 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb268e8-41b3-45bd-a94f-bc1f4b2ef30f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:27.416515 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-d7c70448-cd67-4bc9-99b6-25f5eacd369a None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:27.418004 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-d7c70448-cd67-4bc9-99b6-25f5eacd369a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:27.436344 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1012/2041] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:27.446452 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141d13c-2209-4651-9bfa-226a23dea3b2 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:27.446657 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141d13c-2209-4651-9bfa-226a23dea3b2 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:27.446896 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141d13c-2209-4651-9bfa-226a23dea3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:27.448286 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1030/2042] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:27 2021] POST /identity/v3/projects => generated 373 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:27.452418 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb268e8-41b3-45bd-a94f-bc1f4b2ef30f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:27.455072 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-9bb268e8-41b3-45bd-a94f-bc1f4b2ef30f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:27.476353 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-0141d13c-2209-4651-9bfa-226a23dea3b2 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:27.478545 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-0141d13c-2209-4651-9bfa-226a23dea3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:27.562133 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb268e8-41b3-45bd-a94f-bc1f4b2ef30f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:27.567479 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd6b35-9fa6-45ac-b0ee-485dd1269694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:27.568093 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd6b35-9fa6-45ac-b0ee-485dd1269694 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:27.568384 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd6b35-9fa6-45ac-b0ee-485dd1269694 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:27.568816 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd6b35-9fa6-45ac-b0ee-485dd1269694 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:27.569482 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd6b35-9fa6-45ac-b0ee-485dd1269694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:27.572075 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd6b35-9fa6-45ac-b0ee-485dd1269694 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:27.574679 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1013/2043] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:27.578824 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141d13c-2209-4651-9bfa-226a23dea3b2 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:27.588472 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141d13c-2209-4651-9bfa-226a23dea3b2 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:27.593320 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ab50c-2790-4d05-b6f0-23147f8f988f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:27.593971 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ab50c-2790-4d05-b6f0-23147f8f988f admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:27.594263 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ab50c-2790-4d05-b6f0-23147f8f988f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:27.594550 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ab50c-2790-4d05-b6f0-23147f8f988f admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:27.595258 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ab50c-2790-4d05-b6f0-23147f8f988f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:40:27.595655 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ab50c-2790-4d05-b6f0-23147f8f988f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:27.596322 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1031/2044] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:27 2021] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:40:27.601025 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ab50c-2790-4d05-b6f0-23147f8f988f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:27.601685 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd6b35-9fa6-45ac-b0ee-485dd1269694 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:27.617907 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd6b35-9fa6-45ac-b0ee-485dd1269694 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:27.624982 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1014/2045] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:40:27.624982 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ab50c-2790-4d05-b6f0-23147f8f988f admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:27.628948 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6632d2-bc66-48f7-b047-2dcf589314fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:27.629831 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6632d2-bc66-48f7-b047-2dcf589314fa admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:27.630475 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6632d2-bc66-48f7-b047-2dcf589314fa admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:27.630953 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6632d2-bc66-48f7-b047-2dcf589314fa admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:27.631954 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6632d2-bc66-48f7-b047-2dcf589314fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:27.634838 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6632d2-bc66-48f7-b047-2dcf589314fa admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:27.636064 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ab50c-2790-4d05-b6f0-23147f8f988f admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:27.640747 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81976019-4180-48f4-b591-1e9191bef29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:27.641382 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81976019-4180-48f4-b591-1e9191bef29f admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:27.641671 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81976019-4180-48f4-b591-1e9191bef29f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:27.642083 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81976019-4180-48f4-b591-1e9191bef29f admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:27.642732 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81976019-4180-48f4-b591-1e9191bef29f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:27.644742 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81976019-4180-48f4-b591-1e9191bef29f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:27.653004 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1032/2046] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:27 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:27.654658 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6632d2-bc66-48f7-b047-2dcf589314fa admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:27.665391 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6632d2-bc66-48f7-b047-2dcf589314fa admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:27.670661 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fa717-0d7a-4d94-a77c-4669ad5eaead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:27.671325 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fa717-0d7a-4d94-a77c-4669ad5eaead admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:27.671655 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fa717-0d7a-4d94-a77c-4669ad5eaead admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:27.671975 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fa717-0d7a-4d94-a77c-4669ad5eaead admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:27.672683 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fa717-0d7a-4d94-a77c-4669ad5eaead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:27.674296 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fa717-0d7a-4d94-a77c-4669ad5eaead admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:27.680070 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1015/2047] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:27 2021] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:27.681004 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81976019-4180-48f4-b591-1e9191bef29f admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:27.682622 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-81976019-4180-48f4-b591-1e9191bef29f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:27.693038 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1033/2048] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:27 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:27.693038 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fa717-0d7a-4d94-a77c-4669ad5eaead admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:27.701250 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fa717-0d7a-4d94-a77c-4669ad5eaead admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:27.776870 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81976019-4180-48f4-b591-1e9191bef29f admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:27.777066 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fdfd9-5a1f-43ef-9cff-8395f389d85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:27.777662 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fdfd9-5a1f-43ef-9cff-8395f389d85e admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:27.777970 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fdfd9-5a1f-43ef-9cff-8395f389d85e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:27.778240 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fdfd9-5a1f-43ef-9cff-8395f389d85e admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:27.778878 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fdfd9-5a1f-43ef-9cff-8395f389d85e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:27.781021 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fdfd9-5a1f-43ef-9cff-8395f389d85e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:27.782244 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d585c3-1213-4e55-8f83-348fe030546d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:27.785882 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d585c3-1213-4e55-8f83-348fe030546d admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:27.785882 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d585c3-1213-4e55-8f83-348fe030546d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:27.785882 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d585c3-1213-4e55-8f83-348fe030546d admin admin] PATH_INFO: `/v3/users/5bb24a2974224dadbbd4a097b912cbae` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:27.789272 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d585c3-1213-4e55-8f83-348fe030546d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bb24a2974224dadbbd4a097b912cbae)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:27.791358 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d585c3-1213-4e55-8f83-348fe030546d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:27.818437 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1034/2049] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:27 2021] POST /identity/v3/users => generated 285 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:27.818437 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fdfd9-5a1f-43ef-9cff-8395f389d85e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:27.842333 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fdfd9-5a1f-43ef-9cff-8395f389d85e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:27.846456 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9bd74-3ccd-47ac-b9d6-25a77fea728f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:27.848095 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9bd74-3ccd-47ac-b9d6-25a77fea728f admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:27.848391 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9bd74-3ccd-47ac-b9d6-25a77fea728f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:27.848679 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9bd74-3ccd-47ac-b9d6-25a77fea728f admin admin] PATH_INFO: `/v3/projects/eefffd14d0794d3cb998cd2569e72116/users/4b3d5f2f117341d48d1a919f404f7522/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:27.868737 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b8d585c3-1213-4e55-8f83-348fe030546d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bb24a2974224dadbbd4a097b912cbae'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:27.869529 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b8d585c3-1213-4e55-8f83-348fe030546d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bb24a2974224dadbbd4a097b912cbae'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:27.873655 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9bd74-3ccd-47ac-b9d6-25a77fea728f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eefffd14d0794d3cb998cd2569e72116, user_id=4b3d5f2f117341d48d1a919f404f7522, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:27.877395 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9bd74-3ccd-47ac-b9d6-25a77fea728f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:27.885138 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b8d585c3-1213-4e55-8f83-348fe030546d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bb24a2974224dadbbd4a097b912cbae'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:27.895128 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b8d585c3-1213-4e55-8f83-348fe030546d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bb24a2974224dadbbd4a097b912cbae'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:27.896053 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1035/2050] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:27 2021] PUT /identity/v3/projects/eefffd14d0794d3cb998cd2569e72116/users/4b3d5f2f117341d48d1a919f404f7522/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:27.897216 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9bd74-3ccd-47ac-b9d6-25a77fea728f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:27.904172 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b8d585c3-1213-4e55-8f83-348fe030546d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bb24a2974224dadbbd4a097b912cbae'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:27.912574 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1016/2051] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:27 2021] DELETE /identity/v3/users/5bb24a2974224dadbbd4a097b912cbae => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:27.913748 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecdfe2-3496-419e-80ff-e707d319ee57 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:27.914097 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecdfe2-3496-419e-80ff-e707d319ee57 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:27.914341 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecdfe2-3496-419e-80ff-e707d319ee57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:27.969314 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-e8ecdfe2-3496-419e-80ff-e707d319ee57 None None] MFA Rules not processed for user `4b3d5f2f117341d48d1a919f404f7522`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:27.969314 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e8ecdfe2-3496-419e-80ff-e707d319ee57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:27.986296 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9bd74-3ccd-47ac-b9d6-25a77fea728f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:28.067043 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1017/2052] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:27 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:28.068409 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8daabc6-746a-4813-bb75-ee73d5044613 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:28.068712 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8daabc6-746a-4813-bb75-ee73d5044613 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:28.069061 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8daabc6-746a-4813-bb75-ee73d5044613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:28.084664 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0c42c-b438-41fe-bd04-c2536983b9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:28.085366 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0c42c-b438-41fe-bd04-c2536983b9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:28.085696 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0c42c-b438-41fe-bd04-c2536983b9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:28.085985 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0c42c-b438-41fe-bd04-c2536983b9e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:28.086755 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0c42c-b438-41fe-bd04-c2536983b9e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:28.088685 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0c42c-b438-41fe-bd04-c2536983b9e6 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:28.102620 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1036/2053] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:27 2021] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:28.103630 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0c42c-b438-41fe-bd04-c2536983b9e6 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:28.105490 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-88a0c42c-b438-41fe-bd04-c2536983b9e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:28.105845 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-f8daabc6-746a-4813-bb75-ee73d5044613 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:28.107368 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-f8daabc6-746a-4813-bb75-ee73d5044613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:28.118956 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0c42c-b438-41fe-bd04-c2536983b9e6 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:28.120808 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1018/2054] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:28.121954 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8daabc6-746a-4813-bb75-ee73d5044613 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:28.124288 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-f8daabc6-746a-4813-bb75-ee73d5044613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:28.124652 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673d813-3b34-4c17-8c80-47f017cc6b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:28.125378 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673d813-3b34-4c17-8c80-47f017cc6b6f admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:28.125738 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673d813-3b34-4c17-8c80-47f017cc6b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:28.126094 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673d813-3b34-4c17-8c80-47f017cc6b6f admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:28.126824 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673d813-3b34-4c17-8c80-47f017cc6b6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:28.128823 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673d813-3b34-4c17-8c80-47f017cc6b6f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:28.138114 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8daabc6-746a-4813-bb75-ee73d5044613 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:28.145467 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdd771-7f88-4bb3-8f25-a44770061d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:28.150491 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdd771-7f88-4bb3-8f25-a44770061d7d admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:28.151929 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdd771-7f88-4bb3-8f25-a44770061d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:28.152904 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdd771-7f88-4bb3-8f25-a44770061d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:28.154409 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcdd771-7f88-4bb3-8f25-a44770061d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:28.158848 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcdd771-7f88-4bb3-8f25-a44770061d7d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:28.167761 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1037/2055] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:28 2021] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:28.169019 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673d813-3b34-4c17-8c80-47f017cc6b6f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:28.170835 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e673d813-3b34-4c17-8c80-47f017cc6b6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:28.173971 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1019/2056] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:28 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:28.174965 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdd771-7f88-4bb3-8f25-a44770061d7d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:28.187733 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdd771-7f88-4bb3-8f25-a44770061d7d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:28.289128 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673d813-3b34-4c17-8c80-47f017cc6b6f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:28.293306 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e91062-f000-4ed7-b9e4-4a6811482de7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:28.293897 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e91062-f000-4ed7-b9e4-4a6811482de7 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:28.294189 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e91062-f000-4ed7-b9e4-4a6811482de7 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:28.294475 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e91062-f000-4ed7-b9e4-4a6811482de7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:28.297045 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d82d28-39c4-4314-b0ae-a814d275a679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:28.298093 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d82d28-39c4-4314-b0ae-a814d275a679 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:28.298594 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d82d28-39c4-4314-b0ae-a814d275a679 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:28.299656 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d82d28-39c4-4314-b0ae-a814d275a679 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:28.302915 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d82d28-39c4-4314-b0ae-a814d275a679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:28.305680 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d82d28-39c4-4314-b0ae-a814d275a679 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:28.305802 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e91062-f000-4ed7-b9e4-4a6811482de7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:28.307459 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e91062-f000-4ed7-b9e4-4a6811482de7 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:28.323521 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1038/2057] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:28.324572 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e91062-f000-4ed7-b9e4-4a6811482de7 service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:28.338939 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e91062-f000-4ed7-b9e4-4a6811482de7 service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:28.340414 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1020/2058] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:28 2021] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:28.341378 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d82d28-39c4-4314-b0ae-a814d275a679 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:28.345520 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb528c2c-4c37-41ef-b595-9622f6333125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:28.347839 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb528c2c-4c37-41ef-b595-9622f6333125 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:28.348267 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb528c2c-4c37-41ef-b595-9622f6333125 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:28.348756 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb528c2c-4c37-41ef-b595-9622f6333125 admin admin] PATH_INFO: `/v3/projects/098ab7b6de4a44c7b70ee73f47243884/users/b23dc29a5d6c4a82b8f78c0ee13d5203/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:28.364134 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d82d28-39c4-4314-b0ae-a814d275a679 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:28.376115 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb528c2c-4c37-41ef-b595-9622f6333125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098ab7b6de4a44c7b70ee73f47243884, user_id=b23dc29a5d6c4a82b8f78c0ee13d5203, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:28.379225 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb528c2c-4c37-41ef-b595-9622f6333125 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:28.380362 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43485f-cec7-4c56-8912-13beeed605fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:28.381148 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43485f-cec7-4c56-8912-13beeed605fa admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:28.381499 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43485f-cec7-4c56-8912-13beeed605fa admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:28.382187 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43485f-cec7-4c56-8912-13beeed605fa admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:28.383113 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43485f-cec7-4c56-8912-13beeed605fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:28.385102 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43485f-cec7-4c56-8912-13beeed605fa admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:28.407732 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1039/2059] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:28 2021] PUT /identity/v3/projects/098ab7b6de4a44c7b70ee73f47243884/users/b23dc29a5d6c4a82b8f78c0ee13d5203/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:28.410036 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e2035-2c53-49cd-8810-0af4dafa994b None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:28.410421 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e2035-2c53-49cd-8810-0af4dafa994b None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:28.410718 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e2035-2c53-49cd-8810-0af4dafa994b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:28.421143 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1021/2060] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:28 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:28.422068 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43485f-cec7-4c56-8912-13beeed605fa admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:28.438534 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43485f-cec7-4c56-8912-13beeed605fa admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:28.470630 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-a73e2035-2c53-49cd-8810-0af4dafa994b None None] MFA Rules not processed for user `b23dc29a5d6c4a82b8f78c0ee13d5203`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:28.472039 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-a73e2035-2c53-49cd-8810-0af4dafa994b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:28.586375 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1040/2061] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:28 2021] POST /identity/v3/auth/tokens => generated 3676 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:28.603003 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e2035-2c53-49cd-8810-0af4dafa994b None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:28.605223 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-a73e2035-2c53-49cd-8810-0af4dafa994b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:28.634348 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb7e67-ea7e-4eda-857c-118423994117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:28.635608 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb7e67-ea7e-4eda-857c-118423994117 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:28.636026 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb7e67-ea7e-4eda-857c-118423994117 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:28.636986 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb7e67-ea7e-4eda-857c-118423994117 admin admin] PATH_INFO: `/v3/projects/201ce4c2498b4ae6aefcc45874909ffa/users/96f219f9147941459170e4b1df78bcd9/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:28.662180 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb7e67-ea7e-4eda-857c-118423994117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=201ce4c2498b4ae6aefcc45874909ffa, user_id=96f219f9147941459170e4b1df78bcd9, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:28.666023 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb7e67-ea7e-4eda-857c-118423994117 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:28.682202 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1022/2062] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:28 2021] PUT /identity/v3/projects/201ce4c2498b4ae6aefcc45874909ffa/users/96f219f9147941459170e4b1df78bcd9/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:28.685069 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e2035-2c53-49cd-8810-0af4dafa994b None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:28.686395 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb7e67-ea7e-4eda-857c-118423994117 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:28.772936 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f925c-dbe0-490b-9501-4cea36cf7569 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ccebf28ac494f608c33437fc34139be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:28.774652 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f925c-dbe0-490b-9501-4cea36cf7569 service glance] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:28.775088 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f925c-dbe0-490b-9501-4cea36cf7569 service glance] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:28.776146 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f925c-dbe0-490b-9501-4cea36cf7569 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:28.787495 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb7e67-ea7e-4eda-857c-118423994117 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:28.794197 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92990d5d-4e94-4625-886f-00608d3843c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:28.794973 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92990d5d-4e94-4625-886f-00608d3843c2 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:28.795439 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92990d5d-4e94-4625-886f-00608d3843c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:28.795951 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92990d5d-4e94-4625-886f-00608d3843c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:28.796980 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92990d5d-4e94-4625-886f-00608d3843c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:28.799020 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92990d5d-4e94-4625-886f-00608d3843c2 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:28.819349 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1023/2063] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:28 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:28.822005 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92990d5d-4e94-4625-886f-00608d3843c2 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:28.835353 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92990d5d-4e94-4625-886f-00608d3843c2 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:28.842139 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ea924-78f3-4901-9796-552023f03e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:28.847814 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ea924-78f3-4901-9796-552023f03e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:28.848256 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ea924-78f3-4901-9796-552023f03e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:28.850062 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ea924-78f3-4901-9796-552023f03e39 admin admin] PATH_INFO: `/v3/projects/201ce4c2498b4ae6aefcc45874909ffa/users/96f219f9147941459170e4b1df78bcd9/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:28.855312 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ea924-78f3-4901-9796-552023f03e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=201ce4c2498b4ae6aefcc45874909ffa, user_id=96f219f9147941459170e4b1df78bcd9, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:28.864479 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ea924-78f3-4901-9796-552023f03e39 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:28.888052 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1024/2064] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:28 2021] PUT /identity/v3/projects/201ce4c2498b4ae6aefcc45874909ffa/users/96f219f9147941459170e4b1df78bcd9/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:28.899304 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fb461-f557-44fe-a23a-5d1cf2a51103 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:28.899748 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fb461-f557-44fe-a23a-5d1cf2a51103 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:28.900152 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fb461-f557-44fe-a23a-5d1cf2a51103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:28.916741 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f925c-dbe0-490b-9501-4cea36cf7569 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:28.918418 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f925c-dbe0-490b-9501-4cea36cf7569 service glance] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:28.937690 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1041/2065] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:28 2021] GET /identity/v3/auth/tokens => generated 3676 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:40:29.008278 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-de6fb461-f557-44fe-a23a-5d1cf2a51103 None None] MFA Rules not processed for user `96f219f9147941459170e4b1df78bcd9`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:29.009742 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-de6fb461-f557-44fe-a23a-5d1cf2a51103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:29.148837 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1025/2066] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:28 2021] POST /identity/v3/auth/tokens => generated 3749 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:29.155572 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f925c-dbe0-490b-9501-4cea36cf7569 service glance] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:29.157478 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-3a2f925c-dbe0-490b-9501-4cea36cf7569 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:29.221460 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fb461-f557-44fe-a23a-5d1cf2a51103 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:29.223846 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-de6fb461-f557-44fe-a23a-5d1cf2a51103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:29.243352 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f925c-dbe0-490b-9501-4cea36cf7569 service glance] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:29.304590 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fc027-e7cd-478b-8ae4-6e35c95ad2b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:29.305246 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fc027-e7cd-478b-8ae4-6e35c95ad2b3 service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:29.305449 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fc027-e7cd-478b-8ae4-6e35c95ad2b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:29.305722 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fc027-e7cd-478b-8ae4-6e35c95ad2b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:29.312242 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fb461-f557-44fe-a23a-5d1cf2a51103 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:29.323071 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7d77f-336a-46f8-bc6b-e62e2f1890b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:29.323891 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7d77f-336a-46f8-bc6b-e62e2f1890b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:29.324187 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7d77f-336a-46f8-bc6b-e62e2f1890b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:29.324471 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7d77f-336a-46f8-bc6b-e62e2f1890b1 admin admin] PATH_INFO: `/v3/projects/96762b8bbb2341fa909c8128d91597e1` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:29.325834 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7d77f-336a-46f8-bc6b-e62e2f1890b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96762b8bbb2341fa909c8128d91597e1)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:29.327826 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7d77f-336a-46f8-bc6b-e62e2f1890b1 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:29.393046 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0fc027-e7cd-478b-8ae4-6e35c95ad2b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:29.393046 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0fc027-e7cd-478b-8ae4-6e35c95ad2b3 service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:29.402929 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1042/2067] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:29 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:29.405379 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-c2b7d77f-336a-46f8-bc6b-e62e2f1890b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96762b8bbb2341fa909c8128d91597e1', 'request_id': 'req-c2b7d77f-336a-46f8-bc6b-e62e2f1890b1'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:29.428450 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-c2b7d77f-336a-46f8-bc6b-e62e2f1890b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96762b8bbb2341fa909c8128d91597e1', 'request_id': 'req-c2b7d77f-336a-46f8-bc6b-e62e2f1890b1'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:29.439011 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-c2b7d77f-336a-46f8-bc6b-e62e2f1890b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96762b8bbb2341fa909c8128d91597e1', 'request_id': 'req-c2b7d77f-336a-46f8-bc6b-e62e2f1890b1'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:29.465121 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-c2b7d77f-336a-46f8-bc6b-e62e2f1890b1 admin admin] The token cache is being invalidate because project 96762b8bbb2341fa909c8128d91597e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:29.466142 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-c2b7d77f-336a-46f8-bc6b-e62e2f1890b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:29.467746 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-c2b7d77f-336a-46f8-bc6b-e62e2f1890b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:29.471159 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1026/2068] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:29 2021] DELETE /identity/v3/projects/96762b8bbb2341fa909c8128d91597e1 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:29.476846 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fc027-e7cd-478b-8ae4-6e35c95ad2b3 service cinder] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:29.508476 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fc027-e7cd-478b-8ae4-6e35c95ad2b3 service cinder] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:29.589462 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7d77f-336a-46f8-bc6b-e62e2f1890b1 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:29.591189 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-c2b7d77f-336a-46f8-bc6b-e62e2f1890b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:29.649247 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a4e8e-0cba-49d2-9221-96824fa44a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:29.650083 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a4e8e-0cba-49d2-9221-96824fa44a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:29.650385 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a4e8e-0cba-49d2-9221-96824fa44a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:29.650669 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a4e8e-0cba-49d2-9221-96824fa44a26 admin admin] PATH_INFO: `/v3/users/5c067a6ebdbc4e419e9aff34aa1c7872` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:29.651843 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a4e8e-0cba-49d2-9221-96824fa44a26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c067a6ebdbc4e419e9aff34aa1c7872)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:29.653799 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a4e8e-0cba-49d2-9221-96824fa44a26 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:29.697112 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7d77f-336a-46f8-bc6b-e62e2f1890b1 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:29.706398 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626e622-412a-4556-8e36-c5e5e5a6a3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:29.707839 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626e622-412a-4556-8e36-c5e5e5a6a3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:29.708315 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626e622-412a-4556-8e36-c5e5e5a6a3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:29.708802 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626e622-412a-4556-8e36-c5e5e5a6a3ee admin admin] PATH_INFO: `/v3/users/c8d3e42caae84fedb52ba42d8763ee91` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:29.711439 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626e622-412a-4556-8e36-c5e5e5a6a3ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8d3e42caae84fedb52ba42d8763ee91)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:29.714942 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626e622-412a-4556-8e36-c5e5e5a6a3ee admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:29.741056 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-0a7a4e8e-0cba-49d2-9221-96824fa44a26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c067a6ebdbc4e419e9aff34aa1c7872'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:29.742814 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-0a7a4e8e-0cba-49d2-9221-96824fa44a26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c067a6ebdbc4e419e9aff34aa1c7872'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:29.771283 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-0a7a4e8e-0cba-49d2-9221-96824fa44a26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c067a6ebdbc4e419e9aff34aa1c7872'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:29.791289 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-0a7a4e8e-0cba-49d2-9221-96824fa44a26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c067a6ebdbc4e419e9aff34aa1c7872'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:29.806734 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-0a7a4e8e-0cba-49d2-9221-96824fa44a26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c067a6ebdbc4e419e9aff34aa1c7872'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:29.808813 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-6626e622-412a-4556-8e36-c5e5e5a6a3ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8d3e42caae84fedb52ba42d8763ee91'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:29.809766 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-6626e622-412a-4556-8e36-c5e5e5a6a3ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8d3e42caae84fedb52ba42d8763ee91'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:29.817166 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1043/2069] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:29 2021] DELETE /identity/v3/users/5c067a6ebdbc4e419e9aff34aa1c7872 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:29.842555 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-6626e622-412a-4556-8e36-c5e5e5a6a3ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8d3e42caae84fedb52ba42d8763ee91'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:29.848143 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a4e8e-0cba-49d2-9221-96824fa44a26 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:29.850548 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-0a7a4e8e-0cba-49d2-9221-96824fa44a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:29.860170 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-6626e622-412a-4556-8e36-c5e5e5a6a3ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8d3e42caae84fedb52ba42d8763ee91'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:29.882219 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-6626e622-412a-4556-8e36-c5e5e5a6a3ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8d3e42caae84fedb52ba42d8763ee91'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:29.900410 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1027/2070] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:29 2021] DELETE /identity/v3/users/c8d3e42caae84fedb52ba42d8763ee91 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:29.928989 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626e622-412a-4556-8e36-c5e5e5a6a3ee admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:29.930956 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-6626e622-412a-4556-8e36-c5e5e5a6a3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:30.089656 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a4e8e-0cba-49d2-9221-96824fa44a26 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:30.143384 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626e622-412a-4556-8e36-c5e5e5a6a3ee admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:30.156699 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444ed3f-e88d-4157-bdb1-7c774ea93916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:30.156699 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444ed3f-e88d-4157-bdb1-7c774ea93916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:30.156699 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444ed3f-e88d-4157-bdb1-7c774ea93916 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:30.156699 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444ed3f-e88d-4157-bdb1-7c774ea93916 admin admin] PATH_INFO: `/v3/users/5c91dac6f62340f6bf237de81cd71ffe` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:30.159428 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444ed3f-e88d-4157-bdb1-7c774ea93916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c91dac6f62340f6bf237de81cd71ffe)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:30.166889 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444ed3f-e88d-4157-bdb1-7c774ea93916 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:30.229960 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854a60c-7995-4cb5-b70d-a82ff6d54386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:30.230997 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854a60c-7995-4cb5-b70d-a82ff6d54386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:30.231327 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854a60c-7995-4cb5-b70d-a82ff6d54386 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:30.231620 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854a60c-7995-4cb5-b70d-a82ff6d54386 admin admin] PATH_INFO: `/v3/users/7e1c99567ef640ccbaa0eb8dfbd50132` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:30.233348 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854a60c-7995-4cb5-b70d-a82ff6d54386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e1c99567ef640ccbaa0eb8dfbd50132)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:30.236018 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854a60c-7995-4cb5-b70d-a82ff6d54386 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:30.271628 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-1444ed3f-e88d-4157-bdb1-7c774ea93916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c91dac6f62340f6bf237de81cd71ffe'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:30.273952 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-1444ed3f-e88d-4157-bdb1-7c774ea93916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c91dac6f62340f6bf237de81cd71ffe'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:30.290295 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-1444ed3f-e88d-4157-bdb1-7c774ea93916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c91dac6f62340f6bf237de81cd71ffe'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:30.302431 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-1444ed3f-e88d-4157-bdb1-7c774ea93916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c91dac6f62340f6bf237de81cd71ffe'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:30.315831 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-9854a60c-7995-4cb5-b70d-a82ff6d54386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e1c99567ef640ccbaa0eb8dfbd50132'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:30.317286 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-9854a60c-7995-4cb5-b70d-a82ff6d54386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e1c99567ef640ccbaa0eb8dfbd50132'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:30.319485 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-1444ed3f-e88d-4157-bdb1-7c774ea93916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c91dac6f62340f6bf237de81cd71ffe'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:30.334394 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1028/2071] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:29 2021] DELETE /identity/v3/users/5c91dac6f62340f6bf237de81cd71ffe => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:30.341470 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdd9f5-da67-4467-ad7f-5278b264c084 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:30.342096 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdd9f5-da67-4467-ad7f-5278b264c084 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:30.343111 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdd9f5-da67-4467-ad7f-5278b264c084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:30.347346 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-9854a60c-7995-4cb5-b70d-a82ff6d54386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e1c99567ef640ccbaa0eb8dfbd50132'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:30.360029 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-9854a60c-7995-4cb5-b70d-a82ff6d54386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e1c99567ef640ccbaa0eb8dfbd50132'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:30.370513 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-9854a60c-7995-4cb5-b70d-a82ff6d54386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e1c99567ef640ccbaa0eb8dfbd50132'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:30.372564 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-e6cdd9f5-da67-4467-ad7f-5278b264c084 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:30.374958 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e6cdd9f5-da67-4467-ad7f-5278b264c084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:30.381142 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1044/2072] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:29 2021] DELETE /identity/v3/users/7e1c99567ef640ccbaa0eb8dfbd50132 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:30.386884 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a983a2-a0a4-4e87-bca2-bdc5fb99cd12 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:30.387403 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a983a2-a0a4-4e87-bca2-bdc5fb99cd12 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:30.387770 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a983a2-a0a4-4e87-bca2-bdc5fb99cd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:30.418407 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-c4a983a2-a0a4-4e87-bca2-bdc5fb99cd12 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:30.420449 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-c4a983a2-a0a4-4e87-bca2-bdc5fb99cd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:30.471450 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1029/2073] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:30.484594 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdd9f5-da67-4467-ad7f-5278b264c084 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:30.486010 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e6cdd9f5-da67-4467-ad7f-5278b264c084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:30.548838 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1045/2074] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:30.548838 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a983a2-a0a4-4e87-bca2-bdc5fb99cd12 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:30.565166 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-c4a983a2-a0a4-4e87-bca2-bdc5fb99cd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:30.580554 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a983a2-a0a4-4e87-bca2-bdc5fb99cd12 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:30.587069 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fc010-83fb-4855-aa14-d3821af4aa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:30.588109 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fc010-83fb-4855-aa14-d3821af4aa5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:30.588560 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fc010-83fb-4855-aa14-d3821af4aa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:30.589158 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fc010-83fb-4855-aa14-d3821af4aa5b admin admin] PATH_INFO: `/v3/projects/badee23df7a9473ab35c9a573575c3ee` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:30.590431 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fc010-83fb-4855-aa14-d3821af4aa5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=badee23df7a9473ab35c9a573575c3ee)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:30.592534 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fc010-83fb-4855-aa14-d3821af4aa5b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:30.605055 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdd9f5-da67-4467-ad7f-5278b264c084 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:30.660604 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-d39fc010-83fb-4855-aa14-d3821af4aa5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'badee23df7a9473ab35c9a573575c3ee', 'request_id': 'req-d39fc010-83fb-4855-aa14-d3821af4aa5b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:30.668180 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-d39fc010-83fb-4855-aa14-d3821af4aa5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'badee23df7a9473ab35c9a573575c3ee', 'request_id': 'req-d39fc010-83fb-4855-aa14-d3821af4aa5b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:30.677441 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-d39fc010-83fb-4855-aa14-d3821af4aa5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'badee23df7a9473ab35c9a573575c3ee', 'request_id': 'req-d39fc010-83fb-4855-aa14-d3821af4aa5b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:30.678077 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584474a5-ddd3-4cdd-aca9-ace533764cf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:30.678675 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584474a5-ddd3-4cdd-aca9-ace533764cf1 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:30.678958 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584474a5-ddd3-4cdd-aca9-ace533764cf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:30.679897 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584474a5-ddd3-4cdd-aca9-ace533764cf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:30.690297 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584474a5-ddd3-4cdd-aca9-ace533764cf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:30.692074 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584474a5-ddd3-4cdd-aca9-ace533764cf1 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:30.696994 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-d39fc010-83fb-4855-aa14-d3821af4aa5b admin admin] The token cache is being invalidate because project badee23df7a9473ab35c9a573575c3ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:30.697430 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-d39fc010-83fb-4855-aa14-d3821af4aa5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:30.698144 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-d39fc010-83fb-4855-aa14-d3821af4aa5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:30.699665 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1046/2075] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:30 2021] DELETE /identity/v3/projects/badee23df7a9473ab35c9a573575c3ee => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:30.700433 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fc010-83fb-4855-aa14-d3821af4aa5b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:30.701812 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-d39fc010-83fb-4855-aa14-d3821af4aa5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:30.702105 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1030/2076] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:30 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:40:30.702897 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584474a5-ddd3-4cdd-aca9-ace533764cf1 service neutron] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:30.704402 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-584474a5-ddd3-4cdd-aca9-ace533764cf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:30.717297 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584474a5-ddd3-4cdd-aca9-ace533764cf1 service neutron] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:30.811644 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fc010-83fb-4855-aa14-d3821af4aa5b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:30.815350 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6679c5f-c3a9-4343-bd62-097a83ee73e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:30.816666 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6679c5f-c3a9-4343-bd62-097a83ee73e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:30.819006 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6679c5f-c3a9-4343-bd62-097a83ee73e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:30.819006 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6679c5f-c3a9-4343-bd62-097a83ee73e0 admin admin] PATH_INFO: `/v3/projects/6906ddb7ea8b4cde8dabbec416e0f996` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:30.819220 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3145a6d-ad66-4e6e-bada-0bec155ea353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:30.819854 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3145a6d-ad66-4e6e-bada-0bec155ea353 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:30.820138 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3145a6d-ad66-4e6e-bada-0bec155ea353 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:30.820405 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3145a6d-ad66-4e6e-bada-0bec155ea353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:30.821780 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6679c5f-c3a9-4343-bd62-097a83ee73e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6906ddb7ea8b4cde8dabbec416e0f996)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:30.824221 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6679c5f-c3a9-4343-bd62-097a83ee73e0 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:30.832008 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-f3145a6d-ad66-4e6e-bada-0bec155ea353 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:30.876706 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3145a6d-ad66-4e6e-bada-0bec155ea353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:30.878241 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3145a6d-ad66-4e6e-bada-0bec155ea353 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:30.896053 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1047/2077] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:30 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:30.898700 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d5f71-51f4-4a18-80af-cf972914eb60 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:30.899165 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d5f71-51f4-4a18-80af-cf972914eb60 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:30.899621 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d5f71-51f4-4a18-80af-cf972914eb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:30.919249 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-a6679c5f-c3a9-4343-bd62-097a83ee73e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6906ddb7ea8b4cde8dabbec416e0f996', 'request_id': 'req-a6679c5f-c3a9-4343-bd62-097a83ee73e0'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:30.933050 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-a6679c5f-c3a9-4343-bd62-097a83ee73e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6906ddb7ea8b4cde8dabbec416e0f996', 'request_id': 'req-a6679c5f-c3a9-4343-bd62-097a83ee73e0'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:30.934184 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-f08d5f71-51f4-4a18-80af-cf972914eb60 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:30.935826 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-f08d5f71-51f4-4a18-80af-cf972914eb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:30.939978 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-a6679c5f-c3a9-4343-bd62-097a83ee73e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6906ddb7ea8b4cde8dabbec416e0f996', 'request_id': 'req-a6679c5f-c3a9-4343-bd62-097a83ee73e0'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:30.969037 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-a6679c5f-c3a9-4343-bd62-097a83ee73e0 admin admin] The token cache is being invalidate because project 6906ddb7ea8b4cde8dabbec416e0f996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:30.969856 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-a6679c5f-c3a9-4343-bd62-097a83ee73e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:30.971588 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-a6679c5f-c3a9-4343-bd62-097a83ee73e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:30.973738 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1031/2078] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:30 2021] DELETE /identity/v3/projects/6906ddb7ea8b4cde8dabbec416e0f996 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:30.980382 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d76db-99d2-4477-b335-90ea7080bc2c None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:30.980970 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d76db-99d2-4477-b335-90ea7080bc2c None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:30.981102 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d76db-99d2-4477-b335-90ea7080bc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:31.007825 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-438d76db-99d2-4477-b335-90ea7080bc2c None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:31.009718 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-438d76db-99d2-4477-b335-90ea7080bc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:31.108888 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1032/2079] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:31.122148 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1048/2080] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:31.130492 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62922d5d-2974-4fd8-b67d-e31098c1674d None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:31.130793 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62922d5d-2974-4fd8-b67d-e31098c1674d None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:31.131069 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62922d5d-2974-4fd8-b67d-e31098c1674d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:31.161859 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4287fc6-e006-46e7-8d57-2ec6030fed1d None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:31.162064 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4287fc6-e006-46e7-8d57-2ec6030fed1d None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:31.162418 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4287fc6-e006-46e7-8d57-2ec6030fed1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:31.191518 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-f4287fc6-e006-46e7-8d57-2ec6030fed1d None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:31.191518 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-f4287fc6-e006-46e7-8d57-2ec6030fed1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:31.202751 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1049/2081] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:31.205851 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-62922d5d-2974-4fd8-b67d-e31098c1674d None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:31.207440 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-62922d5d-2974-4fd8-b67d-e31098c1674d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:31.207608 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4287fc6-e006-46e7-8d57-2ec6030fed1d None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:31.216481 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1033/2082] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:31.228621 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62922d5d-2974-4fd8-b67d-e31098c1674d None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:31.248492 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4287fc6-e006-46e7-8d57-2ec6030fed1d None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:31.252091 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62922d5d-2974-4fd8-b67d-e31098c1674d None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:31.262747 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441b4ab-df4e-42d6-941d-b7cf010ffbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:31.263757 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441b4ab-df4e-42d6-941d-b7cf010ffbba admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:31.264293 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441b4ab-df4e-42d6-941d-b7cf010ffbba admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:31.264767 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441b4ab-df4e-42d6-941d-b7cf010ffbba admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:31.265356 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c6a88-c6d6-43fc-8707-c85607b8aa13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:31.266095 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441b4ab-df4e-42d6-941d-b7cf010ffbba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:40:31.266579 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c6a88-c6d6-43fc-8707-c85607b8aa13 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:31.266894 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441b4ab-df4e-42d6-941d-b7cf010ffbba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:31.267127 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c6a88-c6d6-43fc-8707-c85607b8aa13 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:31.267614 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c6a88-c6d6-43fc-8707-c85607b8aa13 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:31.268937 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c6a88-c6d6-43fc-8707-c85607b8aa13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:40:31.269783 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441b4ab-df4e-42d6-941d-b7cf010ffbba admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:31.272304 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c6a88-c6d6-43fc-8707-c85607b8aa13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:31.279387 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c6a88-c6d6-43fc-8707-c85607b8aa13 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:31.287718 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1034/2083] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:40:31.293558 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441b4ab-df4e-42d6-941d-b7cf010ffbba admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:31.327982 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441b4ab-df4e-42d6-941d-b7cf010ffbba admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:31.341318 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1050/2084] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:40:31.341318 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c6a88-c6d6-43fc-8707-c85607b8aa13 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:31.341318 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-5e2c6a88-c6d6-43fc-8707-c85607b8aa13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:31.347298 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec44467-c0f3-4ffb-8084-d42e73004915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:31.347913 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec44467-c0f3-4ffb-8084-d42e73004915 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:31.348204 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec44467-c0f3-4ffb-8084-d42e73004915 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:31.348605 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec44467-c0f3-4ffb-8084-d42e73004915 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:31.349292 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec44467-c0f3-4ffb-8084-d42e73004915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:31.357154 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c6a88-c6d6-43fc-8707-c85607b8aa13 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:31.357591 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec44467-c0f3-4ffb-8084-d42e73004915 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:31.363091 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a8f07-f118-46ef-b2ea-53df281c60cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:31.364079 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a8f07-f118-46ef-b2ea-53df281c60cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:31.364369 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a8f07-f118-46ef-b2ea-53df281c60cb admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:31.365292 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a8f07-f118-46ef-b2ea-53df281c60cb admin admin] PATH_INFO: `/v3/projects/5c7e1fc334a04747b39f7303e3489936` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:31.367233 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a8f07-f118-46ef-b2ea-53df281c60cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c7e1fc334a04747b39f7303e3489936)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:31.369969 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a8f07-f118-46ef-b2ea-53df281c60cb admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:31.413194 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1035/2085] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:31 2021] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:40:31.414603 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec44467-c0f3-4ffb-8084-d42e73004915 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:31.451747 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-5a2a8f07-f118-46ef-b2ea-53df281c60cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c7e1fc334a04747b39f7303e3489936', 'request_id': 'req-5a2a8f07-f118-46ef-b2ea-53df281c60cb'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:31.474253 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-5a2a8f07-f118-46ef-b2ea-53df281c60cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c7e1fc334a04747b39f7303e3489936', 'request_id': 'req-5a2a8f07-f118-46ef-b2ea-53df281c60cb'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:31.488175 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-5a2a8f07-f118-46ef-b2ea-53df281c60cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c7e1fc334a04747b39f7303e3489936', 'request_id': 'req-5a2a8f07-f118-46ef-b2ea-53df281c60cb'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:31.526512 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec44467-c0f3-4ffb-8084-d42e73004915 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:31.535306 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-5a2a8f07-f118-46ef-b2ea-53df281c60cb admin admin] The token cache is being invalidate because project 5c7e1fc334a04747b39f7303e3489936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:31.535887 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-5a2a8f07-f118-46ef-b2ea-53df281c60cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:31.537044 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-5a2a8f07-f118-46ef-b2ea-53df281c60cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:31.539683 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1051/2086] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:31 2021] DELETE /identity/v3/projects/5c7e1fc334a04747b39f7303e3489936 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:31.541241 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a8f07-f118-46ef-b2ea-53df281c60cb admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:31.543483 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-5a2a8f07-f118-46ef-b2ea-53df281c60cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:31.714257 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aaa784-1669-4b43-a0c9-005b377c71ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:31.714891 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaa784-1669-4b43-a0c9-005b377c71ae admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:31.715190 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaa784-1669-4b43-a0c9-005b377c71ae admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:31.719898 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaa784-1669-4b43-a0c9-005b377c71ae admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:31.720685 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aaa784-1669-4b43-a0c9-005b377c71ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:31.731326 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aaa784-1669-4b43-a0c9-005b377c71ae admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:31.747279 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a8f07-f118-46ef-b2ea-53df281c60cb admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:31.763194 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4780f6c-38d0-4818-a9b7-85e70a02678a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:31.770548 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4780f6c-38d0-4818-a9b7-85e70a02678a admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:31.770693 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4780f6c-38d0-4818-a9b7-85e70a02678a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:31.770995 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4780f6c-38d0-4818-a9b7-85e70a02678a admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:31.771658 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4780f6c-38d0-4818-a9b7-85e70a02678a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:31.774982 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4780f6c-38d0-4818-a9b7-85e70a02678a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:31.783880 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1036/2087] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:31 2021] POST /identity/v3/projects => generated 383 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:31.788748 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aaa784-1669-4b43-a0c9-005b377c71ae admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:31.791529 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-f8aaa784-1669-4b43-a0c9-005b377c71ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:31.803133 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1052/2088] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:31 2021] POST /identity/v3/users => generated 286 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:31.804392 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4780f6c-38d0-4818-a9b7-85e70a02678a admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:31.808020 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-a4780f6c-38d0-4818-a9b7-85e70a02678a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:31.824240 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4780f6c-38d0-4818-a9b7-85e70a02678a admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:31.929754 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794447ad-47f2-409a-a1e8-a0f1ab657426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:31.931316 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794447ad-47f2-409a-a1e8-a0f1ab657426 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:31.932113 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794447ad-47f2-409a-a1e8-a0f1ab657426 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:31.932710 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794447ad-47f2-409a-a1e8-a0f1ab657426 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:31.933660 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794447ad-47f2-409a-a1e8-a0f1ab657426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:31.936973 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794447ad-47f2-409a-a1e8-a0f1ab657426 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:31.943241 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aaa784-1669-4b43-a0c9-005b377c71ae admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:31.948454 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3715b4-e08c-4a3e-8881-72a7b530b22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:31.949485 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3715b4-e08c-4a3e-8881-72a7b530b22e admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:31.949774 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3715b4-e08c-4a3e-8881-72a7b530b22e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:31.950055 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3715b4-e08c-4a3e-8881-72a7b530b22e admin admin] PATH_INFO: `/v3/projects/66e8e3028160445db878134de2706b93` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:31.951224 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3715b4-e08c-4a3e-8881-72a7b530b22e admin admin] RBAC: Authorizing `identity:delete_project(project_id=66e8e3028160445db878134de2706b93)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:31.953250 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3715b4-e08c-4a3e-8881-72a7b530b22e admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:31.972178 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1053/2089] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:31 2021] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:31.972178 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794447ad-47f2-409a-a1e8-a0f1ab657426 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:31.983268 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794447ad-47f2-409a-a1e8-a0f1ab657426 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:31.988301 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55c9cc-ff6d-44f0-89d4-6f7196a80612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:31.988995 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55c9cc-ff6d-44f0-89d4-6f7196a80612 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:31.989286 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55c9cc-ff6d-44f0-89d4-6f7196a80612 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:31.989570 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55c9cc-ff6d-44f0-89d4-6f7196a80612 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:31.991982 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55c9cc-ff6d-44f0-89d4-6f7196a80612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:31.994860 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55c9cc-ff6d-44f0-89d4-6f7196a80612 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:32.007861 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1054/2090] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:31 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:32.008796 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55c9cc-ff6d-44f0-89d4-6f7196a80612 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:32.020952 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55c9cc-ff6d-44f0-89d4-6f7196a80612 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:32.027272 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-3f3715b4-e08c-4a3e-8881-72a7b530b22e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66e8e3028160445db878134de2706b93', 'request_id': 'req-3f3715b4-e08c-4a3e-8881-72a7b530b22e'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:32.046179 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-3f3715b4-e08c-4a3e-8881-72a7b530b22e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66e8e3028160445db878134de2706b93', 'request_id': 'req-3f3715b4-e08c-4a3e-8881-72a7b530b22e'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:32.055526 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-3f3715b4-e08c-4a3e-8881-72a7b530b22e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66e8e3028160445db878134de2706b93', 'request_id': 'req-3f3715b4-e08c-4a3e-8881-72a7b530b22e'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:32.072921 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-3f3715b4-e08c-4a3e-8881-72a7b530b22e admin admin] The token cache is being invalidate because project 66e8e3028160445db878134de2706b93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:32.073362 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-3f3715b4-e08c-4a3e-8881-72a7b530b22e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:32.073953 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-3f3715b4-e08c-4a3e-8881-72a7b530b22e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:32.075821 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1037/2091] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:31 2021] DELETE /identity/v3/projects/66e8e3028160445db878134de2706b93 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:32.080247 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3715b4-e08c-4a3e-8881-72a7b530b22e admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:32.082174 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-3f3715b4-e08c-4a3e-8881-72a7b530b22e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:32.101244 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bfbf65-4205-4e6d-9fb8-43e580e6d95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:32.101937 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfbf65-4205-4e6d-9fb8-43e580e6d95f admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:32.102403 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfbf65-4205-4e6d-9fb8-43e580e6d95f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:32.102828 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfbf65-4205-4e6d-9fb8-43e580e6d95f admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:32.103734 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bfbf65-4205-4e6d-9fb8-43e580e6d95f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:32.105766 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bfbf65-4205-4e6d-9fb8-43e580e6d95f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:32.123521 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1055/2092] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:32 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:32.125653 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bfbf65-4205-4e6d-9fb8-43e580e6d95f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:32.128877 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e5bfbf65-4205-4e6d-9fb8-43e580e6d95f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:32.151029 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bfbf65-4205-4e6d-9fb8-43e580e6d95f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:32.158201 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6aea1-26d5-43da-bdee-8d89928157a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:32.160494 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6aea1-26d5-43da-bdee-8d89928157a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:32.169941 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6aea1-26d5-43da-bdee-8d89928157a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:32.170425 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6aea1-26d5-43da-bdee-8d89928157a7 admin admin] PATH_INFO: `/v3/users/7242d1463b114c4c9b79c605c0914766` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:32.171985 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6aea1-26d5-43da-bdee-8d89928157a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7242d1463b114c4c9b79c605c0914766)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:32.174287 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6aea1-26d5-43da-bdee-8d89928157a7 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:32.189425 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3715b4-e08c-4a3e-8881-72a7b530b22e admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:32.197457 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99297cf-0038-40b7-955f-927deb317e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:32.198418 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99297cf-0038-40b7-955f-927deb317e18 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:32.199010 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99297cf-0038-40b7-955f-927deb317e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:32.199434 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99297cf-0038-40b7-955f-927deb317e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:32.201078 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99297cf-0038-40b7-955f-927deb317e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:32.203751 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99297cf-0038-40b7-955f-927deb317e18 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:32.225376 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1038/2093] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:32 2021] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:32.227387 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99297cf-0038-40b7-955f-927deb317e18 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:32.230048 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e99297cf-0038-40b7-955f-927deb317e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:32.244865 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99297cf-0038-40b7-955f-927deb317e18 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:32.249970 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fbed0-daf4-46db-883c-9a3f1d9f83a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:32.250585 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fbed0-daf4-46db-883c-9a3f1d9f83a9 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:32.250875 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fbed0-daf4-46db-883c-9a3f1d9f83a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:32.251156 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fbed0-daf4-46db-883c-9a3f1d9f83a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:32.251865 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fbed0-daf4-46db-883c-9a3f1d9f83a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:32.253513 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fbed0-daf4-46db-883c-9a3f1d9f83a9 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:32.264907 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1039/2094] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:32 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:32.265767 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fbed0-daf4-46db-883c-9a3f1d9f83a9 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:32.275534 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-48e6aea1-26d5-43da-bdee-8d89928157a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7242d1463b114c4c9b79c605c0914766'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:32.277177 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-48e6aea1-26d5-43da-bdee-8d89928157a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7242d1463b114c4c9b79c605c0914766'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:32.282088 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fbed0-daf4-46db-883c-9a3f1d9f83a9 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:32.298043 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-48e6aea1-26d5-43da-bdee-8d89928157a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7242d1463b114c4c9b79c605c0914766'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:32.299519 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63109b4d-c7bb-4c0e-84e7-a497386f48ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:32.301075 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63109b4d-c7bb-4c0e-84e7-a497386f48ed admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:32.301583 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63109b4d-c7bb-4c0e-84e7-a497386f48ed admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:32.302097 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63109b4d-c7bb-4c0e-84e7-a497386f48ed admin admin] PATH_INFO: `/v3/projects/d2c80f6588b6403388795a3cbdab209e/users/f92d2ddc00804f0d813f494e78a88530/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:32.313675 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-48e6aea1-26d5-43da-bdee-8d89928157a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7242d1463b114c4c9b79c605c0914766'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:32.325349 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-48e6aea1-26d5-43da-bdee-8d89928157a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7242d1463b114c4c9b79c605c0914766'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:32.332602 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1056/2095] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:32 2021] DELETE /identity/v3/users/7242d1463b114c4c9b79c605c0914766 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:32.334023 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6aea1-26d5-43da-bdee-8d89928157a7 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:32.335391 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63109b4d-c7bb-4c0e-84e7-a497386f48ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c80f6588b6403388795a3cbdab209e, user_id=f92d2ddc00804f0d813f494e78a88530, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:32.340638 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63109b4d-c7bb-4c0e-84e7-a497386f48ed admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:32.341395 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-48e6aea1-26d5-43da-bdee-8d89928157a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:32.368020 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1040/2096] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:32 2021] PUT /identity/v3/projects/d2c80f6588b6403388795a3cbdab209e/users/f92d2ddc00804f0d813f494e78a88530/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:32.379674 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6ffd4-6e98-4e14-9c5b-44f5a7fdb596 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:32.380773 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6ffd4-6e98-4e14-9c5b-44f5a7fdb596 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:32.381320 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6ffd4-6e98-4e14-9c5b-44f5a7fdb596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:32.424246 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-63d6ffd4-6e98-4e14-9c5b-44f5a7fdb596 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:32.426406 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-63d6ffd4-6e98-4e14-9c5b-44f5a7fdb596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:32.446725 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6aea1-26d5-43da-bdee-8d89928157a7 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:32.535794 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b729f7-053a-415b-954e-cbc069a4edaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:32.536863 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b729f7-053a-415b-954e-cbc069a4edaa admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:32.537201 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b729f7-053a-415b-954e-cbc069a4edaa admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:32.537493 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b729f7-053a-415b-954e-cbc069a4edaa admin admin] PATH_INFO: `/v3/projects/5a10c6d1e7e7425bb59f6efad4231db3/users/eeb2dde456a8408d820d765c54f8a868/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:32.558050 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1041/2097] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:32.565272 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b729f7-053a-415b-954e-cbc069a4edaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a10c6d1e7e7425bb59f6efad4231db3, user_id=eeb2dde456a8408d820d765c54f8a868, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:32.568001 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b729f7-053a-415b-954e-cbc069a4edaa admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:32.569310 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6ffd4-6e98-4e14-9c5b-44f5a7fdb596 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:32.571225 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-63d6ffd4-6e98-4e14-9c5b-44f5a7fdb596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:32.588861 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1057/2098] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:32 2021] PUT /identity/v3/projects/5a10c6d1e7e7425bb59f6efad4231db3/users/eeb2dde456a8408d820d765c54f8a868/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:32.599590 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e7968-32dd-4c12-b711-10c377cfc941 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:32.599590 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e7968-32dd-4c12-b711-10c377cfc941 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:32.599590 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e7968-32dd-4c12-b711-10c377cfc941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:32.631080 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-4e1e7968-32dd-4c12-b711-10c377cfc941 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:32.633182 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-4e1e7968-32dd-4c12-b711-10c377cfc941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:32.655768 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6ffd4-6e98-4e14-9c5b-44f5a7fdb596 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:32.716233 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1058/2099] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:32.727474 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e7968-32dd-4c12-b711-10c377cfc941 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:32.728961 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-4e1e7968-32dd-4c12-b711-10c377cfc941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:32.744010 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac504884-6317-4a2b-b1df-e5c39521f743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:32.745120 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac504884-6317-4a2b-b1df-e5c39521f743 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:32.745621 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac504884-6317-4a2b-b1df-e5c39521f743 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:32.746089 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac504884-6317-4a2b-b1df-e5c39521f743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:32.760903 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac504884-6317-4a2b-b1df-e5c39521f743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:32.762352 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac504884-6317-4a2b-b1df-e5c39521f743 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:32.777236 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1042/2100] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:32 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:40:32.823856 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac504884-6317-4a2b-b1df-e5c39521f743 service neutron] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:32.828834 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-ac504884-6317-4a2b-b1df-e5c39521f743 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:32.829060 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e7968-32dd-4c12-b711-10c377cfc941 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:32.832922 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ae5ea-c403-4b3e-ada0-da9583b2f2ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:32.833695 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ae5ea-c403-4b3e-ada0-da9583b2f2ee service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:32.834266 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ae5ea-c403-4b3e-ada0-da9583b2f2ee service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:32.834266 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ae5ea-c403-4b3e-ada0-da9583b2f2ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:32.843208 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac504884-6317-4a2b-b1df-e5c39521f743 service neutron] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:32.849223 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe415440-857b-4d0c-a151-20caaa2834e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:32.850214 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe415440-857b-4d0c-a151-20caaa2834e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:32.850620 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe415440-857b-4d0c-a151-20caaa2834e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:32.851508 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe415440-857b-4d0c-a151-20caaa2834e0 admin admin] PATH_INFO: `/v3/projects/63d7ab99560440b6ae7f6c58c5e078dc` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:32.853215 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe415440-857b-4d0c-a151-20caaa2834e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63d7ab99560440b6ae7f6c58c5e078dc)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:32.855471 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe415440-857b-4d0c-a151-20caaa2834e0 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:32.862872 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ae5ea-c403-4b3e-ada0-da9583b2f2ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:32.864526 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ae5ea-c403-4b3e-ada0-da9583b2f2ee service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:32.877906 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1059/2101] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:32 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:32.943889 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-fe415440-857b-4d0c-a151-20caaa2834e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63d7ab99560440b6ae7f6c58c5e078dc', 'request_id': 'req-fe415440-857b-4d0c-a151-20caaa2834e0'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:32.969724 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-fe415440-857b-4d0c-a151-20caaa2834e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63d7ab99560440b6ae7f6c58c5e078dc', 'request_id': 'req-fe415440-857b-4d0c-a151-20caaa2834e0'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:32.979742 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-fe415440-857b-4d0c-a151-20caaa2834e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63d7ab99560440b6ae7f6c58c5e078dc', 'request_id': 'req-fe415440-857b-4d0c-a151-20caaa2834e0'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:32.980152 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ae5ea-c403-4b3e-ada0-da9583b2f2ee service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:32.981823 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-d71ae5ea-c403-4b3e-ada0-da9583b2f2ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:32.995679 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ae5ea-c403-4b3e-ada0-da9583b2f2ee service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:33.001202 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-fe415440-857b-4d0c-a151-20caaa2834e0 admin admin] The token cache is being invalidate because project 63d7ab99560440b6ae7f6c58c5e078dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:33.001571 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-fe415440-857b-4d0c-a151-20caaa2834e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:33.002375 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-fe415440-857b-4d0c-a151-20caaa2834e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:33.004298 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1043/2102] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:32 2021] DELETE /identity/v3/projects/63d7ab99560440b6ae7f6c58c5e078dc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:33.011825 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d01b4-b9b1-4e9c-b6e5-a2e89f982874 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:33.011825 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d01b4-b9b1-4e9c-b6e5-a2e89f982874 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:33.012089 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d01b4-b9b1-4e9c-b6e5-a2e89f982874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:33.049122 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-861d01b4-b9b1-4e9c-b6e5-a2e89f982874 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:33.050370 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-861d01b4-b9b1-4e9c-b6e5-a2e89f982874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:33.142705 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b9ac4-fedb-44c2-ad03-c7624d2842c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:33.144217 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b9ac4-fedb-44c2-ad03-c7624d2842c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:33.145046 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b9ac4-fedb-44c2-ad03-c7624d2842c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:33.145532 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b9ac4-fedb-44c2-ad03-c7624d2842c0 admin admin] PATH_INFO: `/v3/users/4b3d5f2f117341d48d1a919f404f7522` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:33.147365 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b9ac4-fedb-44c2-ad03-c7624d2842c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b3d5f2f117341d48d1a919f404f7522)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:33.149839 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b9ac4-fedb-44c2-ad03-c7624d2842c0 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:33.179970 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1044/2103] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:33.189725 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e25f8-e891-44d9-8551-7705f0509a8d None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:33.189914 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e25f8-e891-44d9-8551-7705f0509a8d None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:33.190060 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e25f8-e891-44d9-8551-7705f0509a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:33.225343 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-585e25f8-e891-44d9-8551-7705f0509a8d None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:33.228177 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-585e25f8-e891-44d9-8551-7705f0509a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:33.231864 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-7d0b9ac4-fedb-44c2-ad03-c7624d2842c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b3d5f2f117341d48d1a919f404f7522'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:33.232629 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-7d0b9ac4-fedb-44c2-ad03-c7624d2842c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b3d5f2f117341d48d1a919f404f7522'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:33.259386 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1045/2104] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:33.264862 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e25f8-e891-44d9-8551-7705f0509a8d None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:33.273684 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-7d0b9ac4-fedb-44c2-ad03-c7624d2842c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b3d5f2f117341d48d1a919f404f7522'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:33.282394 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e25f8-e891-44d9-8551-7705f0509a8d None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:33.287775 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-7d0b9ac4-fedb-44c2-ad03-c7624d2842c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b3d5f2f117341d48d1a919f404f7522'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:33.291598 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1697f54-d06c-4ddf-be46-be289c30de17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:33.292579 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1697f54-d06c-4ddf-be46-be289c30de17 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:33.293674 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1697f54-d06c-4ddf-be46-be289c30de17 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:33.294080 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1697f54-d06c-4ddf-be46-be289c30de17 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:33.295327 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1697f54-d06c-4ddf-be46-be289c30de17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:40:33.295861 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1697f54-d06c-4ddf-be46-be289c30de17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:33.299014 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1697f54-d06c-4ddf-be46-be289c30de17 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:33.302546 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-7d0b9ac4-fedb-44c2-ad03-c7624d2842c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b3d5f2f117341d48d1a919f404f7522'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:33.327642 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1046/2105] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:40:33.330224 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1060/2106] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:32 2021] DELETE /identity/v3/users/4b3d5f2f117341d48d1a919f404f7522 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:33.336525 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1697f54-d06c-4ddf-be46-be289c30de17 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:33.341237 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07d699-d1d5-4bec-8334-88664d3a5699 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:33.341756 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07d699-d1d5-4bec-8334-88664d3a5699 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:33.347299 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07d699-d1d5-4bec-8334-88664d3a5699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:33.347810 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-b1697f54-d06c-4ddf-be46-be289c30de17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:33.399945 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-9f07d699-d1d5-4bec-8334-88664d3a5699 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:33.402078 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-9f07d699-d1d5-4bec-8334-88664d3a5699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:33.412569 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1697f54-d06c-4ddf-be46-be289c30de17 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:33.549971 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1061/2107] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:33.590844 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d09c7e-68cf-4ea0-b472-e3743c8da847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:33.593113 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d09c7e-68cf-4ea0-b472-e3743c8da847 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:33.594350 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d09c7e-68cf-4ea0-b472-e3743c8da847 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:33.595272 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d09c7e-68cf-4ea0-b472-e3743c8da847 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:33.597395 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d09c7e-68cf-4ea0-b472-e3743c8da847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:33.603206 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07d699-d1d5-4bec-8334-88664d3a5699 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:33.603206 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-9f07d699-d1d5-4bec-8334-88664d3a5699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:33.603487 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d09c7e-68cf-4ea0-b472-e3743c8da847 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:33.663406 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1047/2108] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:33 2021] POST /identity/v3/projects => generated 385 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:33.664561 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d09c7e-68cf-4ea0-b472-e3743c8da847 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:33.774008 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07d699-d1d5-4bec-8334-88664d3a5699 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:33.848242 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d09c7e-68cf-4ea0-b472-e3743c8da847 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:33.866086 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26765b44-448d-40e5-9312-8bbf1b78ca16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:33.866742 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26765b44-448d-40e5-9312-8bbf1b78ca16 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:33.867034 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26765b44-448d-40e5-9312-8bbf1b78ca16 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:33.867331 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26765b44-448d-40e5-9312-8bbf1b78ca16 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:33.867995 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26765b44-448d-40e5-9312-8bbf1b78ca16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:33.869979 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26765b44-448d-40e5-9312-8bbf1b78ca16 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:33.916229 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1048/2109] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:33 2021] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:40:33.920586 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26765b44-448d-40e5-9312-8bbf1b78ca16 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:33.926692 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11be588-faea-41cb-9317-966e75b843a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:33.928167 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11be588-faea-41cb-9317-966e75b843a5 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:33.928685 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11be588-faea-41cb-9317-966e75b843a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:33.929467 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11be588-faea-41cb-9317-966e75b843a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:33.935515 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26765b44-448d-40e5-9312-8bbf1b78ca16 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:33.940503 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbb0fe-8848-4e9e-a8c4-e0c0c5aa13f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:33.941409 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbb0fe-8848-4e9e-a8c4-e0c0c5aa13f1 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:33.941688 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbb0fe-8848-4e9e-a8c4-e0c0c5aa13f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:33.941980 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbb0fe-8848-4e9e-a8c4-e0c0c5aa13f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:33.942719 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddbb0fe-8848-4e9e-a8c4-e0c0c5aa13f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:33.944315 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddbb0fe-8848-4e9e-a8c4-e0c0c5aa13f1 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:33.951595 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11be588-faea-41cb-9317-966e75b843a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:33.953915 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11be588-faea-41cb-9317-966e75b843a5 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:33.957407 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1049/2110] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:33 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:40:33.963078 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbb0fe-8848-4e9e-a8c4-e0c0c5aa13f1 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:33.967949 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1062/2111] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:33 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:33.973510 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbb0fe-8848-4e9e-a8c4-e0c0c5aa13f1 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:33.978296 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc33ff-d32b-4f8c-913d-349119e4a0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:33.978913 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc33ff-d32b-4f8c-913d-349119e4a0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:33.979208 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc33ff-d32b-4f8c-913d-349119e4a0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:33.980508 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc33ff-d32b-4f8c-913d-349119e4a0b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:33.980508 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc33ff-d32b-4f8c-913d-349119e4a0b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:33.982003 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc33ff-d32b-4f8c-913d-349119e4a0b8 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:33.996130 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1050/2112] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:33 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:34.000822 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11be588-faea-41cb-9317-966e75b843a5 service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:34.012019 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11be588-faea-41cb-9317-966e75b843a5 service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:34.017144 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfaba7-bb4b-4018-b84f-aab775b1c4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:34.017976 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfaba7-bb4b-4018-b84f-aab775b1c4bc admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:34.018269 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfaba7-bb4b-4018-b84f-aab775b1c4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:34.018562 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfaba7-bb4b-4018-b84f-aab775b1c4bc admin admin] PATH_INFO: `/v3/projects/dc5bda9f41924b59bb7b9ec4dadfe751/users/4f4d6f974fe4479d8a3e48c688077604/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:34.046239 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dfaba7-bb4b-4018-b84f-aab775b1c4bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5bda9f41924b59bb7b9ec4dadfe751, user_id=4f4d6f974fe4479d8a3e48c688077604, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:34.049244 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dfaba7-bb4b-4018-b84f-aab775b1c4bc admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:34.071836 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1063/2113] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:33 2021] PUT /identity/v3/projects/dc5bda9f41924b59bb7b9ec4dadfe751/users/4f4d6f974fe4479d8a3e48c688077604/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:34.094924 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e68e8-499a-4c2e-9e7e-9cd49f3a1e00 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:34.095230 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e68e8-499a-4c2e-9e7e-9cd49f3a1e00 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:34.095702 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e68e8-499a-4c2e-9e7e-9cd49f3a1e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:34.136441 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-fe9e68e8-499a-4c2e-9e7e-9cd49f3a1e00 None None] MFA Rules not processed for user `4f4d6f974fe4479d8a3e48c688077604`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:34.137623 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-fe9e68e8-499a-4c2e-9e7e-9cd49f3a1e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:34.224421 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1051/2114] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:34 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:34.235648 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfaba7-bb4b-4018-b84f-aab775b1c4bc admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:34.238007 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-f4dfaba7-bb4b-4018-b84f-aab775b1c4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:34.309682 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfaba7-bb4b-4018-b84f-aab775b1c4bc admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:34.313325 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e96f3-3400-430a-86e4-2ffbae34c642 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:34.314400 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e96f3-3400-430a-86e4-2ffbae34c642 service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:34.314400 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e96f3-3400-430a-86e4-2ffbae34c642 service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:34.314613 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e96f3-3400-430a-86e4-2ffbae34c642 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:34.331840 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e96f3-3400-430a-86e4-2ffbae34c642 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:34.333813 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e96f3-3400-430a-86e4-2ffbae34c642 service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:34.344462 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1064/2115] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:34 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:34.364818 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e68e8-499a-4c2e-9e7e-9cd49f3a1e00 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:34.437224 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e68e8-499a-4c2e-9e7e-9cd49f3a1e00 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:34.443207 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea634285-2b0f-4188-bb74-c489c0ce4e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:34.444018 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea634285-2b0f-4188-bb74-c489c0ce4e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:34.444311 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea634285-2b0f-4188-bb74-c489c0ce4e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:34.445102 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea634285-2b0f-4188-bb74-c489c0ce4e77 admin admin] PATH_INFO: `/v3/users/4f4d6f974fe4479d8a3e48c688077604` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:34.446449 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea634285-2b0f-4188-bb74-c489c0ce4e77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f4d6f974fe4479d8a3e48c688077604)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:34.448548 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea634285-2b0f-4188-bb74-c489c0ce4e77 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:34.500295 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ea634285-2b0f-4188-bb74-c489c0ce4e77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f4d6f974fe4479d8a3e48c688077604'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:34.501317 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ea634285-2b0f-4188-bb74-c489c0ce4e77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f4d6f974fe4479d8a3e48c688077604'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:34.514032 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ea634285-2b0f-4188-bb74-c489c0ce4e77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f4d6f974fe4479d8a3e48c688077604'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:34.521817 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ea634285-2b0f-4188-bb74-c489c0ce4e77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f4d6f974fe4479d8a3e48c688077604'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:34.532267 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ea634285-2b0f-4188-bb74-c489c0ce4e77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f4d6f974fe4479d8a3e48c688077604'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:34.539086 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1052/2116] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:34 2021] DELETE /identity/v3/users/4f4d6f974fe4479d8a3e48c688077604 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:34.545170 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb597da0-8cf5-43cb-a59a-28375a0208b1 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:34.545947 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb597da0-8cf5-43cb-a59a-28375a0208b1 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:34.546241 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb597da0-8cf5-43cb-a59a-28375a0208b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:34.570180 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-fb597da0-8cf5-43cb-a59a-28375a0208b1 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:34.571486 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-fb597da0-8cf5-43cb-a59a-28375a0208b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:34.683840 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1065/2117] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:34.699831 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea634285-2b0f-4188-bb74-c489c0ce4e77 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:34.701605 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-ea634285-2b0f-4188-bb74-c489c0ce4e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:34.772892 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b40e56-afd9-4188-bc36-b462ba50df25 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:34.773652 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b40e56-afd9-4188-bc36-b462ba50df25 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:34.774153 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b40e56-afd9-4188-bc36-b462ba50df25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:34.843952 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea634285-2b0f-4188-bb74-c489c0ce4e77 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:34.852679 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7801f2-3f96-4229-8a33-ff1959cf124d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:34.855380 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7801f2-3f96-4229-8a33-ff1959cf124d service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:34.855663 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7801f2-3f96-4229-8a33-ff1959cf124d service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:34.855946 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7801f2-3f96-4229-8a33-ff1959cf124d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:34.865527 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-e9b40e56-afd9-4188-bc36-b462ba50df25 None None] MFA Rules not processed for user `f92d2ddc00804f0d813f494e78a88530`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:34.870584 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e9b40e56-afd9-4188-bc36-b462ba50df25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:34.879287 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7801f2-3f96-4229-8a33-ff1959cf124d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:34.881900 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7801f2-3f96-4229-8a33-ff1959cf124d service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:34.912627 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1053/2118] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:34 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:34.914814 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d9ca6-fcc5-4754-8649-fa7c66f38fce None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:34.915204 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d9ca6-fcc5-4754-8649-fa7c66f38fce None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:34.915723 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d9ca6-fcc5-4754-8649-fa7c66f38fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:35.034746 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-6b9d9ca6-fcc5-4754-8649-fa7c66f38fce None None] MFA Rules not processed for user `eeb2dde456a8408d820d765c54f8a868`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:35.036503 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-6b9d9ca6-fcc5-4754-8649-fa7c66f38fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:35.061482 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1066/2119] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:34 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:35.062684 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b40e56-afd9-4188-bc36-b462ba50df25 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:35.064713 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e9b40e56-afd9-4188-bc36-b462ba50df25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:35.087273 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b40e56-afd9-4188-bc36-b462ba50df25 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:35.103264 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb7103-fcf6-4c31-8c5e-97e950ece65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:35.104361 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb7103-fcf6-4c31-8c5e-97e950ece65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:35.104915 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb7103-fcf6-4c31-8c5e-97e950ece65d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:35.105839 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb7103-fcf6-4c31-8c5e-97e950ece65d admin admin] PATH_INFO: `/v3/projects/eefffd14d0794d3cb998cd2569e72116` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:35.116411 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb7103-fcf6-4c31-8c5e-97e950ece65d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eefffd14d0794d3cb998cd2569e72116)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:35.119844 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb7103-fcf6-4c31-8c5e-97e950ece65d admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:35.151496 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1054/2120] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:34 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:35.152437 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d9ca6-fcc5-4754-8649-fa7c66f38fce None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:35.154270 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-6b9d9ca6-fcc5-4754-8649-fa7c66f38fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:35.174547 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d9ca6-fcc5-4754-8649-fa7c66f38fce None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:35.183052 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f03af-9764-4b6c-81b0-9a52fc12f95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:35.183808 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f03af-9764-4b6c-81b0-9a52fc12f95a admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:35.183951 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f03af-9764-4b6c-81b0-9a52fc12f95a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:35.184215 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f03af-9764-4b6c-81b0-9a52fc12f95a admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:35.184925 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f03af-9764-4b6c-81b0-9a52fc12f95a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:35.187026 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f03af-9764-4b6c-81b0-9a52fc12f95a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:35.203318 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-44bb7103-fcf6-4c31-8c5e-97e950ece65d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eefffd14d0794d3cb998cd2569e72116', 'request_id': 'req-44bb7103-fcf6-4c31-8c5e-97e950ece65d'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:35.224591 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1055/2121] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:35 2021] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:35.226491 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e388f1-9d68-409f-9b66-88254dd67887 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:35.226787 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e388f1-9d68-409f-9b66-88254dd67887 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:35.227074 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e388f1-9d68-409f-9b66-88254dd67887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:35.236158 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-44bb7103-fcf6-4c31-8c5e-97e950ece65d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eefffd14d0794d3cb998cd2569e72116', 'request_id': 'req-44bb7103-fcf6-4c31-8c5e-97e950ece65d'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:35.247449 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-44bb7103-fcf6-4c31-8c5e-97e950ece65d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eefffd14d0794d3cb998cd2569e72116', 'request_id': 'req-44bb7103-fcf6-4c31-8c5e-97e950ece65d'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:35.250364 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-96e388f1-9d68-409f-9b66-88254dd67887 None None] MFA Rules not processed for user `eeb2dde456a8408d820d765c54f8a868`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:35.251545 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-96e388f1-9d68-409f-9b66-88254dd67887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:35.270187 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-44bb7103-fcf6-4c31-8c5e-97e950ece65d admin admin] The token cache is being invalidate because project eefffd14d0794d3cb998cd2569e72116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:35.270373 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-44bb7103-fcf6-4c31-8c5e-97e950ece65d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:35.271207 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-44bb7103-fcf6-4c31-8c5e-97e950ece65d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:35.273900 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1067/2122] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:35 2021] DELETE /identity/v3/projects/eefffd14d0794d3cb998cd2569e72116 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:35.274778 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb7103-fcf6-4c31-8c5e-97e950ece65d admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:35.276701 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-44bb7103-fcf6-4c31-8c5e-97e950ece65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:35.330952 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1056/2123] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:35 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:35.330952 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e388f1-9d68-409f-9b66-88254dd67887 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:35.330952 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-96e388f1-9d68-409f-9b66-88254dd67887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:35.379728 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb7103-fcf6-4c31-8c5e-97e950ece65d admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:35.455955 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e388f1-9d68-409f-9b66-88254dd67887 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:35.457589 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387b7d7-dd48-4a85-b51a-a2ae888a5c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:35.458627 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387b7d7-dd48-4a85-b51a-a2ae888a5c01 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:35.459176 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387b7d7-dd48-4a85-b51a-a2ae888a5c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:35.459601 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387b7d7-dd48-4a85-b51a-a2ae888a5c01 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:35.460744 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387b7d7-dd48-4a85-b51a-a2ae888a5c01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:35.461766 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c61514-8e73-4320-b786-be201cbe31be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:35.462743 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c61514-8e73-4320-b786-be201cbe31be admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:35.462868 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387b7d7-dd48-4a85-b51a-a2ae888a5c01 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:35.462957 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c61514-8e73-4320-b786-be201cbe31be admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:35.463329 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c61514-8e73-4320-b786-be201cbe31be admin admin] PATH_INFO: `/v3/users/96f219f9147941459170e4b1df78bcd9` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:35.464680 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c61514-8e73-4320-b786-be201cbe31be admin admin] RBAC: Authorizing `identity:delete_user(user_id=96f219f9147941459170e4b1df78bcd9)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:35.466840 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c61514-8e73-4320-b786-be201cbe31be admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:35.485824 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1068/2124] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:35 2021] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:35.487023 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387b7d7-dd48-4a85-b51a-a2ae888a5c01 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:35.489839 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-9387b7d7-dd48-4a85-b51a-a2ae888a5c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:35.530445 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-d9c61514-8e73-4320-b786-be201cbe31be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96f219f9147941459170e4b1df78bcd9'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:35.531423 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-d9c61514-8e73-4320-b786-be201cbe31be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96f219f9147941459170e4b1df78bcd9'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:35.544897 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-d9c61514-8e73-4320-b786-be201cbe31be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96f219f9147941459170e4b1df78bcd9'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:35.552589 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-d9c61514-8e73-4320-b786-be201cbe31be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96f219f9147941459170e4b1df78bcd9'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:35.561131 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-d9c61514-8e73-4320-b786-be201cbe31be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96f219f9147941459170e4b1df78bcd9'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:35.568862 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1057/2125] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:35 2021] DELETE /identity/v3/users/96f219f9147941459170e4b1df78bcd9 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:35.569697 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c61514-8e73-4320-b786-be201cbe31be admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:35.571164 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-d9c61514-8e73-4320-b786-be201cbe31be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:35.596340 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387b7d7-dd48-4a85-b51a-a2ae888a5c01 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:35.660753 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c61514-8e73-4320-b786-be201cbe31be admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:35.668972 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ea911-b336-4ab9-be9e-e8d8651b15f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:35.670067 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ea911-b336-4ab9-be9e-e8d8651b15f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:35.670512 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ea911-b336-4ab9-be9e-e8d8651b15f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:35.670943 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ea911-b336-4ab9-be9e-e8d8651b15f3 admin admin] PATH_INFO: `/v3/projects/dc5bda9f41924b59bb7b9ec4dadfe751` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:35.672294 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ea911-b336-4ab9-be9e-e8d8651b15f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc5bda9f41924b59bb7b9ec4dadfe751)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:35.674939 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ea911-b336-4ab9-be9e-e8d8651b15f3 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:35.709983 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60c70c-6004-4941-a310-29000cbd758d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:35.711324 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60c70c-6004-4941-a310-29000cbd758d service nova] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:35.711727 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60c70c-6004-4941-a310-29000cbd758d service nova] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:35.712273 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60c70c-6004-4941-a310-29000cbd758d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:35.714987 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-8b60c70c-6004-4941-a310-29000cbd758d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:35.738236 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-329ea911-b336-4ab9-be9e-e8d8651b15f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc5bda9f41924b59bb7b9ec4dadfe751', 'request_id': 'req-329ea911-b336-4ab9-be9e-e8d8651b15f3'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:35.755292 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-329ea911-b336-4ab9-be9e-e8d8651b15f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc5bda9f41924b59bb7b9ec4dadfe751', 'request_id': 'req-329ea911-b336-4ab9-be9e-e8d8651b15f3'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:35.762489 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-329ea911-b336-4ab9-be9e-e8d8651b15f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc5bda9f41924b59bb7b9ec4dadfe751', 'request_id': 'req-329ea911-b336-4ab9-be9e-e8d8651b15f3'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:35.779788 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-329ea911-b336-4ab9-be9e-e8d8651b15f3 admin admin] The token cache is being invalidate because project dc5bda9f41924b59bb7b9ec4dadfe751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:35.780077 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-329ea911-b336-4ab9-be9e-e8d8651b15f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:35.780884 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-329ea911-b336-4ab9-be9e-e8d8651b15f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:35.786670 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1058/2126] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:35 2021] DELETE /identity/v3/projects/dc5bda9f41924b59bb7b9ec4dadfe751 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:35.786670 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ea911-b336-4ab9-be9e-e8d8651b15f3 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:35.788113 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-329ea911-b336-4ab9-be9e-e8d8651b15f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:35.817870 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60c70c-6004-4941-a310-29000cbd758d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:35.820948 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60c70c-6004-4941-a310-29000cbd758d service nova] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:35.832240 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1069/2127] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:35 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:35.834148 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ebe92-3431-4c3c-be37-7394d344d8ca None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:35.834552 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ebe92-3431-4c3c-be37-7394d344d8ca None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:35.834941 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ebe92-3431-4c3c-be37-7394d344d8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:35.865171 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-276ebe92-3431-4c3c-be37-7394d344d8ca None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:35.866797 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-276ebe92-3431-4c3c-be37-7394d344d8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:35.905867 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ea911-b336-4ab9-be9e-e8d8651b15f3 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:35.911801 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c298b4-4f33-4619-b4a7-9a908bb9bf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:35.912489 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c298b4-4f33-4619-b4a7-9a908bb9bf27 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:35.912816 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c298b4-4f33-4619-b4a7-9a908bb9bf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:35.913179 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c298b4-4f33-4619-b4a7-9a908bb9bf27 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:35.914320 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c298b4-4f33-4619-b4a7-9a908bb9bf27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:35.916718 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c298b4-4f33-4619-b4a7-9a908bb9bf27 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:35.931675 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1059/2128] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:35 2021] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:35.933180 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c298b4-4f33-4619-b4a7-9a908bb9bf27 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:35.944139 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c298b4-4f33-4619-b4a7-9a908bb9bf27 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:35.951013 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dde61e-47e2-4361-8b36-578172742982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:35.951847 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dde61e-47e2-4361-8b36-578172742982 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:35.952138 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dde61e-47e2-4361-8b36-578172742982 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:35.952420 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dde61e-47e2-4361-8b36-578172742982 admin admin] PATH_INFO: `/v3/projects/d451c2c895d8454a942152eaee68dac1/users/d48dc80a6511424dbe1b32d767c22fdd/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:35.967522 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1070/2129] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:35.975233 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055d37f-5667-4184-9046-d7fbc29daae9 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:35.975540 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055d37f-5667-4184-9046-d7fbc29daae9 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:35.975849 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055d37f-5667-4184-9046-d7fbc29daae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:35.979224 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dde61e-47e2-4361-8b36-578172742982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d451c2c895d8454a942152eaee68dac1, user_id=d48dc80a6511424dbe1b32d767c22fdd, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:35.984663 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dde61e-47e2-4361-8b36-578172742982 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:36.006053 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1060/2130] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:35 2021] PUT /identity/v3/projects/d451c2c895d8454a942152eaee68dac1/users/d48dc80a6511424dbe1b32d767c22fdd/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:36.010272 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dde61e-47e2-4361-8b36-578172742982 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:36.023445 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-f055d37f-5667-4184-9046-d7fbc29daae9 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:36.024713 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-f055d37f-5667-4184-9046-d7fbc29daae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:36.128064 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dde61e-47e2-4361-8b36-578172742982 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:36.134803 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74238484-795d-44a4-bca6-1c6960ec4c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:36.135560 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74238484-795d-44a4-bca6-1c6960ec4c1f admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:36.135901 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74238484-795d-44a4-bca6-1c6960ec4c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:36.136200 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74238484-795d-44a4-bca6-1c6960ec4c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:36.137302 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74238484-795d-44a4-bca6-1c6960ec4c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:36.139559 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74238484-795d-44a4-bca6-1c6960ec4c1f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:36.156034 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1061/2131] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:36 2021] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:40:36.156963 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74238484-795d-44a4-bca6-1c6960ec4c1f admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:36.157487 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1071/2132] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:36.161422 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055d37f-5667-4184-9046-d7fbc29daae9 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:36.168006 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74238484-795d-44a4-bca6-1c6960ec4c1f admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:36.174459 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788216f8-9703-4e4b-be04-71200eafefac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:36.175351 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788216f8-9703-4e4b-be04-71200eafefac admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:36.175635 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788216f8-9703-4e4b-be04-71200eafefac admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:36.176051 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788216f8-9703-4e4b-be04-71200eafefac admin admin] PATH_INFO: `/v3/projects/d451c2c895d8454a942152eaee68dac1/users/d48dc80a6511424dbe1b32d767c22fdd/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:36.178449 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055d37f-5667-4184-9046-d7fbc29daae9 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:36.178604 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788216f8-9703-4e4b-be04-71200eafefac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d451c2c895d8454a942152eaee68dac1, user_id=d48dc80a6511424dbe1b32d767c22fdd, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:36.183087 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788216f8-9703-4e4b-be04-71200eafefac admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:36.188026 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba735b-3d9a-4eea-9ada-0981f55c3271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:36.188755 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba735b-3d9a-4eea-9ada-0981f55c3271 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:36.192177 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba735b-3d9a-4eea-9ada-0981f55c3271 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:36.192620 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba735b-3d9a-4eea-9ada-0981f55c3271 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:36.193395 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba735b-3d9a-4eea-9ada-0981f55c3271 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:40:36.193716 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba735b-3d9a-4eea-9ada-0981f55c3271 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:36.198218 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba735b-3d9a-4eea-9ada-0981f55c3271 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:36.204662 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1062/2133] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:36 2021] PUT /identity/v3/projects/d451c2c895d8454a942152eaee68dac1/users/d48dc80a6511424dbe1b32d767c22fdd/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:36.227072 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788216f8-9703-4e4b-be04-71200eafefac admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:36.232427 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-788216f8-9703-4e4b-be04-71200eafefac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:36.233904 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1072/2134] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:40:36.236926 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba735b-3d9a-4eea-9ada-0981f55c3271 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:36.251130 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba735b-3d9a-4eea-9ada-0981f55c3271 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:36.337413 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f95b5b-44ab-40c6-a00a-9d0a13b00fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:36.338318 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f95b5b-44ab-40c6-a00a-9d0a13b00fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:36.338627 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f95b5b-44ab-40c6-a00a-9d0a13b00fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:36.338986 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f95b5b-44ab-40c6-a00a-9d0a13b00fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:36.339631 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f95b5b-44ab-40c6-a00a-9d0a13b00fa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:36.339895 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788216f8-9703-4e4b-be04-71200eafefac admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:36.344932 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b4ec8-370c-4af0-b9cc-45f17fa4af57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:36.346105 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b4ec8-370c-4af0-b9cc-45f17fa4af57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:36.346533 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b4ec8-370c-4af0-b9cc-45f17fa4af57 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:36.346646 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f95b5b-44ab-40c6-a00a-9d0a13b00fa3 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:36.346822 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b4ec8-370c-4af0-b9cc-45f17fa4af57 admin admin] PATH_INFO: `/v3/projects/201ce4c2498b4ae6aefcc45874909ffa` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:36.348069 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b4ec8-370c-4af0-b9cc-45f17fa4af57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=201ce4c2498b4ae6aefcc45874909ffa)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:36.350044 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b4ec8-370c-4af0-b9cc-45f17fa4af57 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:36.403261 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1073/2135] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:36 2021] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:36.407831 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f95b5b-44ab-40c6-a00a-9d0a13b00fa3 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:36.445245 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-472b4ec8-370c-4af0-b9cc-45f17fa4af57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '201ce4c2498b4ae6aefcc45874909ffa', 'request_id': 'req-472b4ec8-370c-4af0-b9cc-45f17fa4af57'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:36.457995 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-472b4ec8-370c-4af0-b9cc-45f17fa4af57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '201ce4c2498b4ae6aefcc45874909ffa', 'request_id': 'req-472b4ec8-370c-4af0-b9cc-45f17fa4af57'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:36.464287 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-472b4ec8-370c-4af0-b9cc-45f17fa4af57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '201ce4c2498b4ae6aefcc45874909ffa', 'request_id': 'req-472b4ec8-370c-4af0-b9cc-45f17fa4af57'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:36.488884 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-472b4ec8-370c-4af0-b9cc-45f17fa4af57 admin admin] The token cache is being invalidate because project 201ce4c2498b4ae6aefcc45874909ffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:36.489305 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-472b4ec8-370c-4af0-b9cc-45f17fa4af57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:36.490076 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-472b4ec8-370c-4af0-b9cc-45f17fa4af57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:36.491914 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1063/2136] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:36 2021] DELETE /identity/v3/projects/201ce4c2498b4ae6aefcc45874909ffa => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:36.497629 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5650e-b3fd-455f-b9b3-4e85cfa1be95 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:36.502064 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5650e-b3fd-455f-b9b3-4e85cfa1be95 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:36.502436 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5650e-b3fd-455f-b9b3-4e85cfa1be95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:36.549457 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-fdf5650e-b3fd-455f-b9b3-4e85cfa1be95 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:36.550745 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f95b5b-44ab-40c6-a00a-9d0a13b00fa3 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:36.553930 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-fdf5650e-b3fd-455f-b9b3-4e85cfa1be95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:36.658703 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1064/2137] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:36.667082 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1396867-c624-46d6-918f-e4718819914f None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:36.667651 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1396867-c624-46d6-918f-e4718819914f None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:36.668094 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1396867-c624-46d6-918f-e4718819914f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:36.673101 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86ee44-4305-4a23-89b2-ed15ceb9bc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:36.673760 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86ee44-4305-4a23-89b2-ed15ceb9bc13 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:36.674602 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86ee44-4305-4a23-89b2-ed15ceb9bc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:36.675104 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86ee44-4305-4a23-89b2-ed15ceb9bc13 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:36.675963 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86ee44-4305-4a23-89b2-ed15ceb9bc13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:36.678250 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86ee44-4305-4a23-89b2-ed15ceb9bc13 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:36.702584 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-d1396867-c624-46d6-918f-e4718819914f None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:36.704199 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-d1396867-c624-46d6-918f-e4718819914f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:36.704951 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1074/2138] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:36 2021] POST /identity/v3/users => generated 289 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:36.708742 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86ee44-4305-4a23-89b2-ed15ceb9bc13 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:36.711451 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-ee86ee44-4305-4a23-89b2-ed15ceb9bc13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:36.714494 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1065/2139] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:36.719349 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1396867-c624-46d6-918f-e4718819914f None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:36.739622 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86ee44-4305-4a23-89b2-ed15ceb9bc13 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:36.740492 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1396867-c624-46d6-918f-e4718819914f None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:36.745595 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b774919-ff6e-4211-b11b-72c150ee1ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:36.746393 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b774919-ff6e-4211-b11b-72c150ee1ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:36.746747 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b774919-ff6e-4211-b11b-72c150ee1ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:36.747099 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b774919-ff6e-4211-b11b-72c150ee1ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:36.747934 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b774919-ff6e-4211-b11b-72c150ee1ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:36.749811 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b774919-ff6e-4211-b11b-72c150ee1ff4 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:36.754032 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b24589-29c3-4147-bd7e-2df327b566c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:36.754448 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b24589-29c3-4147-bd7e-2df327b566c6 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:36.754747 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b24589-29c3-4147-bd7e-2df327b566c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:36.755034 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b24589-29c3-4147-bd7e-2df327b566c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:36.755743 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b24589-29c3-4147-bd7e-2df327b566c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:40:36.756287 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b24589-29c3-4147-bd7e-2df327b566c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:36.758266 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b24589-29c3-4147-bd7e-2df327b566c6 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:36.764617 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1075/2140] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:36 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:40:36.765695 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b774919-ff6e-4211-b11b-72c150ee1ff4 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:36.775266 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1066/2141] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:40:36.778087 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b774919-ff6e-4211-b11b-72c150ee1ff4 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:36.780156 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b24589-29c3-4147-bd7e-2df327b566c6 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:36.783031 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97604757-f24f-4f52-b1cd-89d078c7e03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:36.783760 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97604757-f24f-4f52-b1cd-89d078c7e03c admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:36.784818 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97604757-f24f-4f52-b1cd-89d078c7e03c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:36.785190 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97604757-f24f-4f52-b1cd-89d078c7e03c admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:36.785996 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97604757-f24f-4f52-b1cd-89d078c7e03c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:36.787684 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97604757-f24f-4f52-b1cd-89d078c7e03c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:36.793278 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b24589-29c3-4147-bd7e-2df327b566c6 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:36.799826 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69110ed1-3100-4602-8e2a-c98055a07a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:36.800626 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69110ed1-3100-4602-8e2a-c98055a07a2d admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:36.801247 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69110ed1-3100-4602-8e2a-c98055a07a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:36.801663 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69110ed1-3100-4602-8e2a-c98055a07a2d admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:36.802483 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1076/2142] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:36 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:36.802710 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69110ed1-3100-4602-8e2a-c98055a07a2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:36.803599 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97604757-f24f-4f52-b1cd-89d078c7e03c admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:36.805144 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69110ed1-3100-4602-8e2a-c98055a07a2d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:36.850567 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97604757-f24f-4f52-b1cd-89d078c7e03c admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:36.859425 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef7848-d284-4d21-8d20-254fbe313966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:36.860266 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef7848-d284-4d21-8d20-254fbe313966 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:36.860560 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef7848-d284-4d21-8d20-254fbe313966 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:36.860875 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef7848-d284-4d21-8d20-254fbe313966 admin admin] PATH_INFO: `/v3/projects/cd04f3d6f9ef4788bb01db0c11ba554f/users/cb0d5bf878154c6fa174db6389f2ea70/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:36.864313 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1067/2143] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:36 2021] POST /identity/v3/projects => generated 377 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:36.869527 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69110ed1-3100-4602-8e2a-c98055a07a2d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:36.914359 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef7848-d284-4d21-8d20-254fbe313966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd04f3d6f9ef4788bb01db0c11ba554f, user_id=cb0d5bf878154c6fa174db6389f2ea70, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:36.919241 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef7848-d284-4d21-8d20-254fbe313966 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:36.941073 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1077/2144] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:36 2021] PUT /identity/v3/projects/cd04f3d6f9ef4788bb01db0c11ba554f/users/cb0d5bf878154c6fa174db6389f2ea70/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:36.946697 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9feaac-82f4-4793-8c34-2182aa6e0fa0 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:36.947103 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9feaac-82f4-4793-8c34-2182aa6e0fa0 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:36.947728 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9feaac-82f4-4793-8c34-2182aa6e0fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:36.988863 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-9a9feaac-82f4-4793-8c34-2182aa6e0fa0 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:36.990453 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-9a9feaac-82f4-4793-8c34-2182aa6e0fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:36.999923 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69110ed1-3100-4602-8e2a-c98055a07a2d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:37.092840 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1078/2145] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:37.101108 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9feaac-82f4-4793-8c34-2182aa6e0fa0 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:37.102637 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-9a9feaac-82f4-4793-8c34-2182aa6e0fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:37.129533 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d863b65-99ad-4cbc-9c01-ae4c05c6ec65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:37.130276 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d863b65-99ad-4cbc-9c01-ae4c05c6ec65 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:37.130729 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d863b65-99ad-4cbc-9c01-ae4c05c6ec65 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:37.131013 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d863b65-99ad-4cbc-9c01-ae4c05c6ec65 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:37.131663 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d863b65-99ad-4cbc-9c01-ae4c05c6ec65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:37.140918 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d863b65-99ad-4cbc-9c01-ae4c05c6ec65 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:37.172171 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1068/2146] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:36 2021] POST /identity/v3/users => generated 289 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:37.173142 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d863b65-99ad-4cbc-9c01-ae4c05c6ec65 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:37.183834 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d863b65-99ad-4cbc-9c01-ae4c05c6ec65 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:37.189448 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b0fee-0e6e-4d44-a92a-36b87f95af95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:37.190125 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b0fee-0e6e-4d44-a92a-36b87f95af95 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:37.191425 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b0fee-0e6e-4d44-a92a-36b87f95af95 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:37.191425 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b0fee-0e6e-4d44-a92a-36b87f95af95 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:37.192288 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b0fee-0e6e-4d44-a92a-36b87f95af95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:37.195314 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b0fee-0e6e-4d44-a92a-36b87f95af95 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:37.204405 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9feaac-82f4-4793-8c34-2182aa6e0fa0 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:37.213861 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56376c5b-59c5-4463-88c5-986cdcf3dbc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:37.214777 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56376c5b-59c5-4463-88c5-986cdcf3dbc4 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:37.215288 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56376c5b-59c5-4463-88c5-986cdcf3dbc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:37.215754 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56376c5b-59c5-4463-88c5-986cdcf3dbc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:37.229198 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56376c5b-59c5-4463-88c5-986cdcf3dbc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:37.230897 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1069/2147] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:37 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:37.233556 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56376c5b-59c5-4463-88c5-986cdcf3dbc4 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:37.237224 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b0fee-0e6e-4d44-a92a-36b87f95af95 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:37.255356 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b0fee-0e6e-4d44-a92a-36b87f95af95 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:37.262230 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32458352-68ce-450e-bdd6-53c821edc66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:37.262974 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32458352-68ce-450e-bdd6-53c821edc66f admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:37.263367 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32458352-68ce-450e-bdd6-53c821edc66f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:37.264153 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32458352-68ce-450e-bdd6-53c821edc66f admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:37.265638 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32458352-68ce-450e-bdd6-53c821edc66f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:37.267757 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32458352-68ce-450e-bdd6-53c821edc66f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:37.269874 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1079/2148] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:37 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:37.295754 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1070/2149] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:37 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:37.299537 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56376c5b-59c5-4463-88c5-986cdcf3dbc4 service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:37.313580 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56376c5b-59c5-4463-88c5-986cdcf3dbc4 service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:37.319033 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d1937-1174-4269-a08a-57cf9f46207a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:37.321359 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d1937-1174-4269-a08a-57cf9f46207a admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:37.321359 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d1937-1174-4269-a08a-57cf9f46207a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:37.321903 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d1937-1174-4269-a08a-57cf9f46207a admin admin] PATH_INFO: `/v3/projects/bd2467af44a546ae9a2edd7785aba38f/users/a1f8d472f75e4eba8277da67b84e8e15/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:37.376831 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d1937-1174-4269-a08a-57cf9f46207a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd2467af44a546ae9a2edd7785aba38f, user_id=a1f8d472f75e4eba8277da67b84e8e15, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:37.380224 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d1937-1174-4269-a08a-57cf9f46207a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:37.392322 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a3f77-0c94-457d-94cf-97bc195f5a36 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:37.392754 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a3f77-0c94-457d-94cf-97bc195f5a36 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:37.393116 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a3f77-0c94-457d-94cf-97bc195f5a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:37.405453 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1080/2150] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:37 2021] PUT /identity/v3/projects/bd2467af44a546ae9a2edd7785aba38f/users/a1f8d472f75e4eba8277da67b84e8e15/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:37.418446 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb082ba-a860-4ec3-a82f-2621d2051e73 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:37.419134 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb082ba-a860-4ec3-a82f-2621d2051e73 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:37.419639 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb082ba-a860-4ec3-a82f-2621d2051e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:37.448477 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-4d9a3f77-0c94-457d-94cf-97bc195f5a36 None None] MFA Rules not processed for user `d48dc80a6511424dbe1b32d767c22fdd`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:37.451470 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-4d9a3f77-0c94-457d-94cf-97bc195f5a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:37.526352 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-8fb082ba-a860-4ec3-a82f-2621d2051e73 None None] MFA Rules not processed for user `a1f8d472f75e4eba8277da67b84e8e15`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:37.527603 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-8fb082ba-a860-4ec3-a82f-2621d2051e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:37.586527 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1071/2151] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:37 2021] POST /identity/v3/auth/tokens => generated 3747 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:37.594114 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a3f77-0c94-457d-94cf-97bc195f5a36 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:37.595812 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-4d9a3f77-0c94-457d-94cf-97bc195f5a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:37.685827 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1081/2152] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:37 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:37.687161 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb082ba-a860-4ec3-a82f-2621d2051e73 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:37.750188 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a3f77-0c94-457d-94cf-97bc195f5a36 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:37.763858 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cd1d8-426b-460e-8cdd-226fdf959d5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:37.765264 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cd1d8-426b-460e-8cdd-226fdf959d5c service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:37.766006 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cd1d8-426b-460e-8cdd-226fdf959d5c service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:37.766621 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cd1d8-426b-460e-8cdd-226fdf959d5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:37.769818 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-405cd1d8-426b-460e-8cdd-226fdf959d5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:37.793636 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb082ba-a860-4ec3-a82f-2621d2051e73 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:37.821363 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd1e26-798a-4055-8d57-64c0047589ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:37.822237 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd1e26-798a-4055-8d57-64c0047589ff admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:37.822755 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd1e26-798a-4055-8d57-64c0047589ff admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:37.823337 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd1e26-798a-4055-8d57-64c0047589ff admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:37.824211 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd1e26-798a-4055-8d57-64c0047589ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:37.828071 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd1e26-798a-4055-8d57-64c0047589ff admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:37.888418 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1082/2153] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:37 2021] POST /identity/v3/projects => generated 375 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:37.889532 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd1e26-798a-4055-8d57-64c0047589ff admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:37.966420 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405cd1d8-426b-460e-8cdd-226fdf959d5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:37.967868 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405cd1d8-426b-460e-8cdd-226fdf959d5c service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:37.982698 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1072/2154] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:37 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:38.017985 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd1e26-798a-4055-8d57-64c0047589ff admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:38.023648 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1d933-2d96-4e7f-a8d8-637b01c0097b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:38.024532 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1d933-2d96-4e7f-a8d8-637b01c0097b admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:38.024762 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1d933-2d96-4e7f-a8d8-637b01c0097b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:38.025123 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1d933-2d96-4e7f-a8d8-637b01c0097b admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:38.025776 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1d933-2d96-4e7f-a8d8-637b01c0097b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:38.028622 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1d933-2d96-4e7f-a8d8-637b01c0097b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:38.058172 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1083/2155] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:37 2021] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:38.059528 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cd1d8-426b-460e-8cdd-226fdf959d5c service cinder] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:38.085136 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cd1d8-426b-460e-8cdd-226fdf959d5c service cinder] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:38.091767 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1bbbd-fa95-48dc-a097-dd1c99b88c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:38.092442 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1bbbd-fa95-48dc-a097-dd1c99b88c4f admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:38.092740 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1bbbd-fa95-48dc-a097-dd1c99b88c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:38.093230 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1bbbd-fa95-48dc-a097-dd1c99b88c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:38.094172 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1bbbd-fa95-48dc-a097-dd1c99b88c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:38.096354 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1bbbd-fa95-48dc-a097-dd1c99b88c4f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:38.115445 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1073/2156] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:38 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:38.119442 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1d933-2d96-4e7f-a8d8-637b01c0097b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:38.139025 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1d933-2d96-4e7f-a8d8-637b01c0097b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:38.151275 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f010352-4ee4-4869-999c-59973dd903f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:38.152670 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f010352-4ee4-4869-999c-59973dd903f7 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:38.152670 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f010352-4ee4-4869-999c-59973dd903f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:38.152670 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f010352-4ee4-4869-999c-59973dd903f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:38.153325 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f010352-4ee4-4869-999c-59973dd903f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:38.155054 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f010352-4ee4-4869-999c-59973dd903f7 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:38.181232 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1084/2157] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:38 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:38.183192 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1bbbd-fa95-48dc-a097-dd1c99b88c4f admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:38.197825 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1bbbd-fa95-48dc-a097-dd1c99b88c4f admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:38.212707 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db8617-bfcd-41cf-bff8-0512058bbf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:38.214164 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db8617-bfcd-41cf-bff8-0512058bbf3d admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:38.214638 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db8617-bfcd-41cf-bff8-0512058bbf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:38.214924 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db8617-bfcd-41cf-bff8-0512058bbf3d admin admin] PATH_INFO: `/v3/projects/dc158c82a49e410e9fc7c465f7db03a6/users/c8ca8adce9704d3ba94a7d642ebaca03/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:38.257426 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db8617-bfcd-41cf-bff8-0512058bbf3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc158c82a49e410e9fc7c465f7db03a6, user_id=c8ca8adce9704d3ba94a7d642ebaca03, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:38.261638 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db8617-bfcd-41cf-bff8-0512058bbf3d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:38.285019 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1074/2158] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:38 2021] PUT /identity/v3/projects/dc158c82a49e410e9fc7c465f7db03a6/users/c8ca8adce9704d3ba94a7d642ebaca03/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:38.294066 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde5e45-141a-45d4-947d-1a2e7c712bf9 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:38.294747 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde5e45-141a-45d4-947d-1a2e7c712bf9 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:38.295306 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde5e45-141a-45d4-947d-1a2e7c712bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:38.357409 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-3fde5e45-141a-45d4-947d-1a2e7c712bf9 None None] MFA Rules not processed for user `c8ca8adce9704d3ba94a7d642ebaca03`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:38.358683 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-3fde5e45-141a-45d4-947d-1a2e7c712bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:38.487067 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1085/2159] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:38 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:38.491277 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db8617-bfcd-41cf-bff8-0512058bbf3d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:38.620193 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db8617-bfcd-41cf-bff8-0512058bbf3d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:38.641976 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860aff0-e8c4-4367-8902-766b2069853c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:38.644495 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860aff0-e8c4-4367-8902-766b2069853c admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:38.645718 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860aff0-e8c4-4367-8902-766b2069853c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:38.646107 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860aff0-e8c4-4367-8902-766b2069853c admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:38.649955 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860aff0-e8c4-4367-8902-766b2069853c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:38.654206 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860aff0-e8c4-4367-8902-766b2069853c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:38.744983 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1075/2160] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:38 2021] POST /identity/v3/projects => generated 375 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:38.754143 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde5e45-141a-45d4-947d-1a2e7c712bf9 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:38.775121 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde5e45-141a-45d4-947d-1a2e7c712bf9 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:38.838366 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633e7ff-8db0-4131-a821-bf3f45e75fd8 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:38.839391 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633e7ff-8db0-4131-a821-bf3f45e75fd8 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:38.841274 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633e7ff-8db0-4131-a821-bf3f45e75fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:38.914570 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-4633e7ff-8db0-4131-a821-bf3f45e75fd8 None None] MFA Rules not processed for user `cb0d5bf878154c6fa174db6389f2ea70`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:38.916739 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-4633e7ff-8db0-4131-a821-bf3f45e75fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:38.939523 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03bd05-479e-47b6-9ce7-324ee52c18d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:38.940408 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03bd05-479e-47b6-9ce7-324ee52c18d5 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:38.940863 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03bd05-479e-47b6-9ce7-324ee52c18d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:38.941287 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03bd05-479e-47b6-9ce7-324ee52c18d5 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:38.942076 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03bd05-479e-47b6-9ce7-324ee52c18d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:38.944259 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03bd05-479e-47b6-9ce7-324ee52c18d5 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:38.987765 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1086/2161] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:38 2021] POST /identity/v3/users => generated 294 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:38.989358 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03bd05-479e-47b6-9ce7-324ee52c18d5 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:39.000257 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03bd05-479e-47b6-9ce7-324ee52c18d5 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:39.006181 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b638b53-5883-4629-ba34-a09219666975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:39.007296 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b638b53-5883-4629-ba34-a09219666975 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:39.007590 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b638b53-5883-4629-ba34-a09219666975 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:39.007871 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b638b53-5883-4629-ba34-a09219666975 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:39.008575 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b638b53-5883-4629-ba34-a09219666975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:39.010283 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b638b53-5883-4629-ba34-a09219666975 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:39.025205 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1076/2162] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:38 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:39.026286 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1087/2163] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:38 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:39.027253 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633e7ff-8db0-4131-a821-bf3f45e75fd8 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:39.034730 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b638b53-5883-4629-ba34-a09219666975 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:39.042018 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633e7ff-8db0-4131-a821-bf3f45e75fd8 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:39.048287 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ece25-b1c9-470d-ba6e-8b0cc7303368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:39.049341 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ece25-b1c9-470d-ba6e-8b0cc7303368 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:39.049703 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ece25-b1c9-470d-ba6e-8b0cc7303368 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:39.050053 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ece25-b1c9-470d-ba6e-8b0cc7303368 admin admin] PATH_INFO: `/v3/projects/56aac780aa4542d3a29f9614097c428f/users/0dcc463f8f224468a7eb81e59f5c5ba9/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:39.189697 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ece25-b1c9-470d-ba6e-8b0cc7303368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56aac780aa4542d3a29f9614097c428f, user_id=0dcc463f8f224468a7eb81e59f5c5ba9, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:39.192502 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ece25-b1c9-470d-ba6e-8b0cc7303368 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:39.214574 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1077/2164] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:39 2021] PUT /identity/v3/projects/56aac780aa4542d3a29f9614097c428f/users/0dcc463f8f224468a7eb81e59f5c5ba9/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:39.218605 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ece25-b1c9-470d-ba6e-8b0cc7303368 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:39.254922 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b638b53-5883-4629-ba34-a09219666975 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:39.318829 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ece25-b1c9-470d-ba6e-8b0cc7303368 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:39.330442 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bf775-84c0-4b99-862d-21a5b179b75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:39.331095 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bf775-84c0-4b99-862d-21a5b179b75a admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:39.331386 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bf775-84c0-4b99-862d-21a5b179b75a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:39.331660 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bf775-84c0-4b99-862d-21a5b179b75a admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:39.332382 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bf775-84c0-4b99-862d-21a5b179b75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:39.334319 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bf775-84c0-4b99-862d-21a5b179b75a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:39.336210 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e355cf-7555-4874-b831-1ff8d3eba863 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:39.337837 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e355cf-7555-4874-b831-1ff8d3eba863 service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:39.337837 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e355cf-7555-4874-b831-1ff8d3eba863 service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:39.337837 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e355cf-7555-4874-b831-1ff8d3eba863 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:39.349632 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1078/2165] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:39 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:40:39.352504 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bf775-84c0-4b99-862d-21a5b179b75a admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:39.364705 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bf775-84c0-4b99-862d-21a5b179b75a admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:39.369473 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2160a-e78a-4e91-990c-8148197a3b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:39.370289 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2160a-e78a-4e91-990c-8148197a3b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:39.370582 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2160a-e78a-4e91-990c-8148197a3b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:39.370870 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2160a-e78a-4e91-990c-8148197a3b50 admin admin] PATH_INFO: `/v3/projects/56aac780aa4542d3a29f9614097c428f/users/0dcc463f8f224468a7eb81e59f5c5ba9/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:39.372686 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2160a-e78a-4e91-990c-8148197a3b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56aac780aa4542d3a29f9614097c428f, user_id=0dcc463f8f224468a7eb81e59f5c5ba9, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:39.375560 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2160a-e78a-4e91-990c-8148197a3b50 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:39.387933 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1079/2166] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:39 2021] PUT /identity/v3/projects/56aac780aa4542d3a29f9614097c428f/users/0dcc463f8f224468a7eb81e59f5c5ba9/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:39.398850 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e9455-cc38-4005-91ac-ed43ccfae75f None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:39.399400 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e9455-cc38-4005-91ac-ed43ccfae75f None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:39.399738 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e9455-cc38-4005-91ac-ed43ccfae75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:39.427474 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e355cf-7555-4874-b831-1ff8d3eba863 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:39.430301 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e355cf-7555-4874-b831-1ff8d3eba863 service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:39.449706 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1088/2167] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:39 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:40:39.463524 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-dd7e9455-cc38-4005-91ac-ed43ccfae75f None None] MFA Rules not processed for user `0dcc463f8f224468a7eb81e59f5c5ba9`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:39.464713 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-dd7e9455-cc38-4005-91ac-ed43ccfae75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:39.610323 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1080/2168] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:39 2021] POST /identity/v3/auth/tokens => generated 3749 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:39.621715 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e355cf-7555-4874-b831-1ff8d3eba863 service cinder] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:39.623770 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-08e355cf-7555-4874-b831-1ff8d3eba863 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:39.636126 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e355cf-7555-4874-b831-1ff8d3eba863 service cinder] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:39.713927 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddf45e-0bea-45ca-ae42-1a4bba8284ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:39.714525 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddf45e-0bea-45ca-ae42-1a4bba8284ef service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:39.714868 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddf45e-0bea-45ca-ae42-1a4bba8284ef service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:39.715156 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddf45e-0bea-45ca-ae42-1a4bba8284ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:39.789833 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddf45e-0bea-45ca-ae42-1a4bba8284ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:39.791503 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddf45e-0bea-45ca-ae42-1a4bba8284ef service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:39.804027 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1089/2169] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:39 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:40.112279 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e9455-cc38-4005-91ac-ed43ccfae75f None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:40.123948 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e9455-cc38-4005-91ac-ed43ccfae75f None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:40.129684 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905b751-400d-422f-8eba-02d0c88ac32a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:40.130268 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905b751-400d-422f-8eba-02d0c88ac32a service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:40.130560 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905b751-400d-422f-8eba-02d0c88ac32a service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:40.130885 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905b751-400d-422f-8eba-02d0c88ac32a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:40.207869 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905b751-400d-422f-8eba-02d0c88ac32a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:40.208339 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905b751-400d-422f-8eba-02d0c88ac32a service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:40.218618 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1081/2170] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:40 2021] GET /identity/v3/auth/tokens => generated 3747 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:41.221439 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad119d-e5e5-4251-a56c-b85e2089a46c None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:41.221977 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad119d-e5e5-4251-a56c-b85e2089a46c None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:41.221977 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad119d-e5e5-4251-a56c-b85e2089a46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:41.248818 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-b3ad119d-e5e5-4251-a56c-b85e2089a46c None None] MFA Rules not processed for user `cb0d5bf878154c6fa174db6389f2ea70`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:41.249998 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-b3ad119d-e5e5-4251-a56c-b85e2089a46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:41.333460 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1090/2171] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:41 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:41.782632 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905b751-400d-422f-8eba-02d0c88ac32a service cinder] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:41.791354 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905b751-400d-422f-8eba-02d0c88ac32a service cinder] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:41.795575 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1bf84-e010-4ce4-b921-3a8c52391b0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:41.796207 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1bf84-e010-4ce4-b921-3a8c52391b0a service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:41.796523 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1bf84-e010-4ce4-b921-3a8c52391b0a service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:41.796890 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1bf84-e010-4ce4-b921-3a8c52391b0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:41.889337 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1bf84-e010-4ce4-b921-3a8c52391b0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:41.891548 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1bf84-e010-4ce4-b921-3a8c52391b0a service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:41.906530 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1082/2172] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:41 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:42.006631 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbefc59-de51-4ab9-911a-b01ad590e3e2 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:42.006927 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbefc59-de51-4ab9-911a-b01ad590e3e2 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:42.007244 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbefc59-de51-4ab9-911a-b01ad590e3e2 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:42.009049 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1091/2173] 10.222.0.64 () {54 vars in 912 bytes} [Thu Dec 16 14:40:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:40:42.014796 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257a183-8641-4763-9559-5d441720afb5 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:42.015098 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257a183-8641-4763-9559-5d441720afb5 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:42.015386 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257a183-8641-4763-9559-5d441720afb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:42.046966 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-f257a183-8641-4763-9559-5d441720afb5 None None] MFA Rules not processed for user `34e25627f3384826b35caf92a804c6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:42.048149 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-f257a183-8641-4763-9559-5d441720afb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:42.129474 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1083/2174] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Dec 16 14:40:42 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:42.178049 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbefc59-de51-4ab9-911a-b01ad590e3e2 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:42.178049 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-ebbefc59-de51-4ab9-911a-b01ad590e3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:42.201967 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbefc59-de51-4ab9-911a-b01ad590e3e2 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:42.215546 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d1679-5fc9-4ef9-842e-bc65ccbddbdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:42.216298 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d1679-5fc9-4ef9-842e-bc65ccbddbdb service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:42.216654 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d1679-5fc9-4ef9-842e-bc65ccbddbdb service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:42.217030 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d1679-5fc9-4ef9-842e-bc65ccbddbdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:42.227136 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d1679-5fc9-4ef9-842e-bc65ccbddbdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:42.229322 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d1679-5fc9-4ef9-842e-bc65ccbddbdb service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:42.242965 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1092/2175] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:42 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:42.934235 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257a183-8641-4763-9559-5d441720afb5 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:42.946511 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257a183-8641-4763-9559-5d441720afb5 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:42.965973 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca023f4c-8966-47f2-b415-598f52fd3278 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:42.966747 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca023f4c-8966-47f2-b415-598f52fd3278 service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:42.967142 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca023f4c-8966-47f2-b415-598f52fd3278 service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:42.967526 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca023f4c-8966-47f2-b415-598f52fd3278 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:42.987863 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca023f4c-8966-47f2-b415-598f52fd3278 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:42.990847 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca023f4c-8966-47f2-b415-598f52fd3278 service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:43.020097 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1084/2176] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:42 2021] GET /identity/v3/auth/tokens => generated 3749 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:47.853243 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d1679-5fc9-4ef9-842e-bc65ccbddbdb service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:47.958109 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d1679-5fc9-4ef9-842e-bc65ccbddbdb service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:47.970081 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8c924-d135-4f40-be25-7e48f6baa96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:47.971040 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8c924-d135-4f40-be25-7e48f6baa96b admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:47.971493 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8c924-d135-4f40-be25-7e48f6baa96b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:47.972000 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8c924-d135-4f40-be25-7e48f6baa96b admin admin] PATH_INFO: `/v3/users/a1f8d472f75e4eba8277da67b84e8e15` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:47.973475 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8c924-d135-4f40-be25-7e48f6baa96b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f8d472f75e4eba8277da67b84e8e15)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:47.980599 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8c924-d135-4f40-be25-7e48f6baa96b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:48.065819 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-37e8c924-d135-4f40-be25-7e48f6baa96b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f8d472f75e4eba8277da67b84e8e15'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:48.066516 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-37e8c924-d135-4f40-be25-7e48f6baa96b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f8d472f75e4eba8277da67b84e8e15'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:48.100047 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-37e8c924-d135-4f40-be25-7e48f6baa96b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f8d472f75e4eba8277da67b84e8e15'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:48.132572 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-37e8c924-d135-4f40-be25-7e48f6baa96b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f8d472f75e4eba8277da67b84e8e15'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:48.143502 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-37e8c924-d135-4f40-be25-7e48f6baa96b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f8d472f75e4eba8277da67b84e8e15'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:48.158243 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1093/2177] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:47 2021] DELETE /identity/v3/users/a1f8d472f75e4eba8277da67b84e8e15 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:48.162616 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a94aa-2e32-4b17-a9a0-170829b39430 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:48.163554 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a94aa-2e32-4b17-a9a0-170829b39430 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:48.164071 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a94aa-2e32-4b17-a9a0-170829b39430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:48.214559 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-6c1a94aa-2e32-4b17-a9a0-170829b39430 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:48.216057 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-6c1a94aa-2e32-4b17-a9a0-170829b39430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:48.350505 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1085/2178] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:48.413241 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8c924-d135-4f40-be25-7e48f6baa96b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:48.415030 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-37e8c924-d135-4f40-be25-7e48f6baa96b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:48.544751 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8c924-d135-4f40-be25-7e48f6baa96b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:48.558410 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04615598-c517-4c66-b56e-7304d71dae0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:48.559024 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04615598-c517-4c66-b56e-7304d71dae0f service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:48.559383 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04615598-c517-4c66-b56e-7304d71dae0f service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:48.559713 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04615598-c517-4c66-b56e-7304d71dae0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:48.576828 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04615598-c517-4c66-b56e-7304d71dae0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:48.579781 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04615598-c517-4c66-b56e-7304d71dae0f service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:48.614602 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1094/2179] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:48 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:49.335412 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a94aa-2e32-4b17-a9a0-170829b39430 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:49.336993 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-6c1a94aa-2e32-4b17-a9a0-170829b39430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:49.349250 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a94aa-2e32-4b17-a9a0-170829b39430 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:49.353683 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac35d7-bc33-4c7e-8ab0-185984a1517e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:49.354487 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac35d7-bc33-4c7e-8ab0-185984a1517e admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:49.354761 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac35d7-bc33-4c7e-8ab0-185984a1517e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:49.355198 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac35d7-bc33-4c7e-8ab0-185984a1517e admin admin] PATH_INFO: `/v3/projects/bd2467af44a546ae9a2edd7785aba38f` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:49.356732 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac35d7-bc33-4c7e-8ab0-185984a1517e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd2467af44a546ae9a2edd7785aba38f)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:49.358827 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac35d7-bc33-4c7e-8ab0-185984a1517e admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:49.415691 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-26ac35d7-bc33-4c7e-8ab0-185984a1517e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd2467af44a546ae9a2edd7785aba38f', 'request_id': 'req-26ac35d7-bc33-4c7e-8ab0-185984a1517e'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:49.428805 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-26ac35d7-bc33-4c7e-8ab0-185984a1517e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd2467af44a546ae9a2edd7785aba38f', 'request_id': 'req-26ac35d7-bc33-4c7e-8ab0-185984a1517e'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:49.435013 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-26ac35d7-bc33-4c7e-8ab0-185984a1517e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd2467af44a546ae9a2edd7785aba38f', 'request_id': 'req-26ac35d7-bc33-4c7e-8ab0-185984a1517e'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:49.447953 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-26ac35d7-bc33-4c7e-8ab0-185984a1517e admin admin] The token cache is being invalidate because project bd2467af44a546ae9a2edd7785aba38f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:49.448241 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-26ac35d7-bc33-4c7e-8ab0-185984a1517e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:49.448899 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-26ac35d7-bc33-4c7e-8ab0-185984a1517e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:49.450380 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1086/2180] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:49 2021] DELETE /identity/v3/projects/bd2467af44a546ae9a2edd7785aba38f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:49.454420 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04615598-c517-4c66-b56e-7304d71dae0f service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:49.463863 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04615598-c517-4c66-b56e-7304d71dae0f service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:49.528636 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004aa7f-750c-41c1-8b98-e98765de0ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:49.529551 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004aa7f-750c-41c1-8b98-e98765de0ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:49.529942 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004aa7f-750c-41c1-8b98-e98765de0ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:49.530326 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004aa7f-750c-41c1-8b98-e98765de0ee8 admin admin] PATH_INFO: `/v3/users/c8ca8adce9704d3ba94a7d642ebaca03` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:49.531708 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004aa7f-750c-41c1-8b98-e98765de0ee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8ca8adce9704d3ba94a7d642ebaca03)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:49.534392 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004aa7f-750c-41c1-8b98-e98765de0ee8 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:49.588061 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-2004aa7f-750c-41c1-8b98-e98765de0ee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8ca8adce9704d3ba94a7d642ebaca03'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:49.589593 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-2004aa7f-750c-41c1-8b98-e98765de0ee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8ca8adce9704d3ba94a7d642ebaca03'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:49.603625 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-2004aa7f-750c-41c1-8b98-e98765de0ee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8ca8adce9704d3ba94a7d642ebaca03'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:49.615090 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-2004aa7f-750c-41c1-8b98-e98765de0ee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8ca8adce9704d3ba94a7d642ebaca03'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:49.624096 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-2004aa7f-750c-41c1-8b98-e98765de0ee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8ca8adce9704d3ba94a7d642ebaca03'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:49.630790 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1095/2181] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:49 2021] DELETE /identity/v3/users/c8ca8adce9704d3ba94a7d642ebaca03 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:50.056156 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac35d7-bc33-4c7e-8ab0-185984a1517e admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:50.058524 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-26ac35d7-bc33-4c7e-8ab0-185984a1517e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:50.086796 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac35d7-bc33-4c7e-8ab0-185984a1517e admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:50.152011 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c601d18-451f-4f7c-b477-1895be6cf9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:50.152802 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c601d18-451f-4f7c-b477-1895be6cf9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:50.153104 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c601d18-451f-4f7c-b477-1895be6cf9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:50.153386 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c601d18-451f-4f7c-b477-1895be6cf9bb admin admin] PATH_INFO: `/v3/projects/dc158c82a49e410e9fc7c465f7db03a6` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:50.154482 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c601d18-451f-4f7c-b477-1895be6cf9bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc158c82a49e410e9fc7c465f7db03a6)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:50.156333 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c601d18-451f-4f7c-b477-1895be6cf9bb admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:50.208890 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-0c601d18-451f-4f7c-b477-1895be6cf9bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc158c82a49e410e9fc7c465f7db03a6', 'request_id': 'req-0c601d18-451f-4f7c-b477-1895be6cf9bb'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:50.223089 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-0c601d18-451f-4f7c-b477-1895be6cf9bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc158c82a49e410e9fc7c465f7db03a6', 'request_id': 'req-0c601d18-451f-4f7c-b477-1895be6cf9bb'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:50.234145 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-0c601d18-451f-4f7c-b477-1895be6cf9bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc158c82a49e410e9fc7c465f7db03a6', 'request_id': 'req-0c601d18-451f-4f7c-b477-1895be6cf9bb'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:50.249691 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-0c601d18-451f-4f7c-b477-1895be6cf9bb admin admin] The token cache is being invalidate because project dc158c82a49e410e9fc7c465f7db03a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:50.250139 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-0c601d18-451f-4f7c-b477-1895be6cf9bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:50.250860 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-0c601d18-451f-4f7c-b477-1895be6cf9bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:50.252473 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1087/2182] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:50 2021] DELETE /identity/v3/projects/dc158c82a49e410e9fc7c465f7db03a6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:50.258032 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004aa7f-750c-41c1-8b98-e98765de0ee8 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:50.260815 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-2004aa7f-750c-41c1-8b98-e98765de0ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:50.277051 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004aa7f-750c-41c1-8b98-e98765de0ee8 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:50.347505 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe34ad1-b9ff-49bf-9605-e6ce2d6414da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:50.348969 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe34ad1-b9ff-49bf-9605-e6ce2d6414da admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:50.348969 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe34ad1-b9ff-49bf-9605-e6ce2d6414da admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:50.348969 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe34ad1-b9ff-49bf-9605-e6ce2d6414da admin admin] PATH_INFO: `/v3/users/0dcc463f8f224468a7eb81e59f5c5ba9` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:50.350272 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe34ad1-b9ff-49bf-9605-e6ce2d6414da admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dcc463f8f224468a7eb81e59f5c5ba9)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:50.352344 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe34ad1-b9ff-49bf-9605-e6ce2d6414da admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:50.407842 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ffe34ad1-b9ff-49bf-9605-e6ce2d6414da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dcc463f8f224468a7eb81e59f5c5ba9'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:50.408524 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ffe34ad1-b9ff-49bf-9605-e6ce2d6414da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dcc463f8f224468a7eb81e59f5c5ba9'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:50.421209 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ffe34ad1-b9ff-49bf-9605-e6ce2d6414da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dcc463f8f224468a7eb81e59f5c5ba9'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:50.430510 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ffe34ad1-b9ff-49bf-9605-e6ce2d6414da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dcc463f8f224468a7eb81e59f5c5ba9'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:50.438590 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ffe34ad1-b9ff-49bf-9605-e6ce2d6414da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dcc463f8f224468a7eb81e59f5c5ba9'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:50.445128 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1096/2183] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:50 2021] DELETE /identity/v3/users/0dcc463f8f224468a7eb81e59f5c5ba9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:50.915791 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c601d18-451f-4f7c-b477-1895be6cf9bb admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:50.917262 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-0c601d18-451f-4f7c-b477-1895be6cf9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:50.936395 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c601d18-451f-4f7c-b477-1895be6cf9bb admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:51.003708 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d37e46-a239-4845-92e6-4d8e69197226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:51.004552 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d37e46-a239-4845-92e6-4d8e69197226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:51.004893 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d37e46-a239-4845-92e6-4d8e69197226 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:51.005176 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d37e46-a239-4845-92e6-4d8e69197226 admin admin] PATH_INFO: `/v3/projects/56aac780aa4542d3a29f9614097c428f` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:51.006907 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d37e46-a239-4845-92e6-4d8e69197226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56aac780aa4542d3a29f9614097c428f)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:51.008869 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d37e46-a239-4845-92e6-4d8e69197226 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:51.069853 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-53d37e46-a239-4845-92e6-4d8e69197226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56aac780aa4542d3a29f9614097c428f', 'request_id': 'req-53d37e46-a239-4845-92e6-4d8e69197226'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:51.081597 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-53d37e46-a239-4845-92e6-4d8e69197226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56aac780aa4542d3a29f9614097c428f', 'request_id': 'req-53d37e46-a239-4845-92e6-4d8e69197226'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:51.087113 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-53d37e46-a239-4845-92e6-4d8e69197226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56aac780aa4542d3a29f9614097c428f', 'request_id': 'req-53d37e46-a239-4845-92e6-4d8e69197226'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:51.102841 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-53d37e46-a239-4845-92e6-4d8e69197226 admin admin] The token cache is being invalidate because project 56aac780aa4542d3a29f9614097c428f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:51.103131 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-53d37e46-a239-4845-92e6-4d8e69197226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:51.104025 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-53d37e46-a239-4845-92e6-4d8e69197226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:51.105727 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1088/2184] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:50 2021] DELETE /identity/v3/projects/56aac780aa4542d3a29f9614097c428f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:51.113160 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cfb65-594a-4d1e-a3a8-5d84d7410848 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:51.113688 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cfb65-594a-4d1e-a3a8-5d84d7410848 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:51.113917 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cfb65-594a-4d1e-a3a8-5d84d7410848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:51.137144 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-8a6cfb65-594a-4d1e-a3a8-5d84d7410848 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:51.138307 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-8a6cfb65-594a-4d1e-a3a8-5d84d7410848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:51.206316 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1097/2185] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:51.214212 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463bd0e-7c97-4665-b3e9-e351ca65b8d6 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:51.214581 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463bd0e-7c97-4665-b3e9-e351ca65b8d6 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:51.214954 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463bd0e-7c97-4665-b3e9-e351ca65b8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:51.238032 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-4463bd0e-7c97-4665-b3e9-e351ca65b8d6 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:51.239196 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-4463bd0e-7c97-4665-b3e9-e351ca65b8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:51.247439 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1089/2186] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:51.251904 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cfb65-594a-4d1e-a3a8-5d84d7410848 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:51.261247 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cfb65-594a-4d1e-a3a8-5d84d7410848 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:51.265599 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825aae21-9788-4faa-a037-1ec1fafde7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:51.266194 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825aae21-9788-4faa-a037-1ec1fafde7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:51.266658 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825aae21-9788-4faa-a037-1ec1fafde7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:51.266947 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825aae21-9788-4faa-a037-1ec1fafde7a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:51.267644 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825aae21-9788-4faa-a037-1ec1fafde7a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:40:51.267947 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825aae21-9788-4faa-a037-1ec1fafde7a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:51.269583 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825aae21-9788-4faa-a037-1ec1fafde7a5 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:51.282992 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1098/2187] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:40:51.286933 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463bd0e-7c97-4665-b3e9-e351ca65b8d6 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:51.296478 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463bd0e-7c97-4665-b3e9-e351ca65b8d6 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:51.300874 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35966a44-c0db-4dc3-b2ef-eef030d96eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:51.301457 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35966a44-c0db-4dc3-b2ef-eef030d96eeb admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:51.301744 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35966a44-c0db-4dc3-b2ef-eef030d96eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:51.302021 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35966a44-c0db-4dc3-b2ef-eef030d96eeb admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:51.302657 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35966a44-c0db-4dc3-b2ef-eef030d96eeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:51.305193 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35966a44-c0db-4dc3-b2ef-eef030d96eeb admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:51.337820 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1090/2188] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:51 2021] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:40:51.338881 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825aae21-9788-4faa-a037-1ec1fafde7a5 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:51.349072 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825aae21-9788-4faa-a037-1ec1fafde7a5 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:51.415948 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406e6c3-8e48-4234-a481-f937d51a876f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:51.416766 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406e6c3-8e48-4234-a481-f937d51a876f admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:51.417114 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406e6c3-8e48-4234-a481-f937d51a876f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:51.417357 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406e6c3-8e48-4234-a481-f937d51a876f admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:51.418009 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406e6c3-8e48-4234-a481-f937d51a876f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:51.419910 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406e6c3-8e48-4234-a481-f937d51a876f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:51.442215 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1099/2189] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:51 2021] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:51.447147 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35966a44-c0db-4dc3-b2ef-eef030d96eeb admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:51.457899 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35966a44-c0db-4dc3-b2ef-eef030d96eeb admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:51.463518 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290b4f2-d71e-4243-9041-995f055fe5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:51.464511 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290b4f2-d71e-4243-9041-995f055fe5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:51.464961 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290b4f2-d71e-4243-9041-995f055fe5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:51.465592 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290b4f2-d71e-4243-9041-995f055fe5a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:51.466431 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290b4f2-d71e-4243-9041-995f055fe5a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:51.468974 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290b4f2-d71e-4243-9041-995f055fe5a2 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:51.482203 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1091/2190] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:51 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:51.486175 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406e6c3-8e48-4234-a481-f937d51a876f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:51.499821 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406e6c3-8e48-4234-a481-f937d51a876f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:51.504886 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bfbc4-ee5c-4043-afb9-57b2f5845aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:51.505503 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bfbc4-ee5c-4043-afb9-57b2f5845aea admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:51.505809 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bfbc4-ee5c-4043-afb9-57b2f5845aea admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:51.506631 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bfbc4-ee5c-4043-afb9-57b2f5845aea admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:51.507371 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462bfbc4-ee5c-4043-afb9-57b2f5845aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:51.509087 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462bfbc4-ee5c-4043-afb9-57b2f5845aea admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:51.521061 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1100/2191] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:51 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:51.525981 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290b4f2-d71e-4243-9041-995f055fe5a2 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:51.536832 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290b4f2-d71e-4243-9041-995f055fe5a2 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:51.542278 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd155a20-60b0-4056-83ee-05ff2102c4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:51.543792 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd155a20-60b0-4056-83ee-05ff2102c4c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:51.544088 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd155a20-60b0-4056-83ee-05ff2102c4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:51.544377 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd155a20-60b0-4056-83ee-05ff2102c4c1 admin admin] PATH_INFO: `/v3/projects/44b95b0a6abc443a9df33a1acf49da93/users/5576e0cc2b514e7fac1096fcba286923/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:51.566931 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd155a20-60b0-4056-83ee-05ff2102c4c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b95b0a6abc443a9df33a1acf49da93, user_id=5576e0cc2b514e7fac1096fcba286923, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:51.570303 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd155a20-60b0-4056-83ee-05ff2102c4c1 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:51.587667 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1092/2192] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:51 2021] PUT /identity/v3/projects/44b95b0a6abc443a9df33a1acf49da93/users/5576e0cc2b514e7fac1096fcba286923/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:51.601432 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835f71f-500d-4dde-b4ed-a8fdd94188a8 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:51.601781 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835f71f-500d-4dde-b4ed-a8fdd94188a8 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:51.602278 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835f71f-500d-4dde-b4ed-a8fdd94188a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:51.648424 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-9835f71f-500d-4dde-b4ed-a8fdd94188a8 None None] MFA Rules not processed for user `5576e0cc2b514e7fac1096fcba286923`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:51.650190 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-9835f71f-500d-4dde-b4ed-a8fdd94188a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:51.748685 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1101/2193] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:51 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:51.755650 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd155a20-60b0-4056-83ee-05ff2102c4c1 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:51.758674 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-dd155a20-60b0-4056-83ee-05ff2102c4c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:51.889116 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd155a20-60b0-4056-83ee-05ff2102c4c1 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:51.894434 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3558e-6425-46e6-b95a-180b2d26c623 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:51.895568 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3558e-6425-46e6-b95a-180b2d26c623 service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:51.896175 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3558e-6425-46e6-b95a-180b2d26c623 service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:51.896467 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3558e-6425-46e6-b95a-180b2d26c623 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:51.907109 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3558e-6425-46e6-b95a-180b2d26c623 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:51.910185 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3558e-6425-46e6-b95a-180b2d26c623 service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:51.926840 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1093/2194] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:51 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:55.132047 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835f71f-500d-4dde-b4ed-a8fdd94188a8 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:55.201920 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835f71f-500d-4dde-b4ed-a8fdd94188a8 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:55.206672 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91249e-1e73-4e7f-bf20-10811a243648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:55.207486 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91249e-1e73-4e7f-bf20-10811a243648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:55.208611 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91249e-1e73-4e7f-bf20-10811a243648 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:55.208611 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91249e-1e73-4e7f-bf20-10811a243648 admin admin] PATH_INFO: `/v3/users/5576e0cc2b514e7fac1096fcba286923` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:55.209734 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91249e-1e73-4e7f-bf20-10811a243648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5576e0cc2b514e7fac1096fcba286923)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:55.211717 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91249e-1e73-4e7f-bf20-10811a243648 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:55.260128 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-fc91249e-1e73-4e7f-bf20-10811a243648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5576e0cc2b514e7fac1096fcba286923'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:55.260804 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-fc91249e-1e73-4e7f-bf20-10811a243648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5576e0cc2b514e7fac1096fcba286923'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:55.272847 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-fc91249e-1e73-4e7f-bf20-10811a243648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5576e0cc2b514e7fac1096fcba286923'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:55.280176 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-fc91249e-1e73-4e7f-bf20-10811a243648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5576e0cc2b514e7fac1096fcba286923'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:55.287075 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-fc91249e-1e73-4e7f-bf20-10811a243648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5576e0cc2b514e7fac1096fcba286923'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:55.293387 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1102/2195] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:55 2021] DELETE /identity/v3/users/5576e0cc2b514e7fac1096fcba286923 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:55.297840 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a52e5-4338-49cc-ad70-1da2e6c3eeb5 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:55.298478 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a52e5-4338-49cc-ad70-1da2e6c3eeb5 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:55.298478 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a52e5-4338-49cc-ad70-1da2e6c3eeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:55.320016 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-725a52e5-4338-49cc-ad70-1da2e6c3eeb5 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:55.321181 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-725a52e5-4338-49cc-ad70-1da2e6c3eeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:55.384097 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1094/2196] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:55.394622 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91249e-1e73-4e7f-bf20-10811a243648 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:55.396210 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-fc91249e-1e73-4e7f-bf20-10811a243648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:55.473043 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91249e-1e73-4e7f-bf20-10811a243648 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:55.477751 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc487a-900a-4078-9db8-7124a4cd0604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:55.478722 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc487a-900a-4078-9db8-7124a4cd0604 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:55.479350 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc487a-900a-4078-9db8-7124a4cd0604 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:55.479875 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc487a-900a-4078-9db8-7124a4cd0604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:55.492809 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc487a-900a-4078-9db8-7124a4cd0604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:55.494811 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc487a-900a-4078-9db8-7124a4cd0604 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:55.510398 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1103/2197] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:55.900626 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a52e5-4338-49cc-ad70-1da2e6c3eeb5 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:55.903295 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-725a52e5-4338-49cc-ad70-1da2e6c3eeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:55.917840 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a52e5-4338-49cc-ad70-1da2e6c3eeb5 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:55.924398 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021dc62-4e75-49f7-b723-d468b31e62ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:55.925243 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021dc62-4e75-49f7-b723-d468b31e62ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:55.925584 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021dc62-4e75-49f7-b723-d468b31e62ef admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:55.926317 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021dc62-4e75-49f7-b723-d468b31e62ef admin admin] PATH_INFO: `/v3/projects/44b95b0a6abc443a9df33a1acf49da93` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:55.928178 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021dc62-4e75-49f7-b723-d468b31e62ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=44b95b0a6abc443a9df33a1acf49da93)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:55.930367 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021dc62-4e75-49f7-b723-d468b31e62ef admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:55.994419 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-0021dc62-4e75-49f7-b723-d468b31e62ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44b95b0a6abc443a9df33a1acf49da93', 'request_id': 'req-0021dc62-4e75-49f7-b723-d468b31e62ef'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:56.007116 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-0021dc62-4e75-49f7-b723-d468b31e62ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44b95b0a6abc443a9df33a1acf49da93', 'request_id': 'req-0021dc62-4e75-49f7-b723-d468b31e62ef'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:56.013964 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-0021dc62-4e75-49f7-b723-d468b31e62ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44b95b0a6abc443a9df33a1acf49da93', 'request_id': 'req-0021dc62-4e75-49f7-b723-d468b31e62ef'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:56.028294 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-0021dc62-4e75-49f7-b723-d468b31e62ef admin admin] The token cache is being invalidate because project 44b95b0a6abc443a9df33a1acf49da93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:56.028967 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-0021dc62-4e75-49f7-b723-d468b31e62ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:56.029796 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-0021dc62-4e75-49f7-b723-d468b31e62ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:56.031540 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1095/2198] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:55 2021] DELETE /identity/v3/projects/44b95b0a6abc443a9df33a1acf49da93 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:56.037570 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e99f7-1774-4003-93f5-29d1a75e30d0 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:56.037867 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e99f7-1774-4003-93f5-29d1a75e30d0 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:56.038414 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e99f7-1774-4003-93f5-29d1a75e30d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:56.064720 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-6c5e99f7-1774-4003-93f5-29d1a75e30d0 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:56.065874 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-6c5e99f7-1774-4003-93f5-29d1a75e30d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:56.168581 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1104/2199] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:56.173022 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba6074-b584-4cbb-a4e9-e9055689a842 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:56.173419 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba6074-b584-4cbb-a4e9-e9055689a842 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:56.173804 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba6074-b584-4cbb-a4e9-e9055689a842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:56.197399 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-60ba6074-b584-4cbb-a4e9-e9055689a842 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:56.199105 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-60ba6074-b584-4cbb-a4e9-e9055689a842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:56.217290 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e99f7-1774-4003-93f5-29d1a75e30d0 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:56.218214 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1096/2200] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:56.228272 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e99f7-1774-4003-93f5-29d1a75e30d0 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:56.233356 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7a6cd-7929-4cb9-80a9-5c7261de24e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:56.234041 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7a6cd-7929-4cb9-80a9-5c7261de24e0 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:56.234389 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7a6cd-7929-4cb9-80a9-5c7261de24e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:56.234743 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7a6cd-7929-4cb9-80a9-5c7261de24e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:56.235517 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7a6cd-7929-4cb9-80a9-5c7261de24e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:40:56.235889 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7a6cd-7929-4cb9-80a9-5c7261de24e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:56.237740 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7a6cd-7929-4cb9-80a9-5c7261de24e0 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:56.256222 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba6074-b584-4cbb-a4e9-e9055689a842 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:56.261989 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1105/2201] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:40:56.266763 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba6074-b584-4cbb-a4e9-e9055689a842 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:56.272765 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377f520-0c64-4e20-a7ed-9505fbab0dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:56.273390 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377f520-0c64-4e20-a7ed-9505fbab0dfa admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:56.273678 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377f520-0c64-4e20-a7ed-9505fbab0dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:56.273956 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377f520-0c64-4e20-a7ed-9505fbab0dfa admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:56.274660 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377f520-0c64-4e20-a7ed-9505fbab0dfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:56.276499 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377f520-0c64-4e20-a7ed-9505fbab0dfa admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:56.310732 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1097/2202] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:56 2021] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:40:56.314938 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7a6cd-7929-4cb9-80a9-5c7261de24e0 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:56.326690 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7a6cd-7929-4cb9-80a9-5c7261de24e0 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:56.419141 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2b175-2b9e-42b2-8650-7f47e6d3c106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:56.419869 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2b175-2b9e-42b2-8650-7f47e6d3c106 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:56.420240 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2b175-2b9e-42b2-8650-7f47e6d3c106 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:56.420599 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2b175-2b9e-42b2-8650-7f47e6d3c106 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:56.422277 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2b175-2b9e-42b2-8650-7f47e6d3c106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:56.423447 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2b175-2b9e-42b2-8650-7f47e6d3c106 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:56.452829 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1106/2203] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:56 2021] POST /identity/v3/users => generated 287 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:56.454215 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377f520-0c64-4e20-a7ed-9505fbab0dfa admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:56.469928 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377f520-0c64-4e20-a7ed-9505fbab0dfa admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:56.486686 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352148db-30ec-46d1-9470-aaab814e0657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:56.488019 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352148db-30ec-46d1-9470-aaab814e0657 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:56.488445 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352148db-30ec-46d1-9470-aaab814e0657 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:56.488928 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352148db-30ec-46d1-9470-aaab814e0657 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:56.489788 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352148db-30ec-46d1-9470-aaab814e0657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:56.491830 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352148db-30ec-46d1-9470-aaab814e0657 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:56.508927 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1098/2204] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:56 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:56.513645 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2b175-2b9e-42b2-8650-7f47e6d3c106 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:56.529670 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2b175-2b9e-42b2-8650-7f47e6d3c106 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:56.546560 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c97ef-bad6-452a-8e82-e01ce7a2f615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:56.547328 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c97ef-bad6-452a-8e82-e01ce7a2f615 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:56.547728 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c97ef-bad6-452a-8e82-e01ce7a2f615 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:56.548076 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c97ef-bad6-452a-8e82-e01ce7a2f615 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:56.548899 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c97ef-bad6-452a-8e82-e01ce7a2f615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:56.550936 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c97ef-bad6-452a-8e82-e01ce7a2f615 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:56.564379 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1107/2205] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:56 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:40:56.569423 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352148db-30ec-46d1-9470-aaab814e0657 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:56.582315 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352148db-30ec-46d1-9470-aaab814e0657 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:56.588091 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42596963-1f85-4d3f-8220-012a9247a443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:56.589080 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42596963-1f85-4d3f-8220-012a9247a443 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:56.589441 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42596963-1f85-4d3f-8220-012a9247a443 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:56.589793 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42596963-1f85-4d3f-8220-012a9247a443 admin admin] PATH_INFO: `/v3/projects/55196afc7da84a8597a24aa5d6cdfe24/users/903315c43c4c451486f57c8e09f41b23/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:56.614768 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42596963-1f85-4d3f-8220-012a9247a443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55196afc7da84a8597a24aa5d6cdfe24, user_id=903315c43c4c451486f57c8e09f41b23, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:56.619508 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42596963-1f85-4d3f-8220-012a9247a443 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:56.635916 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1099/2206] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:56 2021] PUT /identity/v3/projects/55196afc7da84a8597a24aa5d6cdfe24/users/903315c43c4c451486f57c8e09f41b23/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:56.646740 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84502036-9c70-4d73-add9-77d283bd775e None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:56.647151 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84502036-9c70-4d73-add9-77d283bd775e None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:56.647544 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84502036-9c70-4d73-add9-77d283bd775e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:56.696724 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-84502036-9c70-4d73-add9-77d283bd775e None None] MFA Rules not processed for user `903315c43c4c451486f57c8e09f41b23`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:56.698390 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-84502036-9c70-4d73-add9-77d283bd775e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:56.798876 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1108/2207] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:56 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:56.813359 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42596963-1f85-4d3f-8220-012a9247a443 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:56.815353 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-42596963-1f85-4d3f-8220-012a9247a443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:56.926567 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42596963-1f85-4d3f-8220-012a9247a443 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:56.931517 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b59b4-784f-44d3-94f6-4644fbdb0c29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:56.932108 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b59b4-784f-44d3-94f6-4644fbdb0c29 service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:56.932396 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b59b4-784f-44d3-94f6-4644fbdb0c29 service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:56.932676 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b59b4-784f-44d3-94f6-4644fbdb0c29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:56.943525 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b59b4-784f-44d3-94f6-4644fbdb0c29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:56.945788 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b59b4-784f-44d3-94f6-4644fbdb0c29 service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:56.956945 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1100/2208] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:56 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:56.982949 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84502036-9c70-4d73-add9-77d283bd775e None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:57.058133 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84502036-9c70-4d73-add9-77d283bd775e None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:57.066606 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72fde8-2c1a-4120-adbf-031163cd8275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:57.067523 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72fde8-2c1a-4120-adbf-031163cd8275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:57.067906 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72fde8-2c1a-4120-adbf-031163cd8275 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:57.068412 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72fde8-2c1a-4120-adbf-031163cd8275 admin admin] PATH_INFO: `/v3/users/903315c43c4c451486f57c8e09f41b23` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:57.069673 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72fde8-2c1a-4120-adbf-031163cd8275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=903315c43c4c451486f57c8e09f41b23)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:57.071670 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72fde8-2c1a-4120-adbf-031163cd8275 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:57.126775 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-3e72fde8-2c1a-4120-adbf-031163cd8275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '903315c43c4c451486f57c8e09f41b23'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:57.127440 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-3e72fde8-2c1a-4120-adbf-031163cd8275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '903315c43c4c451486f57c8e09f41b23'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:57.140109 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-3e72fde8-2c1a-4120-adbf-031163cd8275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '903315c43c4c451486f57c8e09f41b23'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:57.149022 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-3e72fde8-2c1a-4120-adbf-031163cd8275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '903315c43c4c451486f57c8e09f41b23'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:57.157240 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-3e72fde8-2c1a-4120-adbf-031163cd8275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '903315c43c4c451486f57c8e09f41b23'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:57.164070 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1109/2209] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:56 2021] DELETE /identity/v3/users/903315c43c4c451486f57c8e09f41b23 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:57.169469 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a3ac5-bf41-4fe8-8ebb-c18e9f8f2373 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:57.169769 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a3ac5-bf41-4fe8-8ebb-c18e9f8f2373 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:57.170123 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a3ac5-bf41-4fe8-8ebb-c18e9f8f2373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:57.193490 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-761a3ac5-bf41-4fe8-8ebb-c18e9f8f2373 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:57.194216 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-761a3ac5-bf41-4fe8-8ebb-c18e9f8f2373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:57.261574 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1101/2210] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:57.273237 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72fde8-2c1a-4120-adbf-031163cd8275 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:57.274692 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-3e72fde8-2c1a-4120-adbf-031163cd8275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:57.357470 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72fde8-2c1a-4120-adbf-031163cd8275 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:57.360966 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a898b-5a4f-44c6-9248-03cb47b89ed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:57.361552 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a898b-5a4f-44c6-9248-03cb47b89ed7 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:57.361837 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a898b-5a4f-44c6-9248-03cb47b89ed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:57.362159 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a898b-5a4f-44c6-9248-03cb47b89ed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:57.370949 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a898b-5a4f-44c6-9248-03cb47b89ed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:57.372747 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a898b-5a4f-44c6-9248-03cb47b89ed7 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:57.382571 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1110/2211] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:57 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:40:57.754671 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a3ac5-bf41-4fe8-8ebb-c18e9f8f2373 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:57.756720 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-761a3ac5-bf41-4fe8-8ebb-c18e9f8f2373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:57.769441 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a3ac5-bf41-4fe8-8ebb-c18e9f8f2373 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:57.774436 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9bac4-7112-4ef7-bc32-cc200916afa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:57.775302 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9bac4-7112-4ef7-bc32-cc200916afa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:57.775665 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9bac4-7112-4ef7-bc32-cc200916afa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:57.776020 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9bac4-7112-4ef7-bc32-cc200916afa8 admin admin] PATH_INFO: `/v3/projects/55196afc7da84a8597a24aa5d6cdfe24` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:57.777332 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9bac4-7112-4ef7-bc32-cc200916afa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55196afc7da84a8597a24aa5d6cdfe24)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:57.779348 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9bac4-7112-4ef7-bc32-cc200916afa8 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:57.851135 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b1f9bac4-7112-4ef7-bc32-cc200916afa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55196afc7da84a8597a24aa5d6cdfe24', 'request_id': 'req-b1f9bac4-7112-4ef7-bc32-cc200916afa8'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:57.864884 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b1f9bac4-7112-4ef7-bc32-cc200916afa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55196afc7da84a8597a24aa5d6cdfe24', 'request_id': 'req-b1f9bac4-7112-4ef7-bc32-cc200916afa8'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:57.871496 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b1f9bac4-7112-4ef7-bc32-cc200916afa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55196afc7da84a8597a24aa5d6cdfe24', 'request_id': 'req-b1f9bac4-7112-4ef7-bc32-cc200916afa8'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:57.890337 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b1f9bac4-7112-4ef7-bc32-cc200916afa8 admin admin] The token cache is being invalidate because project 55196afc7da84a8597a24aa5d6cdfe24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:57.890717 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b1f9bac4-7112-4ef7-bc32-cc200916afa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:57.891442 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b1f9bac4-7112-4ef7-bc32-cc200916afa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:57.893399 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1102/2212] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:57 2021] DELETE /identity/v3/projects/55196afc7da84a8597a24aa5d6cdfe24 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:58.098353 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a898b-5a4f-44c6-9248-03cb47b89ed7 service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:58.100309 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-393a898b-5a4f-44c6-9248-03cb47b89ed7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:58.112873 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a898b-5a4f-44c6-9248-03cb47b89ed7 service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:58.174251 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d1b2d-20fc-4502-b042-5f3bbd8f414f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:58.175055 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d1b2d-20fc-4502-b042-5f3bbd8f414f admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:58.175350 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d1b2d-20fc-4502-b042-5f3bbd8f414f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:58.175635 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d1b2d-20fc-4502-b042-5f3bbd8f414f admin admin] PATH_INFO: `/v3/users/f92d2ddc00804f0d813f494e78a88530` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:58.176745 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d1b2d-20fc-4502-b042-5f3bbd8f414f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f92d2ddc00804f0d813f494e78a88530)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:58.179341 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d1b2d-20fc-4502-b042-5f3bbd8f414f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:58.231047 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-966d1b2d-20fc-4502-b042-5f3bbd8f414f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f92d2ddc00804f0d813f494e78a88530'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:58.231800 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-966d1b2d-20fc-4502-b042-5f3bbd8f414f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f92d2ddc00804f0d813f494e78a88530'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:58.246401 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-966d1b2d-20fc-4502-b042-5f3bbd8f414f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f92d2ddc00804f0d813f494e78a88530'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:58.253903 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-966d1b2d-20fc-4502-b042-5f3bbd8f414f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f92d2ddc00804f0d813f494e78a88530'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:58.260954 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-966d1b2d-20fc-4502-b042-5f3bbd8f414f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f92d2ddc00804f0d813f494e78a88530'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:58.267016 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1111/2213] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:58 2021] DELETE /identity/v3/users/f92d2ddc00804f0d813f494e78a88530 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:58.579933 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9bac4-7112-4ef7-bc32-cc200916afa8 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:58.581500 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-b1f9bac4-7112-4ef7-bc32-cc200916afa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:58.597416 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9bac4-7112-4ef7-bc32-cc200916afa8 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:58.662789 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117ca60-1cbd-4bba-a64b-84e869123d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:58.663476 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117ca60-1cbd-4bba-a64b-84e869123d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:58.663767 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117ca60-1cbd-4bba-a64b-84e869123d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:58.664050 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117ca60-1cbd-4bba-a64b-84e869123d81 admin admin] PATH_INFO: `/v3/projects/d2c80f6588b6403388795a3cbdab209e` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:58.665497 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117ca60-1cbd-4bba-a64b-84e869123d81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c80f6588b6403388795a3cbdab209e)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:58.667626 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117ca60-1cbd-4bba-a64b-84e869123d81 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:58.716175 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5117ca60-1cbd-4bba-a64b-84e869123d81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c80f6588b6403388795a3cbdab209e', 'request_id': 'req-5117ca60-1cbd-4bba-a64b-84e869123d81'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:58.727878 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5117ca60-1cbd-4bba-a64b-84e869123d81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c80f6588b6403388795a3cbdab209e', 'request_id': 'req-5117ca60-1cbd-4bba-a64b-84e869123d81'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:58.733015 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5117ca60-1cbd-4bba-a64b-84e869123d81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c80f6588b6403388795a3cbdab209e', 'request_id': 'req-5117ca60-1cbd-4bba-a64b-84e869123d81'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:58.747032 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5117ca60-1cbd-4bba-a64b-84e869123d81 admin admin] The token cache is being invalidate because project d2c80f6588b6403388795a3cbdab209e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:58.747398 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5117ca60-1cbd-4bba-a64b-84e869123d81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:58.748016 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5117ca60-1cbd-4bba-a64b-84e869123d81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:58.749712 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1103/2214] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:58 2021] DELETE /identity/v3/projects/d2c80f6588b6403388795a3cbdab209e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:58.753598 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d1b2d-20fc-4502-b042-5f3bbd8f414f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:58.754963 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-966d1b2d-20fc-4502-b042-5f3bbd8f414f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:58.767526 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d1b2d-20fc-4502-b042-5f3bbd8f414f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:58.831880 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff897a-6bb9-47cd-b0fd-56ab509d3302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:58.832688 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff897a-6bb9-47cd-b0fd-56ab509d3302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:58.833009 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff897a-6bb9-47cd-b0fd-56ab509d3302 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:58.833294 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff897a-6bb9-47cd-b0fd-56ab509d3302 admin admin] PATH_INFO: `/v3/users/d48dc80a6511424dbe1b32d767c22fdd` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:58.835068 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff897a-6bb9-47cd-b0fd-56ab509d3302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d48dc80a6511424dbe1b32d767c22fdd)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:58.837007 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff897a-6bb9-47cd-b0fd-56ab509d3302 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:58.886665 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-5cff897a-6bb9-47cd-b0fd-56ab509d3302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd48dc80a6511424dbe1b32d767c22fdd'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:58.887305 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-5cff897a-6bb9-47cd-b0fd-56ab509d3302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd48dc80a6511424dbe1b32d767c22fdd'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:58.899861 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-5cff897a-6bb9-47cd-b0fd-56ab509d3302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd48dc80a6511424dbe1b32d767c22fdd'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:58.907636 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-5cff897a-6bb9-47cd-b0fd-56ab509d3302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd48dc80a6511424dbe1b32d767c22fdd'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:58.914829 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-5cff897a-6bb9-47cd-b0fd-56ab509d3302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd48dc80a6511424dbe1b32d767c22fdd'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:58.921068 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1112/2215] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:58 2021] DELETE /identity/v3/users/d48dc80a6511424dbe1b32d767c22fdd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:59.143113 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117ca60-1cbd-4bba-a64b-84e869123d81 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:59.144556 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-5117ca60-1cbd-4bba-a64b-84e869123d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:59.164897 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117ca60-1cbd-4bba-a64b-84e869123d81 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:59.228119 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c257a-9327-44b8-98e2-108b0ee3ba10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:59.228936 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c257a-9327-44b8-98e2-108b0ee3ba10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:59.229226 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c257a-9327-44b8-98e2-108b0ee3ba10 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:59.229513 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c257a-9327-44b8-98e2-108b0ee3ba10 admin admin] PATH_INFO: `/v3/projects/d451c2c895d8454a942152eaee68dac1` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:59.230621 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c257a-9327-44b8-98e2-108b0ee3ba10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d451c2c895d8454a942152eaee68dac1)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:59.232503 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c257a-9327-44b8-98e2-108b0ee3ba10 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:59.281202 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5e9c257a-9327-44b8-98e2-108b0ee3ba10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd451c2c895d8454a942152eaee68dac1', 'request_id': 'req-5e9c257a-9327-44b8-98e2-108b0ee3ba10'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:59.292216 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5e9c257a-9327-44b8-98e2-108b0ee3ba10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd451c2c895d8454a942152eaee68dac1', 'request_id': 'req-5e9c257a-9327-44b8-98e2-108b0ee3ba10'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:59.297112 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5e9c257a-9327-44b8-98e2-108b0ee3ba10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd451c2c895d8454a942152eaee68dac1', 'request_id': 'req-5e9c257a-9327-44b8-98e2-108b0ee3ba10'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:59.309073 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5e9c257a-9327-44b8-98e2-108b0ee3ba10 admin admin] The token cache is being invalidate because project d451c2c895d8454a942152eaee68dac1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:59.309353 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5e9c257a-9327-44b8-98e2-108b0ee3ba10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:59.309979 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5e9c257a-9327-44b8-98e2-108b0ee3ba10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:59.311399 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1104/2216] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:59 2021] DELETE /identity/v3/projects/d451c2c895d8454a942152eaee68dac1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:59.317665 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd2faf-8cf3-4df7-b04b-dd543cc189f7 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:59.317961 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd2faf-8cf3-4df7-b04b-dd543cc189f7 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:59.318298 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd2faf-8cf3-4df7-b04b-dd543cc189f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:59.340929 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-c1bd2faf-8cf3-4df7-b04b-dd543cc189f7 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:59.342096 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-c1bd2faf-8cf3-4df7-b04b-dd543cc189f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:59.405223 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1113/2217] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:59.413128 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed137799-9e23-49bc-8833-40af3f1fdbdf None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:59.413427 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed137799-9e23-49bc-8833-40af3f1fdbdf None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:59.413715 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed137799-9e23-49bc-8833-40af3f1fdbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:59.436834 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-ed137799-9e23-49bc-8833-40af3f1fdbdf None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:59.437914 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-ed137799-9e23-49bc-8833-40af3f1fdbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:59.445797 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1105/2218] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:59.449974 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd2faf-8cf3-4df7-b04b-dd543cc189f7 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:59.459175 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd2faf-8cf3-4df7-b04b-dd543cc189f7 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:59.463472 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db490e2a-2807-4523-8ce7-1554b6d2bcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:59.464054 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db490e2a-2807-4523-8ce7-1554b6d2bcc5 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:59.464339 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db490e2a-2807-4523-8ce7-1554b6d2bcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:59.464620 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db490e2a-2807-4523-8ce7-1554b6d2bcc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:59.465358 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db490e2a-2807-4523-8ce7-1554b6d2bcc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:40:59.465651 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db490e2a-2807-4523-8ce7-1554b6d2bcc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:59.467244 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db490e2a-2807-4523-8ce7-1554b6d2bcc5 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:59.479840 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1114/2219] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:40:59.484073 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed137799-9e23-49bc-8833-40af3f1fdbdf None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:59.493615 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed137799-9e23-49bc-8833-40af3f1fdbdf None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:59.498210 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3febf2-e68a-4888-a99c-2eabb12f6c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:59.498865 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3febf2-e68a-4888-a99c-2eabb12f6c74 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:59.499205 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3febf2-e68a-4888-a99c-2eabb12f6c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:59.499500 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3febf2-e68a-4888-a99c-2eabb12f6c74 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:59.500182 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3febf2-e68a-4888-a99c-2eabb12f6c74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:59.502322 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3febf2-e68a-4888-a99c-2eabb12f6c74 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:59.528035 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1106/2220] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:59 2021] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:59.532211 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db490e2a-2807-4523-8ce7-1554b6d2bcc5 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:59.542322 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db490e2a-2807-4523-8ce7-1554b6d2bcc5 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:59.604173 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760c220-4b72-4df1-948d-b8c6f1aea821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:59.604775 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760c220-4b72-4df1-948d-b8c6f1aea821 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:59.605218 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760c220-4b72-4df1-948d-b8c6f1aea821 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:59.605505 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760c220-4b72-4df1-948d-b8c6f1aea821 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:59.606142 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760c220-4b72-4df1-948d-b8c6f1aea821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:59.608073 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760c220-4b72-4df1-948d-b8c6f1aea821 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:59.631830 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1115/2221] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:59 2021] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:40:59.633279 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3febf2-e68a-4888-a99c-2eabb12f6c74 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:59.643068 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3febf2-e68a-4888-a99c-2eabb12f6c74 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:59.647824 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6f5e5-f109-43d2-a8a6-e2a78009d763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:59.648412 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6f5e5-f109-43d2-a8a6-e2a78009d763 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:59.648708 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6f5e5-f109-43d2-a8a6-e2a78009d763 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:59.649094 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6f5e5-f109-43d2-a8a6-e2a78009d763 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:59.649764 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6f5e5-f109-43d2-a8a6-e2a78009d763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:59.651311 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6f5e5-f109-43d2-a8a6-e2a78009d763 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:59.664555 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1107/2222] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:59 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:59.668573 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760c220-4b72-4df1-948d-b8c6f1aea821 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:59.679603 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760c220-4b72-4df1-948d-b8c6f1aea821 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:59.684159 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8ca9c-93f9-4c9d-a7b4-8cd3f9e1fb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:59.684739 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8ca9c-93f9-4c9d-a7b4-8cd3f9e1fb67 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:59.685063 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8ca9c-93f9-4c9d-a7b4-8cd3f9e1fb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:59.685348 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8ca9c-93f9-4c9d-a7b4-8cd3f9e1fb67 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:59.686050 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8ca9c-93f9-4c9d-a7b4-8cd3f9e1fb67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:59.688695 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8ca9c-93f9-4c9d-a7b4-8cd3f9e1fb67 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:59.700081 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1116/2223] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:59 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:40:59.704157 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6f5e5-f109-43d2-a8a6-e2a78009d763 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:59.713709 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6f5e5-f109-43d2-a8a6-e2a78009d763 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:59.718166 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246135c1-53ec-4d5c-8371-2babb5251251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:59.718979 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246135c1-53ec-4d5c-8371-2babb5251251 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:59.719262 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246135c1-53ec-4d5c-8371-2babb5251251 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:59.719561 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246135c1-53ec-4d5c-8371-2babb5251251 admin admin] PATH_INFO: `/v3/projects/5da15d944de44d288ed1eecdd5033af8/users/cc36a09f7eed493aaf5fa82187da0dcb/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:59.741721 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246135c1-53ec-4d5c-8371-2babb5251251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5da15d944de44d288ed1eecdd5033af8, user_id=cc36a09f7eed493aaf5fa82187da0dcb, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:59.744576 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246135c1-53ec-4d5c-8371-2babb5251251 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:40:59.764131 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1108/2224] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:59 2021] PUT /identity/v3/projects/5da15d944de44d288ed1eecdd5033af8/users/cc36a09f7eed493aaf5fa82187da0dcb/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:59.775114 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6b1fc-f3b0-4e85-add5-08a89ae3d591 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:59.775770 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6b1fc-f3b0-4e85-add5-08a89ae3d591 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:59.776065 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6b1fc-f3b0-4e85-add5-08a89ae3d591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:59.832206 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-eba6b1fc-f3b0-4e85-add5-08a89ae3d591 None None] MFA Rules not processed for user `cc36a09f7eed493aaf5fa82187da0dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:59.833452 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-eba6b1fc-f3b0-4e85-add5-08a89ae3d591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:59.925724 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1117/2225] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:40:59 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:59.935944 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246135c1-53ec-4d5c-8371-2babb5251251 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:59.938014 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-246135c1-53ec-4d5c-8371-2babb5251251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:00.003602 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246135c1-53ec-4d5c-8371-2babb5251251 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:00.007682 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fb469-5de7-44d2-a603-6907f962ffaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:00.008265 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fb469-5de7-44d2-a603-6907f962ffaf service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:00.008561 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fb469-5de7-44d2-a603-6907f962ffaf service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:00.008882 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fb469-5de7-44d2-a603-6907f962ffaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:00.018485 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fb469-5de7-44d2-a603-6907f962ffaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:00.020262 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fb469-5de7-44d2-a603-6907f962ffaf service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:00.030339 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1109/2226] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:59 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:41:00.051665 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6b1fc-f3b0-4e85-add5-08a89ae3d591 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:00.132294 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6b1fc-f3b0-4e85-add5-08a89ae3d591 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:00.136624 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f88b10-76b6-4aa7-b023-425b2deac01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:00.137492 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f88b10-76b6-4aa7-b023-425b2deac01a admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:00.137774 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f88b10-76b6-4aa7-b023-425b2deac01a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:00.138060 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f88b10-76b6-4aa7-b023-425b2deac01a admin admin] PATH_INFO: `/v3/users/cc36a09f7eed493aaf5fa82187da0dcb` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:00.139232 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f88b10-76b6-4aa7-b023-425b2deac01a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc36a09f7eed493aaf5fa82187da0dcb)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:00.141171 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f88b10-76b6-4aa7-b023-425b2deac01a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:00.190336 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-b6f88b10-76b6-4aa7-b023-425b2deac01a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc36a09f7eed493aaf5fa82187da0dcb'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:00.191316 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-b6f88b10-76b6-4aa7-b023-425b2deac01a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc36a09f7eed493aaf5fa82187da0dcb'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:00.204391 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-b6f88b10-76b6-4aa7-b023-425b2deac01a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc36a09f7eed493aaf5fa82187da0dcb'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:00.213182 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-b6f88b10-76b6-4aa7-b023-425b2deac01a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc36a09f7eed493aaf5fa82187da0dcb'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:00.221129 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-b6f88b10-76b6-4aa7-b023-425b2deac01a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc36a09f7eed493aaf5fa82187da0dcb'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:00.229141 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1118/2227] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:41:00 2021] DELETE /identity/v3/users/cc36a09f7eed493aaf5fa82187da0dcb => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:41:00.233674 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e20a9-5d59-4b29-a289-172f8404a03f None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:00.234529 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e20a9-5d59-4b29-a289-172f8404a03f None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:00.234964 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e20a9-5d59-4b29-a289-172f8404a03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:00.258814 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-907e20a9-5d59-4b29-a289-172f8404a03f None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:00.260045 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-907e20a9-5d59-4b29-a289-172f8404a03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:00.325952 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1110/2228] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:41:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:41:00.336874 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f88b10-76b6-4aa7-b023-425b2deac01a admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:00.338213 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-b6f88b10-76b6-4aa7-b023-425b2deac01a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:00.405584 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f88b10-76b6-4aa7-b023-425b2deac01a admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:00.409386 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea6351-5c81-4dc8-b258-528eaee0d4c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:00.409982 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea6351-5c81-4dc8-b258-528eaee0d4c2 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:00.410275 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea6351-5c81-4dc8-b258-528eaee0d4c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:00.410563 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea6351-5c81-4dc8-b258-528eaee0d4c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:00.420000 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea6351-5c81-4dc8-b258-528eaee0d4c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:00.421562 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea6351-5c81-4dc8-b258-528eaee0d4c2 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:00.433181 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1119/2229] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:41:00 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:41:00.790864 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e20a9-5d59-4b29-a289-172f8404a03f None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:00.792349 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-907e20a9-5d59-4b29-a289-172f8404a03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:00.805664 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e20a9-5d59-4b29-a289-172f8404a03f None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:00.811269 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fc11b-32ee-402a-8061-db52b62bea79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:00.812109 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fc11b-32ee-402a-8061-db52b62bea79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:00.812400 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fc11b-32ee-402a-8061-db52b62bea79 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:00.812679 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fc11b-32ee-402a-8061-db52b62bea79 admin admin] PATH_INFO: `/v3/projects/5da15d944de44d288ed1eecdd5033af8` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:00.813825 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fc11b-32ee-402a-8061-db52b62bea79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5da15d944de44d288ed1eecdd5033af8)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:00.815816 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fc11b-32ee-402a-8061-db52b62bea79 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:00.898073 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-c86fc11b-32ee-402a-8061-db52b62bea79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5da15d944de44d288ed1eecdd5033af8', 'request_id': 'req-c86fc11b-32ee-402a-8061-db52b62bea79'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:00.915018 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-c86fc11b-32ee-402a-8061-db52b62bea79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5da15d944de44d288ed1eecdd5033af8', 'request_id': 'req-c86fc11b-32ee-402a-8061-db52b62bea79'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:00.921757 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-c86fc11b-32ee-402a-8061-db52b62bea79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5da15d944de44d288ed1eecdd5033af8', 'request_id': 'req-c86fc11b-32ee-402a-8061-db52b62bea79'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:00.935046 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-c86fc11b-32ee-402a-8061-db52b62bea79 admin admin] The token cache is being invalidate because project 5da15d944de44d288ed1eecdd5033af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:41:00.935325 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-c86fc11b-32ee-402a-8061-db52b62bea79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:00.935935 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-c86fc11b-32ee-402a-8061-db52b62bea79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:00.937682 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1111/2230] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:41:00 2021] DELETE /identity/v3/projects/5da15d944de44d288ed1eecdd5033af8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:41:00.943273 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208a328-4bb9-4e93-86fc-c972cfbdc729 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:00.943754 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208a328-4bb9-4e93-86fc-c972cfbdc729 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:00.944151 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208a328-4bb9-4e93-86fc-c972cfbdc729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:00.981688 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-1208a328-4bb9-4e93-86fc-c972cfbdc729 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:00.982872 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-1208a328-4bb9-4e93-86fc-c972cfbdc729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:01.062717 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1120/2231] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:41:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:41:01.071116 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fd058-b419-4da2-b21f-c05a3740df1d None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:01.071410 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fd058-b419-4da2-b21f-c05a3740df1d None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:01.071697 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fd058-b419-4da2-b21f-c05a3740df1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:01.100062 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-ac6fd058-b419-4da2-b21f-c05a3740df1d None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:01.101418 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-ac6fd058-b419-4da2-b21f-c05a3740df1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:01.132809 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1112/2232] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:41:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:41:01.137131 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208a328-4bb9-4e93-86fc-c972cfbdc729 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:01.159202 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208a328-4bb9-4e93-86fc-c972cfbdc729 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:01.178719 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c27eaf-6de5-4f7d-99ee-73890f3e3c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:01.179793 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c27eaf-6de5-4f7d-99ee-73890f3e3c11 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:01.181989 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c27eaf-6de5-4f7d-99ee-73890f3e3c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:01.182408 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c27eaf-6de5-4f7d-99ee-73890f3e3c11 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:01.183725 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c27eaf-6de5-4f7d-99ee-73890f3e3c11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:41:01.186996 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c27eaf-6de5-4f7d-99ee-73890f3e3c11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:01.195277 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c27eaf-6de5-4f7d-99ee-73890f3e3c11 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:01.212918 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1121/2233] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:41:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:41:01.217738 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fd058-b419-4da2-b21f-c05a3740df1d None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:01.233220 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fd058-b419-4da2-b21f-c05a3740df1d None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:01.254338 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbff98-1d9f-41d0-a0fb-ddf3b3a77b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:01.254947 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbff98-1d9f-41d0-a0fb-ddf3b3a77b04 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:01.255238 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbff98-1d9f-41d0-a0fb-ddf3b3a77b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:01.255554 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbff98-1d9f-41d0-a0fb-ddf3b3a77b04 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:01.256215 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbff98-1d9f-41d0-a0fb-ddf3b3a77b04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:01.258147 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbff98-1d9f-41d0-a0fb-ddf3b3a77b04 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:01.286231 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1113/2234] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:41:01 2021] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:41:01.290957 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c27eaf-6de5-4f7d-99ee-73890f3e3c11 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:01.312210 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c27eaf-6de5-4f7d-99ee-73890f3e3c11 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:01.362179 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9610de-c89a-4822-ba09-ec92a7547ca1 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:01.362639 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9610de-c89a-4822-ba09-ec92a7547ca1 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:01.362933 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9610de-c89a-4822-ba09-ec92a7547ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:01.385230 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-af9610de-c89a-4822-ba09-ec92a7547ca1 None None] MFA Rules not processed for user `eeb2dde456a8408d820d765c54f8a868`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:01.394404 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-af9610de-c89a-4822-ba09-ec92a7547ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:01.394510 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba1321-08f5-49a8-879b-635fe66f4f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:01.394510 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba1321-08f5-49a8-879b-635fe66f4f25 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:01.394510 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba1321-08f5-49a8-879b-635fe66f4f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:01.394510 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba1321-08f5-49a8-879b-635fe66f4f25 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:01.394857 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba1321-08f5-49a8-879b-635fe66f4f25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:01.397492 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba1321-08f5-49a8-879b-635fe66f4f25 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:01.420934 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1122/2235] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:41:01 2021] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:41:01.424902 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba1321-08f5-49a8-879b-635fe66f4f25 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:01.435171 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba1321-08f5-49a8-879b-635fe66f4f25 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:01.440154 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7361a-db59-4e8c-8022-025792a01de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:01.440808 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7361a-db59-4e8c-8022-025792a01de1 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:01.441108 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7361a-db59-4e8c-8022-025792a01de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:01.441393 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7361a-db59-4e8c-8022-025792a01de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:01.442095 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7361a-db59-4e8c-8022-025792a01de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:01.444165 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7361a-db59-4e8c-8022-025792a01de1 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:01.455008 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1123/2236] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:41:01 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:41:01.459468 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7361a-db59-4e8c-8022-025792a01de1 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:01.464135 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1114/2237] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:41:01 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:41:01.471067 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7361a-db59-4e8c-8022-025792a01de1 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:01.477030 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95791d7c-82ce-4137-823d-77e6fd1a042a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:01.478293 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95791d7c-82ce-4137-823d-77e6fd1a042a admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:01.478591 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95791d7c-82ce-4137-823d-77e6fd1a042a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:01.478877 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95791d7c-82ce-4137-823d-77e6fd1a042a admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:01.479641 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95791d7c-82ce-4137-823d-77e6fd1a042a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:01.481441 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95791d7c-82ce-4137-823d-77e6fd1a042a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:01.493209 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1124/2238] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:41:01 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:41:01.497508 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9610de-c89a-4822-ba09-ec92a7547ca1 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:01.509557 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9610de-c89a-4822-ba09-ec92a7547ca1 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:01.514720 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2f94b-77f3-48a3-b2b0-6b8ea3217668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:01.515893 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2f94b-77f3-48a3-b2b0-6b8ea3217668 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:01.516350 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2f94b-77f3-48a3-b2b0-6b8ea3217668 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:01.516750 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2f94b-77f3-48a3-b2b0-6b8ea3217668 admin admin] PATH_INFO: `/v3/projects/e337980a10d340e3b0dcc9b87375aedb/users/101274204cd444d7b7f0b0f4ea48ea29/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:01.539542 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2f94b-77f3-48a3-b2b0-6b8ea3217668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e337980a10d340e3b0dcc9b87375aedb, user_id=101274204cd444d7b7f0b0f4ea48ea29, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:01.542577 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2f94b-77f3-48a3-b2b0-6b8ea3217668 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:01.556575 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1115/2239] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:41:01 2021] PUT /identity/v3/projects/e337980a10d340e3b0dcc9b87375aedb/users/101274204cd444d7b7f0b0f4ea48ea29/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:41:01.570972 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45bcd1-0311-405c-abc2-3627053ba758 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:01.571253 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45bcd1-0311-405c-abc2-3627053ba758 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:01.571541 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45bcd1-0311-405c-abc2-3627053ba758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:01.610721 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-5c45bcd1-0311-405c-abc2-3627053ba758 None None] MFA Rules not processed for user `101274204cd444d7b7f0b0f4ea48ea29`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:01.612022 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-5c45bcd1-0311-405c-abc2-3627053ba758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:01.691894 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1125/2240] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:41:01 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:41:01.702138 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2f94b-77f3-48a3-b2b0-6b8ea3217668 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:01.703880 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-2bf2f94b-77f3-48a3-b2b0-6b8ea3217668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:01.774901 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2f94b-77f3-48a3-b2b0-6b8ea3217668 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:01.778430 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f60da7-dfed-47c9-91de-a78483e199ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:01.779018 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f60da7-dfed-47c9-91de-a78483e199ad service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:01.779303 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f60da7-dfed-47c9-91de-a78483e199ad service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:01.779587 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f60da7-dfed-47c9-91de-a78483e199ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:01.788916 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f60da7-dfed-47c9-91de-a78483e199ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:01.790330 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f60da7-dfed-47c9-91de-a78483e199ad service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:01.800762 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1116/2241] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:41:01 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:41:09.780231 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45bcd1-0311-405c-abc2-3627053ba758 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:09.781722 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-5c45bcd1-0311-405c-abc2-3627053ba758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:09.882453 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45bcd1-0311-405c-abc2-3627053ba758 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:09.892730 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40224b34-088c-403b-b889-a6ff57578d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:09.893664 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40224b34-088c-403b-b889-a6ff57578d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:09.894025 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40224b34-088c-403b-b889-a6ff57578d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:09.894379 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40224b34-088c-403b-b889-a6ff57578d5a admin admin] PATH_INFO: `/v3/users/b23dc29a5d6c4a82b8f78c0ee13d5203` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:09.897733 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40224b34-088c-403b-b889-a6ff57578d5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b23dc29a5d6c4a82b8f78c0ee13d5203)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:09.901809 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40224b34-088c-403b-b889-a6ff57578d5a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:09.968594 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-40224b34-088c-403b-b889-a6ff57578d5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b23dc29a5d6c4a82b8f78c0ee13d5203'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:09.971856 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-40224b34-088c-403b-b889-a6ff57578d5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b23dc29a5d6c4a82b8f78c0ee13d5203'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:09.987645 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-40224b34-088c-403b-b889-a6ff57578d5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b23dc29a5d6c4a82b8f78c0ee13d5203'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:09.997484 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-40224b34-088c-403b-b889-a6ff57578d5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b23dc29a5d6c4a82b8f78c0ee13d5203'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:10.009344 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-40224b34-088c-403b-b889-a6ff57578d5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b23dc29a5d6c4a82b8f78c0ee13d5203'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:10.020167 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1126/2242] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:41:09 2021] DELETE /identity/v3/users/b23dc29a5d6c4a82b8f78c0ee13d5203 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:41:10.025406 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f24bd-4fa8-4eb5-bd51-1c5fe5846a6d None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:10.025925 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f24bd-4fa8-4eb5-bd51-1c5fe5846a6d None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:10.026037 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f24bd-4fa8-4eb5-bd51-1c5fe5846a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:10.048941 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-2d2f24bd-4fa8-4eb5-bd51-1c5fe5846a6d None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:10.050117 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-2d2f24bd-4fa8-4eb5-bd51-1c5fe5846a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:10.120358 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1117/2243] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:41:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:41:10.130991 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40224b34-088c-403b-b889-a6ff57578d5a admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:10.132971 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-40224b34-088c-403b-b889-a6ff57578d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:10.203063 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40224b34-088c-403b-b889-a6ff57578d5a admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:10.207222 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c39c2-1ac3-4f3d-a979-a7efa5231c5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:10.207825 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c39c2-1ac3-4f3d-a979-a7efa5231c5e service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:10.208923 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c39c2-1ac3-4f3d-a979-a7efa5231c5e service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:10.209220 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c39c2-1ac3-4f3d-a979-a7efa5231c5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:10.221136 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c39c2-1ac3-4f3d-a979-a7efa5231c5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:10.222692 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c39c2-1ac3-4f3d-a979-a7efa5231c5e service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:10.240465 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1127/2244] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:41:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:41:10.676477 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f24bd-4fa8-4eb5-bd51-1c5fe5846a6d None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:10.678802 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-2d2f24bd-4fa8-4eb5-bd51-1c5fe5846a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:10.692334 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f24bd-4fa8-4eb5-bd51-1c5fe5846a6d None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:10.698943 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2031140-c54e-47ed-b35a-cd33c6af397d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:10.699734 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2031140-c54e-47ed-b35a-cd33c6af397d admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:10.700038 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2031140-c54e-47ed-b35a-cd33c6af397d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:10.700301 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2031140-c54e-47ed-b35a-cd33c6af397d admin admin] PATH_INFO: `/v3/projects/098ab7b6de4a44c7b70ee73f47243884` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:10.701438 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2031140-c54e-47ed-b35a-cd33c6af397d admin admin] RBAC: Authorizing `identity:delete_project(project_id=098ab7b6de4a44c7b70ee73f47243884)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:10.703397 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2031140-c54e-47ed-b35a-cd33c6af397d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:10.755564 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-a2031140-c54e-47ed-b35a-cd33c6af397d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '098ab7b6de4a44c7b70ee73f47243884', 'request_id': 'req-a2031140-c54e-47ed-b35a-cd33c6af397d'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:10.766300 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-a2031140-c54e-47ed-b35a-cd33c6af397d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '098ab7b6de4a44c7b70ee73f47243884', 'request_id': 'req-a2031140-c54e-47ed-b35a-cd33c6af397d'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:10.771742 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-a2031140-c54e-47ed-b35a-cd33c6af397d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '098ab7b6de4a44c7b70ee73f47243884', 'request_id': 'req-a2031140-c54e-47ed-b35a-cd33c6af397d'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:10.784349 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-a2031140-c54e-47ed-b35a-cd33c6af397d admin admin] The token cache is being invalidate because project 098ab7b6de4a44c7b70ee73f47243884 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:41:10.784633 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-a2031140-c54e-47ed-b35a-cd33c6af397d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:10.785324 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-a2031140-c54e-47ed-b35a-cd33c6af397d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:10.787295 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1118/2245] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:41:10 2021] DELETE /identity/v3/projects/098ab7b6de4a44c7b70ee73f47243884 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:41:10.793145 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ed974-23a6-435e-97eb-80708bdb5fee None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:10.793643 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ed974-23a6-435e-97eb-80708bdb5fee None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:10.793766 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ed974-23a6-435e-97eb-80708bdb5fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:10.821476 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-c24ed974-23a6-435e-97eb-80708bdb5fee None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:10.823518 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-c24ed974-23a6-435e-97eb-80708bdb5fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:10.904941 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1128/2246] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:41:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:41:10.914197 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf96047-31f1-4d60-9f18-46ff4d84c90a None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:10.914497 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf96047-31f1-4d60-9f18-46ff4d84c90a None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:10.914786 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf96047-31f1-4d60-9f18-46ff4d84c90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:10.938787 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-bdf96047-31f1-4d60-9f18-46ff4d84c90a None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:10.939976 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-bdf96047-31f1-4d60-9f18-46ff4d84c90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:10.947392 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1119/2247] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:41:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:41:10.951637 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ed974-23a6-435e-97eb-80708bdb5fee None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:10.961236 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ed974-23a6-435e-97eb-80708bdb5fee None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:10.965692 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca923a7f-bc60-4c1b-829f-f14b98bd17d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:10.966294 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca923a7f-bc60-4c1b-829f-f14b98bd17d6 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:10.966585 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca923a7f-bc60-4c1b-829f-f14b98bd17d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:10.966878 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca923a7f-bc60-4c1b-829f-f14b98bd17d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:10.967576 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca923a7f-bc60-4c1b-829f-f14b98bd17d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:41:10.967882 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca923a7f-bc60-4c1b-829f-f14b98bd17d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:10.970202 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca923a7f-bc60-4c1b-829f-f14b98bd17d6 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:10.984409 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1129/2248] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:41:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:41:10.988622 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf96047-31f1-4d60-9f18-46ff4d84c90a None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:10.998674 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf96047-31f1-4d60-9f18-46ff4d84c90a None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:11.003178 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad371c5-4212-4d7f-afcb-855fc94db633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:11.003773 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad371c5-4212-4d7f-afcb-855fc94db633 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:11.004064 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad371c5-4212-4d7f-afcb-855fc94db633 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:11.004344 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad371c5-4212-4d7f-afcb-855fc94db633 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:11.005024 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad371c5-4212-4d7f-afcb-855fc94db633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:11.006950 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad371c5-4212-4d7f-afcb-855fc94db633 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:11.038472 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1120/2249] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:41:10 2021] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:41:11.039924 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca923a7f-bc60-4c1b-829f-f14b98bd17d6 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:11.061160 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca923a7f-bc60-4c1b-829f-f14b98bd17d6 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:11.119858 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f6a47-f5e0-402a-8552-a6eb0a899442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:11.120612 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f6a47-f5e0-402a-8552-a6eb0a899442 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:11.120940 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f6a47-f5e0-402a-8552-a6eb0a899442 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:11.121224 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f6a47-f5e0-402a-8552-a6eb0a899442 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:11.121916 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f6a47-f5e0-402a-8552-a6eb0a899442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:11.123890 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f6a47-f5e0-402a-8552-a6eb0a899442 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:11.151010 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1130/2250] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:41:11 2021] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:41:11.152462 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad371c5-4212-4d7f-afcb-855fc94db633 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:11.163952 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad371c5-4212-4d7f-afcb-855fc94db633 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:11.169966 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f6a47-f5e0-402a-8552-a6eb0a899442 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:11.171708 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-ec8f6a47-f5e0-402a-8552-a6eb0a899442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:11.171892 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56be1a-6bf0-4ee8-a7fa-752550bfd01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:11.172542 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56be1a-6bf0-4ee8-a7fa-752550bfd01d admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:11.172949 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56be1a-6bf0-4ee8-a7fa-752550bfd01d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:11.173298 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56be1a-6bf0-4ee8-a7fa-752550bfd01d admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:11.174087 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56be1a-6bf0-4ee8-a7fa-752550bfd01d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:11.175797 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56be1a-6bf0-4ee8-a7fa-752550bfd01d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:11.184336 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f6a47-f5e0-402a-8552-a6eb0a899442 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:11.190259 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1121/2251] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:41:11 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:41:11.191572 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56be1a-6bf0-4ee8-a7fa-752550bfd01d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:11.192614 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b411c-373a-45db-9ff5-25aeff142a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:11.193537 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b411c-373a-45db-9ff5-25aeff142a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:11.193898 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b411c-373a-45db-9ff5-25aeff142a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:11.194256 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b411c-373a-45db-9ff5-25aeff142a60 admin admin] PATH_INFO: `/v3/users/101274204cd444d7b7f0b0f4ea48ea29` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:11.195512 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b411c-373a-45db-9ff5-25aeff142a60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=101274204cd444d7b7f0b0f4ea48ea29)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:11.197628 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b411c-373a-45db-9ff5-25aeff142a60 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:11.202647 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56be1a-6bf0-4ee8-a7fa-752550bfd01d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:11.213748 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385dab0a-8c60-4bc3-8b27-edc7b8fd95d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:11.214375 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385dab0a-8c60-4bc3-8b27-edc7b8fd95d7 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:11.214674 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385dab0a-8c60-4bc3-8b27-edc7b8fd95d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:11.214955 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385dab0a-8c60-4bc3-8b27-edc7b8fd95d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:11.215656 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385dab0a-8c60-4bc3-8b27-edc7b8fd95d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:11.217477 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385dab0a-8c60-4bc3-8b27-edc7b8fd95d7 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:11.229980 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1122/2252] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:41:11 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:41:11.235296 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385dab0a-8c60-4bc3-8b27-edc7b8fd95d7 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:11.249343 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385dab0a-8c60-4bc3-8b27-edc7b8fd95d7 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:11.254826 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2a54b-85a5-43ca-a3c9-1bd484ecef98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:11.255247 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-551b411c-373a-45db-9ff5-25aeff142a60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '101274204cd444d7b7f0b0f4ea48ea29'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:11.256030 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2a54b-85a5-43ca-a3c9-1bd484ecef98 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:11.256167 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-551b411c-373a-45db-9ff5-25aeff142a60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '101274204cd444d7b7f0b0f4ea48ea29'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:11.256328 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2a54b-85a5-43ca-a3c9-1bd484ecef98 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:11.257396 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2a54b-85a5-43ca-a3c9-1bd484ecef98 admin admin] PATH_INFO: `/v3/projects/fe793e87c25740bbb4479157bfebc7fa/users/ef3bf05b4bf1471f81631729ab61c521/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:11.268709 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-551b411c-373a-45db-9ff5-25aeff142a60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '101274204cd444d7b7f0b0f4ea48ea29'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:11.277867 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-551b411c-373a-45db-9ff5-25aeff142a60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '101274204cd444d7b7f0b0f4ea48ea29'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:11.285771 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-551b411c-373a-45db-9ff5-25aeff142a60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '101274204cd444d7b7f0b0f4ea48ea29'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:11.286921 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2a54b-85a5-43ca-a3c9-1bd484ecef98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe793e87c25740bbb4479157bfebc7fa, user_id=ef3bf05b4bf1471f81631729ab61c521, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:11.289552 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2a54b-85a5-43ca-a3c9-1bd484ecef98 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:11.299050 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1131/2253] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:41:11 2021] DELETE /identity/v3/users/101274204cd444d7b7f0b0f4ea48ea29 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:41:11.300588 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d5e76-ee1d-4667-8a6f-37f11ce9791a None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:11.301168 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d5e76-ee1d-4667-8a6f-37f11ce9791a None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:11.301750 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d5e76-ee1d-4667-8a6f-37f11ce9791a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:11.318460 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1123/2254] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:41:11 2021] PUT /identity/v3/projects/fe793e87c25740bbb4479157bfebc7fa/users/ef3bf05b4bf1471f81631729ab61c521/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:41:11.320476 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936f026-4cfb-42c2-8a8e-4c71379fc26f None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:11.320860 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936f026-4cfb-42c2-8a8e-4c71379fc26f None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:11.321150 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936f026-4cfb-42c2-8a8e-4c71379fc26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:11.326653 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-686d5e76-ee1d-4667-8a6f-37f11ce9791a None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:11.328191 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-686d5e76-ee1d-4667-8a6f-37f11ce9791a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:11.366572 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-7936f026-4cfb-42c2-8a8e-4c71379fc26f None None] MFA Rules not processed for user `ef3bf05b4bf1471f81631729ab61c521`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:11.367539 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-7936f026-4cfb-42c2-8a8e-4c71379fc26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:11.412824 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1132/2255] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:41:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:41:11.420390 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d5e76-ee1d-4667-8a6f-37f11ce9791a None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:11.424127 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-686d5e76-ee1d-4667-8a6f-37f11ce9791a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:11.490682 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1124/2256] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:41:11 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:41:11.496983 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936f026-4cfb-42c2-8a8e-4c71379fc26f None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:11.500106 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-7936f026-4cfb-42c2-8a8e-4c71379fc26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:11.533241 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d5e76-ee1d-4667-8a6f-37f11ce9791a None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:11.537950 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f956d2-7386-4684-ac03-0d512827b0eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:11.538768 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f956d2-7386-4684-ac03-0d512827b0eb service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:11.539060 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f956d2-7386-4684-ac03-0d512827b0eb service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:11.539764 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f956d2-7386-4684-ac03-0d512827b0eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:11.549904 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f956d2-7386-4684-ac03-0d512827b0eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:11.551453 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f956d2-7386-4684-ac03-0d512827b0eb service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:11.561487 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1133/2257] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:41:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:41:11.582206 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936f026-4cfb-42c2-8a8e-4c71379fc26f None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:11.586258 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ee744-4ba8-4bf5-b1b6-f332a496ca2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:11.586834 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ee744-4ba8-4bf5-b1b6-f332a496ca2b service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:11.587116 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ee744-4ba8-4bf5-b1b6-f332a496ca2b service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:11.587391 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ee744-4ba8-4bf5-b1b6-f332a496ca2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:11.597078 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ee744-4ba8-4bf5-b1b6-f332a496ca2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:11.598726 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ee744-4ba8-4bf5-b1b6-f332a496ca2b service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:11.610752 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1125/2258] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:41:11 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:41:11.990280 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f956d2-7386-4684-ac03-0d512827b0eb service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:11.992337 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-a1f956d2-7386-4684-ac03-0d512827b0eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:12.019148 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f956d2-7386-4684-ac03-0d512827b0eb service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:12.026554 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b3866-55fc-40af-830c-cf2da26ec288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:12.027703 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b3866-55fc-40af-830c-cf2da26ec288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:12.028086 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b3866-55fc-40af-830c-cf2da26ec288 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:12.028429 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b3866-55fc-40af-830c-cf2da26ec288 admin admin] PATH_INFO: `/v3/projects/e337980a10d340e3b0dcc9b87375aedb` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:12.029932 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b3866-55fc-40af-830c-cf2da26ec288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e337980a10d340e3b0dcc9b87375aedb)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:12.032028 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b3866-55fc-40af-830c-cf2da26ec288 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:12.102959 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-041b3866-55fc-40af-830c-cf2da26ec288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e337980a10d340e3b0dcc9b87375aedb', 'request_id': 'req-041b3866-55fc-40af-830c-cf2da26ec288'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:12.109518 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-041b3866-55fc-40af-830c-cf2da26ec288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e337980a10d340e3b0dcc9b87375aedb', 'request_id': 'req-041b3866-55fc-40af-830c-cf2da26ec288'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:12.120022 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-041b3866-55fc-40af-830c-cf2da26ec288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e337980a10d340e3b0dcc9b87375aedb', 'request_id': 'req-041b3866-55fc-40af-830c-cf2da26ec288'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:12.151938 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-041b3866-55fc-40af-830c-cf2da26ec288 admin admin] The token cache is being invalidate because project e337980a10d340e3b0dcc9b87375aedb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:41:12.152596 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-041b3866-55fc-40af-830c-cf2da26ec288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:12.153260 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-041b3866-55fc-40af-830c-cf2da26ec288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:12.154709 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1134/2259] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:41:11 2021] DELETE /identity/v3/projects/e337980a10d340e3b0dcc9b87375aedb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:41:12.160999 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7f068-d171-4de5-a84b-1439e81a7879 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:12.161516 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7f068-d171-4de5-a84b-1439e81a7879 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:12.161648 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7f068-d171-4de5-a84b-1439e81a7879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:12.209992 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-dce7f068-d171-4de5-a84b-1439e81a7879 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:12.211550 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-dce7f068-d171-4de5-a84b-1439e81a7879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:12.311103 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1126/2260] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:41:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:41:12.318874 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e27a01-a9b5-4165-866c-ac671bce1649 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:12.319167 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e27a01-a9b5-4165-866c-ac671bce1649 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:12.319452 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e27a01-a9b5-4165-866c-ac671bce1649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:12.342293 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-27e27a01-a9b5-4165-866c-ac671bce1649 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:12.343457 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-27e27a01-a9b5-4165-866c-ac671bce1649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:12.351650 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1135/2261] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:41:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:41:12.360973 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7f068-d171-4de5-a84b-1439e81a7879 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:12.371242 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7f068-d171-4de5-a84b-1439e81a7879 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:12.375783 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc5211-3507-4eea-8f10-b032e030119c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:12.376365 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc5211-3507-4eea-8f10-b032e030119c admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:12.376651 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc5211-3507-4eea-8f10-b032e030119c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:12.376970 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc5211-3507-4eea-8f10-b032e030119c admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:12.377672 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc5211-3507-4eea-8f10-b032e030119c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:41:12.377969 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc5211-3507-4eea-8f10-b032e030119c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:12.379547 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc5211-3507-4eea-8f10-b032e030119c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:12.391694 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1127/2262] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:41:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:41:12.396276 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e27a01-a9b5-4165-866c-ac671bce1649 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:12.405258 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e27a01-a9b5-4165-866c-ac671bce1649 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:12.409696 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d668060-9975-4dbd-b74c-783a773845c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:12.410281 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d668060-9975-4dbd-b74c-783a773845c6 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:12.410571 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d668060-9975-4dbd-b74c-783a773845c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:12.411371 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d668060-9975-4dbd-b74c-783a773845c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:12.412001 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d668060-9975-4dbd-b74c-783a773845c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:12.413916 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d668060-9975-4dbd-b74c-783a773845c6 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:12.440314 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1136/2263] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:41:12 2021] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:41:12.444728 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc5211-3507-4eea-8f10-b032e030119c admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:12.455752 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc5211-3507-4eea-8f10-b032e030119c admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:12.517451 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fdee5-ec1c-42ff-8528-ee04faeb9040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:12.518047 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fdee5-ec1c-42ff-8528-ee04faeb9040 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:12.518335 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fdee5-ec1c-42ff-8528-ee04faeb9040 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:12.518611 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fdee5-ec1c-42ff-8528-ee04faeb9040 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:12.519249 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835fdee5-ec1c-42ff-8528-ee04faeb9040 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:12.521416 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835fdee5-ec1c-42ff-8528-ee04faeb9040 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:12.541145 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1128/2264] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:41:12 2021] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:41:12.545678 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d668060-9975-4dbd-b74c-783a773845c6 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:12.555829 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d668060-9975-4dbd-b74c-783a773845c6 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:12.560135 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd130a-4c7d-47b8-9d3a-29b3013375af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:12.560749 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd130a-4c7d-47b8-9d3a-29b3013375af admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:12.561057 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd130a-4c7d-47b8-9d3a-29b3013375af admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:12.561340 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd130a-4c7d-47b8-9d3a-29b3013375af admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:12.562033 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd130a-4c7d-47b8-9d3a-29b3013375af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:12.563597 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd130a-4c7d-47b8-9d3a-29b3013375af admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:12.577344 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1137/2265] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:41:12 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:41:12.579020 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fdee5-ec1c-42ff-8528-ee04faeb9040 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:12.588949 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fdee5-ec1c-42ff-8528-ee04faeb9040 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:12.593280 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512065fb-0fcd-46a1-bf5e-318ad7446287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:12.593862 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512065fb-0fcd-46a1-bf5e-318ad7446287 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:12.594143 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512065fb-0fcd-46a1-bf5e-318ad7446287 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:12.594426 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512065fb-0fcd-46a1-bf5e-318ad7446287 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:12.595139 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512065fb-0fcd-46a1-bf5e-318ad7446287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:12.596688 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512065fb-0fcd-46a1-bf5e-318ad7446287 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:12.607184 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1129/2266] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:41:12 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:41:12.611518 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd130a-4c7d-47b8-9d3a-29b3013375af admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:12.622645 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd130a-4c7d-47b8-9d3a-29b3013375af admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:12.627626 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf1ae1-a557-47d6-92b5-4cf4821a22af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:12.628532 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf1ae1-a557-47d6-92b5-4cf4821a22af admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:12.628893 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf1ae1-a557-47d6-92b5-4cf4821a22af admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:12.629218 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf1ae1-a557-47d6-92b5-4cf4821a22af admin admin] PATH_INFO: `/v3/projects/3a0a8f8b2ba340f1b5d3aacb9646f676/users/2a4047bb1e8e42099d2263ee1322450d/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:12.651770 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf1ae1-a557-47d6-92b5-4cf4821a22af admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0a8f8b2ba340f1b5d3aacb9646f676, user_id=2a4047bb1e8e42099d2263ee1322450d, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:12.654443 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf1ae1-a557-47d6-92b5-4cf4821a22af admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:12.667831 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1138/2267] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:41:12 2021] PUT /identity/v3/projects/3a0a8f8b2ba340f1b5d3aacb9646f676/users/2a4047bb1e8e42099d2263ee1322450d/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:41:12.673109 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466cf4c-0e53-45ee-bacc-2d5f2fcdf050 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:12.673413 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466cf4c-0e53-45ee-bacc-2d5f2fcdf050 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:12.673703 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466cf4c-0e53-45ee-bacc-2d5f2fcdf050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:12.697429 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-a466cf4c-0e53-45ee-bacc-2d5f2fcdf050 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:12.698585 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-a466cf4c-0e53-45ee-bacc-2d5f2fcdf050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:12.762447 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1130/2268] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:41:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:41:12.773517 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf1ae1-a557-47d6-92b5-4cf4821a22af admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:12.775221 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-95cf1ae1-a557-47d6-92b5-4cf4821a22af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:12.861545 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf1ae1-a557-47d6-92b5-4cf4821a22af admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:12.865148 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454e206-6837-4773-b660-6d4f025adc50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:12.865742 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454e206-6837-4773-b660-6d4f025adc50 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:12.866034 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454e206-6837-4773-b660-6d4f025adc50 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:12.866372 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454e206-6837-4773-b660-6d4f025adc50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:12.876186 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454e206-6837-4773-b660-6d4f025adc50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:12.877659 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454e206-6837-4773-b660-6d4f025adc50 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:12.887797 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1139/2269] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:41:12 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:41:14.011650 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac0043-28ad-4faf-9eac-3ea87b7e670e None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:14.012189 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac0043-28ad-4faf-9eac-3ea87b7e670e None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:14.012493 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac0043-28ad-4faf-9eac-3ea87b7e670e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:14.086757 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-dcac0043-28ad-4faf-9eac-3ea87b7e670e None None] MFA Rules not processed for user `2a4047bb1e8e42099d2263ee1322450d`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:14.088170 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-dcac0043-28ad-4faf-9eac-3ea87b7e670e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:14.242780 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1131/2270] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:41:14 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:41:14.253326 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454e206-6837-4773-b660-6d4f025adc50 service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:14.255817 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-3454e206-6837-4773-b660-6d4f025adc50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:14.358015 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454e206-6837-4773-b660-6d4f025adc50 service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:14.362719 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e44295-642b-44e9-b9b1-fab97c979a02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:14.363593 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e44295-642b-44e9-b9b1-fab97c979a02 service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:14.364478 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e44295-642b-44e9-b9b1-fab97c979a02 service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:14.364866 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e44295-642b-44e9-b9b1-fab97c979a02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:14.375089 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e44295-642b-44e9-b9b1-fab97c979a02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:14.376631 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e44295-642b-44e9-b9b1-fab97c979a02 service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:14.387373 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1140/2271] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:41:14 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:41:16.068023 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd79ab-587b-404a-bd0e-b79b09b5665b None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:16.068544 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd79ab-587b-404a-bd0e-b79b09b5665b None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:16.068663 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd79ab-587b-404a-bd0e-b79b09b5665b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:16.090284 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-17dd79ab-587b-404a-bd0e-b79b09b5665b None None] MFA Rules not processed for user `2a4047bb1e8e42099d2263ee1322450d`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:16.092130 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-17dd79ab-587b-404a-bd0e-b79b09b5665b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:16.099723 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1132/2272] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:41:16 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:41:27.550672 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac7c3e-8c8c-43f2-8fbb-32351d5ff410 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:27.551684 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac7c3e-8c8c-43f2-8fbb-32351d5ff410 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:27.551768 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac7c3e-8c8c-43f2-8fbb-32351d5ff410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:27.584664 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-0cac7c3e-8c8c-43f2-8fbb-32351d5ff410 None None] MFA Rules not processed for user `eeb2dde456a8408d820d765c54f8a868`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:27.585865 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-0cac7c3e-8c8c-43f2-8fbb-32351d5ff410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:27.669790 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1141/2273] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:41:27 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:41:34.618345 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e5f19-7e3c-4750-8dc5-7f5b194c6958 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:34.618866 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e5f19-7e3c-4750-8dc5-7f5b194c6958 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:34.618964 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e5f19-7e3c-4750-8dc5-7f5b194c6958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:34.648630 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-ca7e5f19-7e3c-4750-8dc5-7f5b194c6958 None None] MFA Rules not processed for user `fa7dedfceea346ca997eedec181935c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:34.649881 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-ca7e5f19-7e3c-4750-8dc5-7f5b194c6958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:34.740644 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1133/2274] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Dec 16 14:41:34 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:41:34.787404 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac7c3e-8c8c-43f2-8fbb-32351d5ff410 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:34.788876 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-0cac7c3e-8c8c-43f2-8fbb-32351d5ff410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:34.909551 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac7c3e-8c8c-43f2-8fbb-32351d5ff410 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:34.915116 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4b377-c6dd-4a40-a30e-2cd1ca3fafba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de4c90e44b96488aa47fbbc302e4f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:34.915782 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4b377-c6dd-4a40-a30e-2cd1ca3fafba service swift] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:34.916139 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4b377-c6dd-4a40-a30e-2cd1ca3fafba service swift] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:34.916429 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4b377-c6dd-4a40-a30e-2cd1ca3fafba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:34.925089 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4b377-c6dd-4a40-a30e-2cd1ca3fafba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:34.927206 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4b377-c6dd-4a40-a30e-2cd1ca3fafba service swift] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:41:34.935103 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1142/2275] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Dec 16 14:41:34 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:41:46.028381 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdb62e-c195-44a8-9170-a4d4e98a8134 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:46.029034 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdb62e-c195-44a8-9170-a4d4e98a8134 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:46.029034 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdb62e-c195-44a8-9170-a4d4e98a8134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:46.051196 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-d3fdb62e-c195-44a8-9170-a4d4e98a8134 None None] MFA Rules not processed for user `2a4047bb1e8e42099d2263ee1322450d`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:46.052319 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-d3fdb62e-c195-44a8-9170-a4d4e98a8134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:46.058489 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1134/2276] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:41:46 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:42:00.114574 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69383b2e-509c-4374-aaf2-fb0817a5486a None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:00.115080 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69383b2e-509c-4374-aaf2-fb0817a5486a None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:00.115277 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69383b2e-509c-4374-aaf2-fb0817a5486a None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:00.117620 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1143/2277] 10.222.0.64 () {54 vars in 921 bytes} [Thu Dec 16 14:42:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:42:00.125451 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb3851-fa61-47a8-ac90-3c38fa7cb294 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:00.125932 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb3851-fa61-47a8-ac90-3c38fa7cb294 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:00.126014 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb3851-fa61-47a8-ac90-3c38fa7cb294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:00.241627 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-5bdb3851-fa61-47a8-ac90-3c38fa7cb294 None None] MFA Rules not processed for user `8e416527de444ef1b744da062ee1e7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:00.242788 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-5bdb3851-fa61-47a8-ac90-3c38fa7cb294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:00.347707 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1135/2278] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Dec 16 14:42:00 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:42:00.359183 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69383b2e-509c-4374-aaf2-fb0817a5486a None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:00.360956 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-69383b2e-509c-4374-aaf2-fb0817a5486a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:00.431819 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69383b2e-509c-4374-aaf2-fb0817a5486a None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:00.435504 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67c701-d084-437b-9053-069eb5c92403 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ccebf28ac494f608c33437fc34139be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:00.436102 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67c701-d084-437b-9053-069eb5c92403 service glance] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:00.436401 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67c701-d084-437b-9053-069eb5c92403 service glance] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:00.436681 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67c701-d084-437b-9053-069eb5c92403 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:00.449240 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67c701-d084-437b-9053-069eb5c92403 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:00.450681 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67c701-d084-437b-9053-069eb5c92403 service glance] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:42:00.462729 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1144/2279] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:42:00 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:42:00.538514 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca309c16-bc8b-4e32-953d-f5bcaa8e1a17 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:00.538830 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca309c16-bc8b-4e32-953d-f5bcaa8e1a17 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:00.539118 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca309c16-bc8b-4e32-953d-f5bcaa8e1a17 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:00.541480 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1136/2280] 10.222.0.64 () {54 vars in 921 bytes} [Thu Dec 16 14:42:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:42:00.547054 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5a92a-7437-40bf-b880-010a8d90a03d None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:00.547564 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5a92a-7437-40bf-b880-010a8d90a03d None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:00.548207 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5a92a-7437-40bf-b880-010a8d90a03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:00.590162 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-6ac5a92a-7437-40bf-b880-010a8d90a03d None None] MFA Rules not processed for user `34e25627f3384826b35caf92a804c6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:00.591317 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-6ac5a92a-7437-40bf-b880-010a8d90a03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:00.609058 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1145/2281] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Dec 16 14:42:00 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:42:00.622305 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca309c16-bc8b-4e32-953d-f5bcaa8e1a17 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:00.634628 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca309c16-bc8b-4e32-953d-f5bcaa8e1a17 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:00.638079 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a934d-7ad5-4dbb-88ea-60b7b1875c76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:00.638695 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a934d-7ad5-4dbb-88ea-60b7b1875c76 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:00.638984 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a934d-7ad5-4dbb-88ea-60b7b1875c76 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:00.639265 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a934d-7ad5-4dbb-88ea-60b7b1875c76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:00.647581 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a934d-7ad5-4dbb-88ea-60b7b1875c76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:00.649049 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a934d-7ad5-4dbb-88ea-60b7b1875c76 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:42:00.657479 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1137/2282] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:42:00 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:42:02.427145 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5a92a-7437-40bf-b880-010a8d90a03d None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:02.428492 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-6ac5a92a-7437-40bf-b880-010a8d90a03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:02.489595 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5a92a-7437-40bf-b880-010a8d90a03d None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:02.493968 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea9afa-0aab-4fa3-bb70-b2ad7f760d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:02.494789 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea9afa-0aab-4fa3-bb70-b2ad7f760d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:02.495076 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea9afa-0aab-4fa3-bb70-b2ad7f760d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:02.495355 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea9afa-0aab-4fa3-bb70-b2ad7f760d5f admin admin] PATH_INFO: `/v3/users/ef3bf05b4bf1471f81631729ab61c521` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:02.496478 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea9afa-0aab-4fa3-bb70-b2ad7f760d5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef3bf05b4bf1471f81631729ab61c521)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:02.498420 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea9afa-0aab-4fa3-bb70-b2ad7f760d5f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:42:02.549153 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-edea9afa-0aab-4fa3-bb70-b2ad7f760d5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef3bf05b4bf1471f81631729ab61c521'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:02.550233 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-edea9afa-0aab-4fa3-bb70-b2ad7f760d5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef3bf05b4bf1471f81631729ab61c521'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:02.562673 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-edea9afa-0aab-4fa3-bb70-b2ad7f760d5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef3bf05b4bf1471f81631729ab61c521'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:02.572947 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-edea9afa-0aab-4fa3-bb70-b2ad7f760d5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef3bf05b4bf1471f81631729ab61c521'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:02.580523 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-edea9afa-0aab-4fa3-bb70-b2ad7f760d5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef3bf05b4bf1471f81631729ab61c521'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:02.586309 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1146/2283] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:42:02 2021] DELETE /identity/v3/users/ef3bf05b4bf1471f81631729ab61c521 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:42:02.590710 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6d8b4-0807-43a9-a70a-def28048ed51 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:02.591169 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6d8b4-0807-43a9-a70a-def28048ed51 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:02.591322 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6d8b4-0807-43a9-a70a-def28048ed51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:02.628158 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-fae6d8b4-0807-43a9-a70a-def28048ed51 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:02.629344 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-fae6d8b4-0807-43a9-a70a-def28048ed51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:02.693202 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1138/2284] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:42:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:42:02.703209 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea9afa-0aab-4fa3-bb70-b2ad7f760d5f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:02.704543 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-edea9afa-0aab-4fa3-bb70-b2ad7f760d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:02.790765 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea9afa-0aab-4fa3-bb70-b2ad7f760d5f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:02.797098 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb1e37-c225-4f57-b19a-11834b4315c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:02.797949 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb1e37-c225-4f57-b19a-11834b4315c9 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:02.799247 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb1e37-c225-4f57-b19a-11834b4315c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:02.799714 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb1e37-c225-4f57-b19a-11834b4315c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:02.812443 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb1e37-c225-4f57-b19a-11834b4315c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:02.816174 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb1e37-c225-4f57-b19a-11834b4315c9 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:42:02.828698 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1147/2285] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:42:02 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:42:03.300847 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6d8b4-0807-43a9-a70a-def28048ed51 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:03.302390 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-fae6d8b4-0807-43a9-a70a-def28048ed51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:03.315417 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6d8b4-0807-43a9-a70a-def28048ed51 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:03.322814 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dedd539-b3ec-4a73-8af6-ebf479f4b0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:03.323664 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedd539-b3ec-4a73-8af6-ebf479f4b0e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:03.324135 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedd539-b3ec-4a73-8af6-ebf479f4b0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:03.324595 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedd539-b3ec-4a73-8af6-ebf479f4b0e2 admin admin] PATH_INFO: `/v3/projects/fe793e87c25740bbb4479157bfebc7fa` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:03.325755 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dedd539-b3ec-4a73-8af6-ebf479f4b0e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe793e87c25740bbb4479157bfebc7fa)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:03.327924 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dedd539-b3ec-4a73-8af6-ebf479f4b0e2 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:42:03.384947 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-3dedd539-b3ec-4a73-8af6-ebf479f4b0e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe793e87c25740bbb4479157bfebc7fa', 'request_id': 'req-3dedd539-b3ec-4a73-8af6-ebf479f4b0e2'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:03.397431 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-3dedd539-b3ec-4a73-8af6-ebf479f4b0e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe793e87c25740bbb4479157bfebc7fa', 'request_id': 'req-3dedd539-b3ec-4a73-8af6-ebf479f4b0e2'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:03.404078 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-3dedd539-b3ec-4a73-8af6-ebf479f4b0e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe793e87c25740bbb4479157bfebc7fa', 'request_id': 'req-3dedd539-b3ec-4a73-8af6-ebf479f4b0e2'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:03.422348 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-3dedd539-b3ec-4a73-8af6-ebf479f4b0e2 admin admin] The token cache is being invalidate because project fe793e87c25740bbb4479157bfebc7fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:42:03.422947 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-3dedd539-b3ec-4a73-8af6-ebf479f4b0e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:03.424453 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-3dedd539-b3ec-4a73-8af6-ebf479f4b0e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:03.426519 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1139/2286] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:42:03 2021] DELETE /identity/v3/projects/fe793e87c25740bbb4479157bfebc7fa => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:42:09.154911 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66130a17-6437-4f6b-9c60-c0d77c4be649 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:09.155416 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66130a17-6437-4f6b-9c60-c0d77c4be649 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:09.155718 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66130a17-6437-4f6b-9c60-c0d77c4be649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:09.179449 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-66130a17-6437-4f6b-9c60-c0d77c4be649 None None] MFA Rules not processed for user `fa7dedfceea346ca997eedec181935c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:09.180792 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-66130a17-6437-4f6b-9c60-c0d77c4be649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:09.250221 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1148/2287] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Dec 16 14:42:09 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:42:09.262481 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dedd539-b3ec-4a73-8af6-ebf479f4b0e2 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:09.263851 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-3dedd539-b3ec-4a73-8af6-ebf479f4b0e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:09.342571 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dedd539-b3ec-4a73-8af6-ebf479f4b0e2 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:09.348068 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f4541-c17f-47d7-b9ac-fe24d54ddd3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de4c90e44b96488aa47fbbc302e4f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:09.348806 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f4541-c17f-47d7-b9ac-fe24d54ddd3b service swift] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:09.349199 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f4541-c17f-47d7-b9ac-fe24d54ddd3b service swift] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:09.349585 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f4541-c17f-47d7-b9ac-fe24d54ddd3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:09.358113 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f4541-c17f-47d7-b9ac-fe24d54ddd3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:09.359990 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f4541-c17f-47d7-b9ac-fe24d54ddd3b service swift] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:42:09.371350 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1140/2288] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Dec 16 14:42:09 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 16 14:42:24.895428 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66130a17-6437-4f6b-9c60-c0d77c4be649 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:24.896933 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-66130a17-6437-4f6b-9c60-c0d77c4be649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:25.003410 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66130a17-6437-4f6b-9c60-c0d77c4be649 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:25.008299 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f35b09-f444-4ab9-9ab4-244876fde542 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9a2114d29c4edeb20f394140d390bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:25.008926 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f35b09-f444-4ab9-9ab4-244876fde542 service placement] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:25.009214 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f35b09-f444-4ab9-9ab4-244876fde542 service placement] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:25.009496 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f35b09-f444-4ab9-9ab4-244876fde542 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:25.011208 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-29f35b09-f444-4ab9-9ab4-244876fde542 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:25.023637 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f35b09-f444-4ab9-9ab4-244876fde542 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:25.025260 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f35b09-f444-4ab9-9ab4-244876fde542 service placement] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:42:25.035928 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1149/2289] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:42:24 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:42:25.503090 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861556c-1372-4cd0-beb9-94498d939579 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:25.503656 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861556c-1372-4cd0-beb9-94498d939579 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:25.503754 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861556c-1372-4cd0-beb9-94498d939579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:25.527456 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-2861556c-1372-4cd0-beb9-94498d939579 None None] MFA Rules not processed for user `eeb2dde456a8408d820d765c54f8a868`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:25.528654 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-2861556c-1372-4cd0-beb9-94498d939579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:25.592305 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1141/2290] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:42:25 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:42:37.230617 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f621193-37ad-40fd-9c95-e67bdfe296d0 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:37.231492 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f621193-37ad-40fd-9c95-e67bdfe296d0 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:37.231784 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f621193-37ad-40fd-9c95-e67bdfe296d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:37.256406 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-3f621193-37ad-40fd-9c95-e67bdfe296d0 None None] MFA Rules not processed for user `cb0d5bf878154c6fa174db6389f2ea70`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:37.257750 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-3f621193-37ad-40fd-9c95-e67bdfe296d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:37.320140 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1150/2291] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:42:37 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:42:40.529282 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f06e7-8391-4f26-b247-8d5b0b60442e None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:40.529282 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f06e7-8391-4f26-b247-8d5b0b60442e None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:40.529282 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f06e7-8391-4f26-b247-8d5b0b60442e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:40.549086 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-f35f06e7-8391-4f26-b247-8d5b0b60442e None None] MFA Rules not processed for user `fa7dedfceea346ca997eedec181935c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:40.550244 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-f35f06e7-8391-4f26-b247-8d5b0b60442e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:40.558584 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1142/2292] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Dec 16 14:42:40 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:42:40.583208 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f621193-37ad-40fd-9c95-e67bdfe296d0 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:40.595606 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f621193-37ad-40fd-9c95-e67bdfe296d0 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:40.600910 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341c6c3-edbe-4a5c-bbbf-618027e05df5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de4c90e44b96488aa47fbbc302e4f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:40.601961 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341c6c3-edbe-4a5c-bbbf-618027e05df5 service swift] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:40.601961 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341c6c3-edbe-4a5c-bbbf-618027e05df5 service swift] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:40.602119 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341c6c3-edbe-4a5c-bbbf-618027e05df5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:40.611450 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341c6c3-edbe-4a5c-bbbf-618027e05df5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:40.613064 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341c6c3-edbe-4a5c-bbbf-618027e05df5 service swift] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:42:40.621323 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1151/2293] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Dec 16 14:42:40 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:42:45.405470 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1642334-9661-42d6-9d61-06928cd8ccab None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:45.406599 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1642334-9661-42d6-9d61-06928cd8ccab None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:45.407593 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1642334-9661-42d6-9d61-06928cd8ccab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:45.496423 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-f1642334-9661-42d6-9d61-06928cd8ccab None None] MFA Rules not processed for user `fa7dedfceea346ca997eedec181935c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:45.498673 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-f1642334-9661-42d6-9d61-06928cd8ccab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:45.524317 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1143/2294] 10.222.0.64 () {58 vars in 967 bytes} [Thu Dec 16 14:42:45 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:42:45.547859 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341c6c3-edbe-4a5c-bbbf-618027e05df5 service swift] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:45.593639 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341c6c3-edbe-4a5c-bbbf-618027e05df5 service swift] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:45.607066 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fd4a7-66eb-4fb4-bdb9-4d4990569023 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de4c90e44b96488aa47fbbc302e4f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:45.608008 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fd4a7-66eb-4fb4-bdb9-4d4990569023 service swift] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:45.608490 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fd4a7-66eb-4fb4-bdb9-4d4990569023 service swift] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:45.609009 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fd4a7-66eb-4fb4-bdb9-4d4990569023 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:45.623119 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872fd4a7-66eb-4fb4-bdb9-4d4990569023 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:45.624906 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872fd4a7-66eb-4fb4-bdb9-4d4990569023 service swift] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:42:45.644672 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1152/2295] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Dec 16 14:42:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:42:55.461860 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1642334-9661-42d6-9d61-06928cd8ccab None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:55.463269 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-f1642334-9661-42d6-9d61-06928cd8ccab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:55.564594 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1642334-9661-42d6-9d61-06928cd8ccab None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:55.569689 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1d74a-d779-4cfd-b4c8-4894981e8de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:55.570549 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1d74a-d779-4cfd-b4c8-4894981e8de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:55.570871 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1d74a-d779-4cfd-b4c8-4894981e8de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:55.571357 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1d74a-d779-4cfd-b4c8-4894981e8de5 admin admin] PATH_INFO: `/v3/users/4166133ac04844d491662feab2bd2d21` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:55.572720 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e1d74a-d779-4cfd-b4c8-4894981e8de5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4166133ac04844d491662feab2bd2d21)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:55.575195 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e1d74a-d779-4cfd-b4c8-4894981e8de5 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:42:55.636319 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-a8e1d74a-d779-4cfd-b4c8-4894981e8de5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4166133ac04844d491662feab2bd2d21'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:55.637302 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-a8e1d74a-d779-4cfd-b4c8-4894981e8de5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4166133ac04844d491662feab2bd2d21'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:55.651292 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-a8e1d74a-d779-4cfd-b4c8-4894981e8de5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4166133ac04844d491662feab2bd2d21'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:55.660838 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-a8e1d74a-d779-4cfd-b4c8-4894981e8de5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4166133ac04844d491662feab2bd2d21'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:55.671879 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-a8e1d74a-d779-4cfd-b4c8-4894981e8de5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4166133ac04844d491662feab2bd2d21'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:55.679723 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1144/2296] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:42:55 2021] DELETE /identity/v3/users/4166133ac04844d491662feab2bd2d21 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:42:55.974652 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fd4a7-66eb-4fb4-bdb9-4d4990569023 service swift] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:55.987051 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fd4a7-66eb-4fb4-bdb9-4d4990569023 service swift] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:56.069260 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69532a-9fba-413b-bf46-6253c6d76b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:56.070094 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69532a-9fba-413b-bf46-6253c6d76b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:56.070382 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69532a-9fba-413b-bf46-6253c6d76b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:56.070669 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69532a-9fba-413b-bf46-6253c6d76b75 admin admin] PATH_INFO: `/v3/projects/ceb0da71791f4f9889daab33c73ac572` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:56.071823 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69532a-9fba-413b-bf46-6253c6d76b75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceb0da71791f4f9889daab33c73ac572)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:56.073849 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69532a-9fba-413b-bf46-6253c6d76b75 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:42:56.138286 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-1c69532a-9fba-413b-bf46-6253c6d76b75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceb0da71791f4f9889daab33c73ac572', 'request_id': 'req-1c69532a-9fba-413b-bf46-6253c6d76b75'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:56.146785 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-1c69532a-9fba-413b-bf46-6253c6d76b75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceb0da71791f4f9889daab33c73ac572', 'request_id': 'req-1c69532a-9fba-413b-bf46-6253c6d76b75'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:56.156096 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-1c69532a-9fba-413b-bf46-6253c6d76b75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceb0da71791f4f9889daab33c73ac572', 'request_id': 'req-1c69532a-9fba-413b-bf46-6253c6d76b75'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:56.182444 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-1c69532a-9fba-413b-bf46-6253c6d76b75 admin admin] The token cache is being invalidate because project ceb0da71791f4f9889daab33c73ac572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:42:56.183065 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-1c69532a-9fba-413b-bf46-6253c6d76b75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:56.183969 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-1c69532a-9fba-413b-bf46-6253c6d76b75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:56.185760 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1153/2297] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:42:55 2021] DELETE /identity/v3/projects/ceb0da71791f4f9889daab33c73ac572 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:42:56.193302 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071242c1-9218-43a2-8dc1-b67aa5cfb9b4 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:56.193802 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071242c1-9218-43a2-8dc1-b67aa5cfb9b4 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:56.194344 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071242c1-9218-43a2-8dc1-b67aa5cfb9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:56.262201 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-071242c1-9218-43a2-8dc1-b67aa5cfb9b4 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:56.265228 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-071242c1-9218-43a2-8dc1-b67aa5cfb9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:56.372820 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1145/2298] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:42:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:42:56.384923 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35429e1-25d0-4807-a335-14d5a71675e0 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:56.385580 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35429e1-25d0-4807-a335-14d5a71675e0 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:56.386095 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35429e1-25d0-4807-a335-14d5a71675e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:56.420301 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-e35429e1-25d0-4807-a335-14d5a71675e0 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:56.422695 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e35429e1-25d0-4807-a335-14d5a71675e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:56.432864 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1154/2299] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:42:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:42:56.437106 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071242c1-9218-43a2-8dc1-b67aa5cfb9b4 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:56.447001 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071242c1-9218-43a2-8dc1-b67aa5cfb9b4 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:56.452732 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9f6c7-a072-4612-a04b-9803a356cc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:56.453481 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9f6c7-a072-4612-a04b-9803a356cc65 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:56.453845 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9f6c7-a072-4612-a04b-9803a356cc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:56.454200 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9f6c7-a072-4612-a04b-9803a356cc65 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:56.454993 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9f6c7-a072-4612-a04b-9803a356cc65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:42:56.455364 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9f6c7-a072-4612-a04b-9803a356cc65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:56.457074 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9f6c7-a072-4612-a04b-9803a356cc65 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:42:56.475363 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1146/2300] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:42:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:42:56.477092 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35429e1-25d0-4807-a335-14d5a71675e0 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:56.498515 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35429e1-25d0-4807-a335-14d5a71675e0 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:56.513954 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63cfd7-3530-4e35-af14-f63487a380f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:56.514793 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63cfd7-3530-4e35-af14-f63487a380f4 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:56.515553 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63cfd7-3530-4e35-af14-f63487a380f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:56.516046 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63cfd7-3530-4e35-af14-f63487a380f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:56.516952 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63cfd7-3530-4e35-af14-f63487a380f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:56.519129 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63cfd7-3530-4e35-af14-f63487a380f4 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:42:56.568754 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1155/2301] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:42:56 2021] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:42:56.572037 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9f6c7-a072-4612-a04b-9803a356cc65 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:56.584497 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9f6c7-a072-4612-a04b-9803a356cc65 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:56.677880 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbc369-2414-4a19-b4ae-4170b4c9c8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:56.679056 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbc369-2414-4a19-b4ae-4170b4c9c8a5 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:56.679347 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbc369-2414-4a19-b4ae-4170b4c9c8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:56.679633 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbc369-2414-4a19-b4ae-4170b4c9c8a5 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:56.680334 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbbc369-2414-4a19-b4ae-4170b4c9c8a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:56.682342 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbbc369-2414-4a19-b4ae-4170b4c9c8a5 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:42:56.708505 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1147/2302] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:42:56 2021] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:42:56.712618 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63cfd7-3530-4e35-af14-f63487a380f4 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:56.726475 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63cfd7-3530-4e35-af14-f63487a380f4 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:56.731922 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe36e9a-bd7e-4d71-ace1-a97b9bbf2625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:56.732908 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe36e9a-bd7e-4d71-ace1-a97b9bbf2625 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:56.733271 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe36e9a-bd7e-4d71-ace1-a97b9bbf2625 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:56.733613 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe36e9a-bd7e-4d71-ace1-a97b9bbf2625 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:56.735077 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe36e9a-bd7e-4d71-ace1-a97b9bbf2625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:56.736692 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe36e9a-bd7e-4d71-ace1-a97b9bbf2625 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:42:56.751396 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1156/2303] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:42:56 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:42:56.752342 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbc369-2414-4a19-b4ae-4170b4c9c8a5 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:56.763387 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbc369-2414-4a19-b4ae-4170b4c9c8a5 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:56.768439 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028cc3d-f269-4517-bdf9-eb03e5ac209e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:56.769095 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028cc3d-f269-4517-bdf9-eb03e5ac209e admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:56.769388 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028cc3d-f269-4517-bdf9-eb03e5ac209e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:56.769670 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028cc3d-f269-4517-bdf9-eb03e5ac209e admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:56.770379 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028cc3d-f269-4517-bdf9-eb03e5ac209e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:56.771987 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028cc3d-f269-4517-bdf9-eb03e5ac209e admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:42:56.786664 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1148/2304] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:42:56 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:42:56.788236 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe36e9a-bd7e-4d71-ace1-a97b9bbf2625 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:56.802090 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe36e9a-bd7e-4d71-ace1-a97b9bbf2625 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:56.807150 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2587c-80d4-472f-adfe-b39dbf88a973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:56.808136 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2587c-80d4-472f-adfe-b39dbf88a973 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:56.808429 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2587c-80d4-472f-adfe-b39dbf88a973 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:56.808717 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2587c-80d4-472f-adfe-b39dbf88a973 admin admin] PATH_INFO: `/v3/projects/2b380512fda640f3a469344c0427c7b1/users/ee8cdf18936645f690106d9d65a729e7/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:56.832253 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2587c-80d4-472f-adfe-b39dbf88a973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b380512fda640f3a469344c0427c7b1, user_id=ee8cdf18936645f690106d9d65a729e7, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:56.835160 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2587c-80d4-472f-adfe-b39dbf88a973 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:42:56.856862 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1157/2305] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:42:56 2021] PUT /identity/v3/projects/2b380512fda640f3a469344c0427c7b1/users/ee8cdf18936645f690106d9d65a729e7/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:42:56.860798 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40caec8-07dc-45dc-aab5-c70b09afbda9 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:56.861465 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40caec8-07dc-45dc-aab5-c70b09afbda9 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:56.861956 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40caec8-07dc-45dc-aab5-c70b09afbda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:56.907774 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-a40caec8-07dc-45dc-aab5-c70b09afbda9 None None] MFA Rules not processed for user `ee8cdf18936645f690106d9d65a729e7`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:56.908989 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-a40caec8-07dc-45dc-aab5-c70b09afbda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:56.995520 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1149/2306] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:42:56 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:42:57.002231 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2587c-80d4-472f-adfe-b39dbf88a973 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:57.003914 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-b7e2587c-80d4-472f-adfe-b39dbf88a973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:57.092826 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2587c-80d4-472f-adfe-b39dbf88a973 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:57.099067 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586b6f2-cdff-4971-9480-c9d191471e43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:57.099657 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586b6f2-cdff-4971-9480-c9d191471e43 service nova] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:57.099945 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586b6f2-cdff-4971-9480-c9d191471e43 service nova] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:57.100228 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586b6f2-cdff-4971-9480-c9d191471e43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:57.108680 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586b6f2-cdff-4971-9480-c9d191471e43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:57.110346 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586b6f2-cdff-4971-9480-c9d191471e43 service nova] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:42:57.119714 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1158/2307] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:42:57 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:43:03.681101 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78851c-58e2-4581-a03b-c0aefcc159ca None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:03.681574 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78851c-58e2-4581-a03b-c0aefcc159ca None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:03.681685 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78851c-58e2-4581-a03b-c0aefcc159ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:03.704629 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-7a78851c-58e2-4581-a03b-c0aefcc159ca None None] MFA Rules not processed for user `fa7dedfceea346ca997eedec181935c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:03.705821 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-7a78851c-58e2-4581-a03b-c0aefcc159ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:03.778425 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1150/2308] 10.222.0.64 () {58 vars in 967 bytes} [Thu Dec 16 14:43:03 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:03.791664 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586b6f2-cdff-4971-9480-c9d191471e43 service nova] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:03.793068 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-3586b6f2-cdff-4971-9480-c9d191471e43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:03.899889 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586b6f2-cdff-4971-9480-c9d191471e43 service nova] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:03.904725 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3bf45-c30d-42e7-9c19-9cba9bc37dc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de4c90e44b96488aa47fbbc302e4f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:03.905344 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3bf45-c30d-42e7-9c19-9cba9bc37dc4 service swift] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:03.906184 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3bf45-c30d-42e7-9c19-9cba9bc37dc4 service swift] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:03.906469 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3bf45-c30d-42e7-9c19-9cba9bc37dc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:03.915486 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef3bf45-c30d-42e7-9c19-9cba9bc37dc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:03.916805 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef3bf45-c30d-42e7-9c19-9cba9bc37dc4 service swift] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:03.925483 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1159/2309] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Dec 16 14:43:03 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:43:06.498600 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78851c-58e2-4581-a03b-c0aefcc159ca None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:06.500555 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-7a78851c-58e2-4581-a03b-c0aefcc159ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:06.599180 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78851c-58e2-4581-a03b-c0aefcc159ca None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:06.603472 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc360e3e-4814-48d2-9d19-37f04eee4e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:06.604277 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc360e3e-4814-48d2-9d19-37f04eee4e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:06.604563 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc360e3e-4814-48d2-9d19-37f04eee4e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:06.604875 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc360e3e-4814-48d2-9d19-37f04eee4e8c admin admin] PATH_INFO: `/v3/users/2a4047bb1e8e42099d2263ee1322450d` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:06.606057 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc360e3e-4814-48d2-9d19-37f04eee4e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a4047bb1e8e42099d2263ee1322450d)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:06.607973 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc360e3e-4814-48d2-9d19-37f04eee4e8c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:06.652112 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3bf45-c30d-42e7-9c19-9cba9bc37dc4 service swift] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:06.663519 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3bf45-c30d-42e7-9c19-9cba9bc37dc4 service swift] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:06.668404 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe944bd3-70b5-4e1c-86c1-ada9befd1d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:06.669752 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe944bd3-70b5-4e1c-86c1-ada9befd1d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:06.670221 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe944bd3-70b5-4e1c-86c1-ada9befd1d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:06.670692 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe944bd3-70b5-4e1c-86c1-ada9befd1d02 admin admin] PATH_INFO: `/v3/users/ee8cdf18936645f690106d9d65a729e7` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:06.672579 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe944bd3-70b5-4e1c-86c1-ada9befd1d02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee8cdf18936645f690106d9d65a729e7)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:06.675399 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-bc360e3e-4814-48d2-9d19-37f04eee4e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a4047bb1e8e42099d2263ee1322450d'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:06.675980 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe944bd3-70b5-4e1c-86c1-ada9befd1d02 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:06.676383 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-bc360e3e-4814-48d2-9d19-37f04eee4e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a4047bb1e8e42099d2263ee1322450d'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:06.694792 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-bc360e3e-4814-48d2-9d19-37f04eee4e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a4047bb1e8e42099d2263ee1322450d'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:06.704064 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-bc360e3e-4814-48d2-9d19-37f04eee4e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a4047bb1e8e42099d2263ee1322450d'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:06.713698 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-bc360e3e-4814-48d2-9d19-37f04eee4e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a4047bb1e8e42099d2263ee1322450d'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:06.722702 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1151/2310] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:43:06 2021] DELETE /identity/v3/users/2a4047bb1e8e42099d2263ee1322450d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:06.741581 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-fe944bd3-70b5-4e1c-86c1-ada9befd1d02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee8cdf18936645f690106d9d65a729e7'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:06.742309 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-fe944bd3-70b5-4e1c-86c1-ada9befd1d02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee8cdf18936645f690106d9d65a729e7'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:06.756598 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-fe944bd3-70b5-4e1c-86c1-ada9befd1d02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee8cdf18936645f690106d9d65a729e7'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:06.765583 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-fe944bd3-70b5-4e1c-86c1-ada9befd1d02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee8cdf18936645f690106d9d65a729e7'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:06.776141 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-fe944bd3-70b5-4e1c-86c1-ada9befd1d02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee8cdf18936645f690106d9d65a729e7'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:06.784010 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1160/2311] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:43:06 2021] DELETE /identity/v3/users/ee8cdf18936645f690106d9d65a729e7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:43:06.789834 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a40f37-6728-4416-a957-d93f8fdc2ff2 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:06.790132 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a40f37-6728-4416-a957-d93f8fdc2ff2 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:06.790413 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a40f37-6728-4416-a957-d93f8fdc2ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:06.813266 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-a3a40f37-6728-4416-a957-d93f8fdc2ff2 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:06.814383 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-a3a40f37-6728-4416-a957-d93f8fdc2ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:06.901943 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1152/2312] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:43:06.914472 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe944bd3-70b5-4e1c-86c1-ada9befd1d02 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:06.915928 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-fe944bd3-70b5-4e1c-86c1-ada9befd1d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:06.975997 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a40f37-6728-4416-a957-d93f8fdc2ff2 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:06.977491 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-a3a40f37-6728-4416-a957-d93f8fdc2ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:06.986763 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe944bd3-70b5-4e1c-86c1-ada9befd1d02 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:06.990298 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a40f37-6728-4416-a957-d93f8fdc2ff2 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:06.994092 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad0114-218f-41a9-9967-e0ddc1e1cc42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:06.994092 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad0114-218f-41a9-9967-e0ddc1e1cc42 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:06.994092 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad0114-218f-41a9-9967-e0ddc1e1cc42 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:06.994092 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad0114-218f-41a9-9967-e0ddc1e1cc42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:06.997342 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75495526-d6a2-448f-8f2a-7a3dab44869d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:06.998163 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75495526-d6a2-448f-8f2a-7a3dab44869d admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:06.998457 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75495526-d6a2-448f-8f2a-7a3dab44869d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:06.998743 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75495526-d6a2-448f-8f2a-7a3dab44869d admin admin] PATH_INFO: `/v3/projects/3a0a8f8b2ba340f1b5d3aacb9646f676` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:07.000461 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75495526-d6a2-448f-8f2a-7a3dab44869d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a0a8f8b2ba340f1b5d3aacb9646f676)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:07.002825 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75495526-d6a2-448f-8f2a-7a3dab44869d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:07.004047 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad0114-218f-41a9-9967-e0ddc1e1cc42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:07.005680 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad0114-218f-41a9-9967-e0ddc1e1cc42 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:07.017514 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1161/2313] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:43:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:43:07.065798 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-75495526-d6a2-448f-8f2a-7a3dab44869d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'request_id': 'req-75495526-d6a2-448f-8f2a-7a3dab44869d'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:07.085357 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-75495526-d6a2-448f-8f2a-7a3dab44869d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'request_id': 'req-75495526-d6a2-448f-8f2a-7a3dab44869d'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:07.092598 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-75495526-d6a2-448f-8f2a-7a3dab44869d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'request_id': 'req-75495526-d6a2-448f-8f2a-7a3dab44869d'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:07.107557 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-75495526-d6a2-448f-8f2a-7a3dab44869d admin admin] The token cache is being invalidate because project 3a0a8f8b2ba340f1b5d3aacb9646f676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:43:07.107837 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-75495526-d6a2-448f-8f2a-7a3dab44869d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:07.108552 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-75495526-d6a2-448f-8f2a-7a3dab44869d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:07.110141 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1153/2314] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:43:06 2021] DELETE /identity/v3/projects/3a0a8f8b2ba340f1b5d3aacb9646f676 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:43:07.118405 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd4a95-27bd-42ce-b74b-b42a45300ba3 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:07.119323 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd4a95-27bd-42ce-b74b-b42a45300ba3 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:07.119823 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd4a95-27bd-42ce-b74b-b42a45300ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:07.147826 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-5edd4a95-27bd-42ce-b74b-b42a45300ba3 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:07.149047 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-5edd4a95-27bd-42ce-b74b-b42a45300ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:07.221608 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1162/2315] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:07.230236 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06850d-531d-45c6-bd30-d55fdff8c8bf None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:07.230536 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06850d-531d-45c6-bd30-d55fdff8c8bf None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:07.230829 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06850d-531d-45c6-bd30-d55fdff8c8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:07.256360 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-af06850d-531d-45c6-bd30-d55fdff8c8bf None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:07.257662 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-af06850d-531d-45c6-bd30-d55fdff8c8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:07.267444 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1154/2316] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:43:07.271909 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd4a95-27bd-42ce-b74b-b42a45300ba3 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:07.281837 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd4a95-27bd-42ce-b74b-b42a45300ba3 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:07.286570 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e75245-5358-49df-87de-deb47e0e9953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:07.287250 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e75245-5358-49df-87de-deb47e0e9953 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:07.287645 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e75245-5358-49df-87de-deb47e0e9953 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:07.287996 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e75245-5358-49df-87de-deb47e0e9953 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:07.288818 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e75245-5358-49df-87de-deb47e0e9953 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:43:07.289196 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e75245-5358-49df-87de-deb47e0e9953 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:07.290964 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e75245-5358-49df-87de-deb47e0e9953 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:07.305519 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1163/2317] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:43:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:43:07.310207 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06850d-531d-45c6-bd30-d55fdff8c8bf None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:07.320108 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06850d-531d-45c6-bd30-d55fdff8c8bf None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:07.324534 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ac4d1-a28f-4f76-b5c7-f2ca913aab66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:07.325217 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ac4d1-a28f-4f76-b5c7-f2ca913aab66 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:07.325512 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ac4d1-a28f-4f76-b5c7-f2ca913aab66 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:07.325799 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ac4d1-a28f-4f76-b5c7-f2ca913aab66 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:07.326471 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ac4d1-a28f-4f76-b5c7-f2ca913aab66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:07.328434 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ac4d1-a28f-4f76-b5c7-f2ca913aab66 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:07.359403 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1155/2318] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:43:07 2021] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:43:07.364123 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e75245-5358-49df-87de-deb47e0e9953 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:07.374147 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e75245-5358-49df-87de-deb47e0e9953 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:07.400252 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ac4d1-a28f-4f76-b5c7-f2ca913aab66 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:07.402002 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-422ac4d1-a28f-4f76-b5c7-f2ca913aab66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:07.452068 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b5b08-0edf-40e2-83e2-85c407088e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:07.452929 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b5b08-0edf-40e2-83e2-85c407088e93 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:07.453391 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b5b08-0edf-40e2-83e2-85c407088e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:07.453751 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b5b08-0edf-40e2-83e2-85c407088e93 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:07.454499 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b5b08-0edf-40e2-83e2-85c407088e93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:07.456574 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b5b08-0edf-40e2-83e2-85c407088e93 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:07.481691 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ac4d1-a28f-4f76-b5c7-f2ca913aab66 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:07.487506 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1164/2319] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:43:07 2021] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:43:07.491584 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b5b08-0edf-40e2-83e2-85c407088e93 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:07.495096 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a05b77-3273-4cb3-ba8a-70edac71b744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:07.496747 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a05b77-3273-4cb3-ba8a-70edac71b744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:07.497617 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a05b77-3273-4cb3-ba8a-70edac71b744 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:07.498351 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a05b77-3273-4cb3-ba8a-70edac71b744 admin admin] PATH_INFO: `/v3/projects/2b380512fda640f3a469344c0427c7b1` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:07.501103 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a05b77-3273-4cb3-ba8a-70edac71b744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b380512fda640f3a469344c0427c7b1)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:07.502613 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b5b08-0edf-40e2-83e2-85c407088e93 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:07.506562 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a05b77-3273-4cb3-ba8a-70edac71b744 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:07.510308 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e32eb-8603-42c9-a649-85dd7475aad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:07.510956 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e32eb-8603-42c9-a649-85dd7475aad8 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:07.511426 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e32eb-8603-42c9-a649-85dd7475aad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:07.511690 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e32eb-8603-42c9-a649-85dd7475aad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:07.512391 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e32eb-8603-42c9-a649-85dd7475aad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:07.514228 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e32eb-8603-42c9-a649-85dd7475aad8 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:07.528993 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1165/2320] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:07 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:43:07.529969 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e32eb-8603-42c9-a649-85dd7475aad8 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:07.539792 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e32eb-8603-42c9-a649-85dd7475aad8 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:07.544259 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5958c-e0d1-47bb-b1bc-6f5e61f0058a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:07.544916 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5958c-e0d1-47bb-b1bc-6f5e61f0058a admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:07.545210 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5958c-e0d1-47bb-b1bc-6f5e61f0058a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:07.545494 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5958c-e0d1-47bb-b1bc-6f5e61f0058a admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:07.546728 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5958c-e0d1-47bb-b1bc-6f5e61f0058a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:07.548340 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5958c-e0d1-47bb-b1bc-6f5e61f0058a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:07.561345 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1166/2321] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:07 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:43:07.567751 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5958c-e0d1-47bb-b1bc-6f5e61f0058a admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:07.578927 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5958c-e0d1-47bb-b1bc-6f5e61f0058a admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:07.590420 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-f5a05b77-3273-4cb3-ba8a-70edac71b744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b380512fda640f3a469344c0427c7b1', 'request_id': 'req-f5a05b77-3273-4cb3-ba8a-70edac71b744'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:07.608230 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-f5a05b77-3273-4cb3-ba8a-70edac71b744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b380512fda640f3a469344c0427c7b1', 'request_id': 'req-f5a05b77-3273-4cb3-ba8a-70edac71b744'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:07.609114 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-f5a05b77-3273-4cb3-ba8a-70edac71b744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b380512fda640f3a469344c0427c7b1', 'request_id': 'req-f5a05b77-3273-4cb3-ba8a-70edac71b744'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:07.634828 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-f5a05b77-3273-4cb3-ba8a-70edac71b744 admin admin] The token cache is being invalidate because project 2b380512fda640f3a469344c0427c7b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:43:07.635463 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-f5a05b77-3273-4cb3-ba8a-70edac71b744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:07.637000 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-f5a05b77-3273-4cb3-ba8a-70edac71b744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:07.640588 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1156/2322] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:43:07 2021] DELETE /identity/v3/projects/2b380512fda640f3a469344c0427c7b1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:43:07.649740 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0be7fb-c7d1-4738-86d7-e9d2f8a295db None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:07.650453 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0be7fb-c7d1-4738-86d7-e9d2f8a295db None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:07.650746 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0be7fb-c7d1-4738-86d7-e9d2f8a295db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:07.658816 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ddd4c-93a3-471e-a50e-df0ca02dc329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:07.659731 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ddd4c-93a3-471e-a50e-df0ca02dc329 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:07.660080 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ddd4c-93a3-471e-a50e-df0ca02dc329 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:07.660420 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ddd4c-93a3-471e-a50e-df0ca02dc329 admin admin] PATH_INFO: `/v3/projects/dc988a0f77ba4d9f8a2443542b107904/users/309278edd3fe4259ab1d210cca892442/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:07.676068 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-eb0be7fb-c7d1-4738-86d7-e9d2f8a295db None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:07.677410 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-eb0be7fb-c7d1-4738-86d7-e9d2f8a295db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:07.684655 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ddd4c-93a3-471e-a50e-df0ca02dc329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc988a0f77ba4d9f8a2443542b107904, user_id=309278edd3fe4259ab1d210cca892442, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:07.686960 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1157/2323] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:43:07.687427 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ddd4c-93a3-471e-a50e-df0ca02dc329 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:07.695688 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7451f-18d4-45de-86a8-d57842ba2243 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:07.695985 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7451f-18d4-45de-86a8-d57842ba2243 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:07.696270 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7451f-18d4-45de-86a8-d57842ba2243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:07.705552 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1167/2324] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:07 2021] PUT /identity/v3/projects/dc988a0f77ba4d9f8a2443542b107904/users/309278edd3fe4259ab1d210cca892442/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:43:07.721061 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-f3c7451f-18d4-45de-86a8-d57842ba2243 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:07.722221 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-f3c7451f-18d4-45de-86a8-d57842ba2243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:07.722525 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda58c35-d112-4ee0-857e-4cca8d099c92 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:07.722924 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda58c35-d112-4ee0-857e-4cca8d099c92 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:07.723219 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda58c35-d112-4ee0-857e-4cca8d099c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:07.760339 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-eda58c35-d112-4ee0-857e-4cca8d099c92 None None] MFA Rules not processed for user `309278edd3fe4259ab1d210cca892442`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:07.761806 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-eda58c35-d112-4ee0-857e-4cca8d099c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:07.790194 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1158/2325] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:07.794260 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7451f-18d4-45de-86a8-d57842ba2243 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:07.804685 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7451f-18d4-45de-86a8-d57842ba2243 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:07.809658 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba524ebe-2b74-4331-9d8d-769850264c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:07.810266 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba524ebe-2b74-4331-9d8d-769850264c66 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:07.810562 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba524ebe-2b74-4331-9d8d-769850264c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:07.810849 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba524ebe-2b74-4331-9d8d-769850264c66 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:07.811624 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba524ebe-2b74-4331-9d8d-769850264c66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:43:07.811931 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba524ebe-2b74-4331-9d8d-769850264c66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:07.813558 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba524ebe-2b74-4331-9d8d-769850264c66 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:07.827550 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1159/2326] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:43:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:43:07.831769 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba524ebe-2b74-4331-9d8d-769850264c66 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:07.841783 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba524ebe-2b74-4331-9d8d-769850264c66 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:07.847277 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cff15-bf24-42e1-935c-5a1fa4b0750b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:07.847870 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cff15-bf24-42e1-935c-5a1fa4b0750b admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:07.848159 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cff15-bf24-42e1-935c-5a1fa4b0750b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:07.848460 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cff15-bf24-42e1-935c-5a1fa4b0750b admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:07.849140 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575cff15-bf24-42e1-935c-5a1fa4b0750b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:07.851014 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575cff15-bf24-42e1-935c-5a1fa4b0750b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:07.876961 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1168/2327] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:07 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:43:07.883842 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda58c35-d112-4ee0-857e-4cca8d099c92 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:07.885273 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-eda58c35-d112-4ee0-857e-4cca8d099c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:07.891470 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1160/2328] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:43:07 2021] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:43:07.893336 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cff15-bf24-42e1-935c-5a1fa4b0750b admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:07.979663 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda58c35-d112-4ee0-857e-4cca8d099c92 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:07.984816 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cff15-bf24-42e1-935c-5a1fa4b0750b admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:07.989326 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7359546-1be1-4add-b0b1-5a40d849220e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:07.989950 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7359546-1be1-4add-b0b1-5a40d849220e admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:07.990243 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7359546-1be1-4add-b0b1-5a40d849220e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:07.990529 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7359546-1be1-4add-b0b1-5a40d849220e admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:07.991167 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7359546-1be1-4add-b0b1-5a40d849220e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:07.993103 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7359546-1be1-4add-b0b1-5a40d849220e admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:08.015078 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1161/2329] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:43:07 2021] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:43:08.018841 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7359546-1be1-4add-b0b1-5a40d849220e admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:08.028666 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7359546-1be1-4add-b0b1-5a40d849220e admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:08.036407 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf7b06-cfe0-4b01-80c2-35e402ddb8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:08.037106 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf7b06-cfe0-4b01-80c2-35e402ddb8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:08.037396 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf7b06-cfe0-4b01-80c2-35e402ddb8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:08.037677 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf7b06-cfe0-4b01-80c2-35e402ddb8c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:08.038379 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf7b06-cfe0-4b01-80c2-35e402ddb8c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:08.039988 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf7b06-cfe0-4b01-80c2-35e402ddb8c8 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:08.041045 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033acf3-5827-40b0-a488-2253ddde29cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:08.041643 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033acf3-5827-40b0-a488-2253ddde29cb service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:08.041930 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033acf3-5827-40b0-a488-2253ddde29cb service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:08.042212 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033acf3-5827-40b0-a488-2253ddde29cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:08.054061 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1162/2330] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:08 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:43:08.055180 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf7b06-cfe0-4b01-80c2-35e402ddb8c8 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:08.064577 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf7b06-cfe0-4b01-80c2-35e402ddb8c8 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:08.069058 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcaa714-bcc9-46ba-898b-f4020aa9e641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:08.069639 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcaa714-bcc9-46ba-898b-f4020aa9e641 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:08.069917 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcaa714-bcc9-46ba-898b-f4020aa9e641 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:08.070198 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcaa714-bcc9-46ba-898b-f4020aa9e641 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:08.070888 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcaa714-bcc9-46ba-898b-f4020aa9e641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:08.072465 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcaa714-bcc9-46ba-898b-f4020aa9e641 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:08.083797 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1163/2331] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:08 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:43:08.088090 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcaa714-bcc9-46ba-898b-f4020aa9e641 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:08.098928 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcaa714-bcc9-46ba-898b-f4020aa9e641 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:08.103512 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7d0ba-d7d6-4a53-a2a7-dfe45d02022f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:08.104354 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7d0ba-d7d6-4a53-a2a7-dfe45d02022f admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:08.104646 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7d0ba-d7d6-4a53-a2a7-dfe45d02022f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:08.104976 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7d0ba-d7d6-4a53-a2a7-dfe45d02022f admin admin] PATH_INFO: `/v3/projects/f8c2afbc7ad34a69a6942beb882f4153/users/6c99f55920d04e7fa41032e4ab9811fd/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:08.110222 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033acf3-5827-40b0-a488-2253ddde29cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:08.114004 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033acf3-5827-40b0-a488-2253ddde29cb service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:08.127519 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7d0ba-d7d6-4a53-a2a7-dfe45d02022f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c2afbc7ad34a69a6942beb882f4153, user_id=6c99f55920d04e7fa41032e4ab9811fd, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:08.130322 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1169/2332] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:43:07 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:43:08.130780 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7d0ba-d7d6-4a53-a2a7-dfe45d02022f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:08.152579 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1164/2333] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:08 2021] PUT /identity/v3/projects/f8c2afbc7ad34a69a6942beb882f4153/users/6c99f55920d04e7fa41032e4ab9811fd/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:43:08.159996 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c99f1-ee26-489f-8af6-6a006e2fb28b None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:08.160297 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c99f1-ee26-489f-8af6-6a006e2fb28b None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:08.160586 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c99f1-ee26-489f-8af6-6a006e2fb28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:08.200016 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-799c99f1-ee26-489f-8af6-6a006e2fb28b None None] MFA Rules not processed for user `6c99f55920d04e7fa41032e4ab9811fd`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:08.201236 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-799c99f1-ee26-489f-8af6-6a006e2fb28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:08.289815 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1170/2334] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:08 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:08.294392 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7d0ba-d7d6-4a53-a2a7-dfe45d02022f admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:08.381162 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7d0ba-d7d6-4a53-a2a7-dfe45d02022f admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:08.387081 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b7146-ccf0-45e1-9626-6cd69832cb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:08.387927 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b7146-ccf0-45e1-9626-6cd69832cb93 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:08.388429 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b7146-ccf0-45e1-9626-6cd69832cb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:08.388756 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b7146-ccf0-45e1-9626-6cd69832cb93 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:08.390577 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b7146-ccf0-45e1-9626-6cd69832cb93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:08.393538 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b7146-ccf0-45e1-9626-6cd69832cb93 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:08.427184 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1165/2335] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:43:08 2021] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:43:08.432014 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c99f1-ee26-489f-8af6-6a006e2fb28b None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:08.444213 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c99f1-ee26-489f-8af6-6a006e2fb28b None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:08.518363 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d2952-3714-4d0c-9f7e-93ea8ef85f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:08.519005 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d2952-3714-4d0c-9f7e-93ea8ef85f0e admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:08.519302 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d2952-3714-4d0c-9f7e-93ea8ef85f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:08.519592 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d2952-3714-4d0c-9f7e-93ea8ef85f0e admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:08.520272 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d2952-3714-4d0c-9f7e-93ea8ef85f0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:08.522262 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d2952-3714-4d0c-9f7e-93ea8ef85f0e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:08.554727 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1171/2336] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:43:08 2021] POST /identity/v3/users => generated 296 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:43:08.555942 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b7146-ccf0-45e1-9626-6cd69832cb93 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:08.571067 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b7146-ccf0-45e1-9626-6cd69832cb93 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:08.596827 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943e540-0bcb-4587-afe3-f7a594a9f94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:08.597716 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943e540-0bcb-4587-afe3-f7a594a9f94d admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:08.598605 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943e540-0bcb-4587-afe3-f7a594a9f94d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:08.599099 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943e540-0bcb-4587-afe3-f7a594a9f94d admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:08.600675 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943e540-0bcb-4587-afe3-f7a594a9f94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:08.603132 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943e540-0bcb-4587-afe3-f7a594a9f94d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:08.619199 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1166/2337] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:08 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:43:08.623795 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d2952-3714-4d0c-9f7e-93ea8ef85f0e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:08.636181 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d2952-3714-4d0c-9f7e-93ea8ef85f0e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:08.642132 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9996c14-deb8-4f14-af13-ed67eecc56fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:08.643113 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9996c14-deb8-4f14-af13-ed67eecc56fb admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:08.643572 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9996c14-deb8-4f14-af13-ed67eecc56fb admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:08.643861 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9996c14-deb8-4f14-af13-ed67eecc56fb admin admin] PATH_INFO: `/v3/projects/193fa23ebf4646fbba06a892cfa7f7ba/users/658c0009449b482db87d712d1d44ae1d/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:08.667615 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9996c14-deb8-4f14-af13-ed67eecc56fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=193fa23ebf4646fbba06a892cfa7f7ba, user_id=658c0009449b482db87d712d1d44ae1d, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:08.671166 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9996c14-deb8-4f14-af13-ed67eecc56fb admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:08.691063 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1172/2338] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:08 2021] PUT /identity/v3/projects/193fa23ebf4646fbba06a892cfa7f7ba/users/658c0009449b482db87d712d1d44ae1d/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:08.695312 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943e540-0bcb-4587-afe3-f7a594a9f94d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:08.706735 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943e540-0bcb-4587-afe3-f7a594a9f94d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:08.788228 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4d58e-5b3f-41b5-ad18-21dd7dc1e6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:08.788891 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4d58e-5b3f-41b5-ad18-21dd7dc1e6ae admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:08.789195 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4d58e-5b3f-41b5-ad18-21dd7dc1e6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:08.789477 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4d58e-5b3f-41b5-ad18-21dd7dc1e6ae admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:08.790224 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4d58e-5b3f-41b5-ad18-21dd7dc1e6ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:08.791802 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4d58e-5b3f-41b5-ad18-21dd7dc1e6ae admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:08.806600 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1167/2339] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:08 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:43:08.808031 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9996c14-deb8-4f14-af13-ed67eecc56fb admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:08.820571 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9996c14-deb8-4f14-af13-ed67eecc56fb admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:08.830019 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6c0d3-2e8a-4f5f-874d-563e937bc48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:08.837706 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6c0d3-2e8a-4f5f-874d-563e937bc48b admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:08.837706 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6c0d3-2e8a-4f5f-874d-563e937bc48b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:08.837706 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6c0d3-2e8a-4f5f-874d-563e937bc48b admin admin] PATH_INFO: `/v3/projects/193fa23ebf4646fbba06a892cfa7f7ba/users/658c0009449b482db87d712d1d44ae1d/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:08.837706 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6c0d3-2e8a-4f5f-874d-563e937bc48b admin admin] RBAC: Authorizing `identity:create_grant(project_id=193fa23ebf4646fbba06a892cfa7f7ba, user_id=658c0009449b482db87d712d1d44ae1d, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:08.842630 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6c0d3-2e8a-4f5f-874d-563e937bc48b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:08.858004 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1173/2340] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:08 2021] PUT /identity/v3/projects/193fa23ebf4646fbba06a892cfa7f7ba/users/658c0009449b482db87d712d1d44ae1d/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:08.870016 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fc9b3-17f2-48f7-b619-7432f0f47b7a None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:08.870370 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fc9b3-17f2-48f7-b619-7432f0f47b7a None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:08.870608 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fc9b3-17f2-48f7-b619-7432f0f47b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:08.907437 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-e46fc9b3-17f2-48f7-b619-7432f0f47b7a None None] MFA Rules not processed for user `658c0009449b482db87d712d1d44ae1d`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:08.908604 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e46fc9b3-17f2-48f7-b619-7432f0f47b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:08.988221 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1168/2341] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:08 2021] POST /identity/v3/auth/tokens => generated 3753 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:08.995793 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6c0d3-2e8a-4f5f-874d-563e937bc48b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:09.067763 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6c0d3-2e8a-4f5f-874d-563e937bc48b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:09.072346 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128edf9f-e5ca-49b7-9cfb-54684b009129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:09.073198 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128edf9f-e5ca-49b7-9cfb-54684b009129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:09.073489 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128edf9f-e5ca-49b7-9cfb-54684b009129 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:09.073770 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128edf9f-e5ca-49b7-9cfb-54684b009129 admin admin] PATH_INFO: `/v3/users/6c99f55920d04e7fa41032e4ab9811fd` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:09.074915 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128edf9f-e5ca-49b7-9cfb-54684b009129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c99f55920d04e7fa41032e4ab9811fd)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:09.076836 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128edf9f-e5ca-49b7-9cfb-54684b009129 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:09.130577 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-128edf9f-e5ca-49b7-9cfb-54684b009129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c99f55920d04e7fa41032e4ab9811fd'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:09.131348 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-128edf9f-e5ca-49b7-9cfb-54684b009129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c99f55920d04e7fa41032e4ab9811fd'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:09.144314 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-128edf9f-e5ca-49b7-9cfb-54684b009129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c99f55920d04e7fa41032e4ab9811fd'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:09.151949 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-128edf9f-e5ca-49b7-9cfb-54684b009129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c99f55920d04e7fa41032e4ab9811fd'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:09.160249 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-128edf9f-e5ca-49b7-9cfb-54684b009129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c99f55920d04e7fa41032e4ab9811fd'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:09.166728 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1174/2342] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:43:08 2021] DELETE /identity/v3/users/6c99f55920d04e7fa41032e4ab9811fd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:09.172131 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18174b70-bf1c-4b17-96f9-dc8005f8dfda None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:09.172441 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18174b70-bf1c-4b17-96f9-dc8005f8dfda None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:09.172731 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18174b70-bf1c-4b17-96f9-dc8005f8dfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:09.195707 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-18174b70-bf1c-4b17-96f9-dc8005f8dfda None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:09.196938 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-18174b70-bf1c-4b17-96f9-dc8005f8dfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:09.271358 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1169/2343] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:09.283052 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128edf9f-e5ca-49b7-9cfb-54684b009129 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:09.284615 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-128edf9f-e5ca-49b7-9cfb-54684b009129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:09.350902 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128edf9f-e5ca-49b7-9cfb-54684b009129 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:09.354470 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287472c-a118-46e8-9d54-bfa26aae71d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:09.355057 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287472c-a118-46e8-9d54-bfa26aae71d1 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:09.355357 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287472c-a118-46e8-9d54-bfa26aae71d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:09.355644 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287472c-a118-46e8-9d54-bfa26aae71d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:09.366456 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287472c-a118-46e8-9d54-bfa26aae71d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:09.367912 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287472c-a118-46e8-9d54-bfa26aae71d1 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:09.378150 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1175/2344] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:43:09 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:43:09.771385 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18174b70-bf1c-4b17-96f9-dc8005f8dfda None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:09.772820 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-18174b70-bf1c-4b17-96f9-dc8005f8dfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:09.785616 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18174b70-bf1c-4b17-96f9-dc8005f8dfda None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:09.789902 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7ce11-b773-4bb1-87af-ca695c2d46b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:09.790699 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7ce11-b773-4bb1-87af-ca695c2d46b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:09.790989 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7ce11-b773-4bb1-87af-ca695c2d46b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:09.791287 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7ce11-b773-4bb1-87af-ca695c2d46b5 admin admin] PATH_INFO: `/v3/projects/f8c2afbc7ad34a69a6942beb882f4153` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:09.792464 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7ce11-b773-4bb1-87af-ca695c2d46b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8c2afbc7ad34a69a6942beb882f4153)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:09.794476 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7ce11-b773-4bb1-87af-ca695c2d46b5 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:09.888099 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-60b7ce11-b773-4bb1-87af-ca695c2d46b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8c2afbc7ad34a69a6942beb882f4153', 'request_id': 'req-60b7ce11-b773-4bb1-87af-ca695c2d46b5'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:09.918092 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-60b7ce11-b773-4bb1-87af-ca695c2d46b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8c2afbc7ad34a69a6942beb882f4153', 'request_id': 'req-60b7ce11-b773-4bb1-87af-ca695c2d46b5'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:09.930297 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-60b7ce11-b773-4bb1-87af-ca695c2d46b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8c2afbc7ad34a69a6942beb882f4153', 'request_id': 'req-60b7ce11-b773-4bb1-87af-ca695c2d46b5'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:09.955829 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-60b7ce11-b773-4bb1-87af-ca695c2d46b5 admin admin] The token cache is being invalidate because project f8c2afbc7ad34a69a6942beb882f4153 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:43:09.956461 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-60b7ce11-b773-4bb1-87af-ca695c2d46b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:09.958053 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-60b7ce11-b773-4bb1-87af-ca695c2d46b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:09.960651 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1170/2345] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:43:09 2021] DELETE /identity/v3/projects/f8c2afbc7ad34a69a6942beb882f4153 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:43:09.966958 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287472c-a118-46e8-9d54-bfa26aae71d1 service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:09.985714 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287472c-a118-46e8-9d54-bfa26aae71d1 service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:10.067146 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21453c-2b59-41f9-913f-69578d7f8273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:10.068023 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21453c-2b59-41f9-913f-69578d7f8273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:10.068377 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21453c-2b59-41f9-913f-69578d7f8273 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:10.068745 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21453c-2b59-41f9-913f-69578d7f8273 admin admin] PATH_INFO: `/v3/users/658c0009449b482db87d712d1d44ae1d` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:10.070179 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21453c-2b59-41f9-913f-69578d7f8273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=658c0009449b482db87d712d1d44ae1d)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:10.072349 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21453c-2b59-41f9-913f-69578d7f8273 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:10.130193 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ae21453c-2b59-41f9-913f-69578d7f8273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '658c0009449b482db87d712d1d44ae1d'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:10.131038 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ae21453c-2b59-41f9-913f-69578d7f8273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '658c0009449b482db87d712d1d44ae1d'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:10.146699 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ae21453c-2b59-41f9-913f-69578d7f8273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '658c0009449b482db87d712d1d44ae1d'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:10.155599 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ae21453c-2b59-41f9-913f-69578d7f8273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '658c0009449b482db87d712d1d44ae1d'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:10.164090 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ae21453c-2b59-41f9-913f-69578d7f8273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '658c0009449b482db87d712d1d44ae1d'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:10.172163 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1176/2346] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:43:09 2021] DELETE /identity/v3/users/658c0009449b482db87d712d1d44ae1d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:43:10.668433 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7ce11-b773-4bb1-87af-ca695c2d46b5 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:10.670110 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-60b7ce11-b773-4bb1-87af-ca695c2d46b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:10.684849 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7ce11-b773-4bb1-87af-ca695c2d46b5 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:10.759640 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30271e-1218-447f-b721-3369a1331b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:10.760870 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30271e-1218-447f-b721-3369a1331b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:10.761169 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30271e-1218-447f-b721-3369a1331b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:10.761461 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30271e-1218-447f-b721-3369a1331b08 admin admin] PATH_INFO: `/v3/projects/193fa23ebf4646fbba06a892cfa7f7ba` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:10.762628 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd30271e-1218-447f-b721-3369a1331b08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=193fa23ebf4646fbba06a892cfa7f7ba)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:10.764801 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd30271e-1218-447f-b721-3369a1331b08 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:10.836343 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-fd30271e-1218-447f-b721-3369a1331b08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '193fa23ebf4646fbba06a892cfa7f7ba', 'request_id': 'req-fd30271e-1218-447f-b721-3369a1331b08'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:10.850245 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-fd30271e-1218-447f-b721-3369a1331b08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '193fa23ebf4646fbba06a892cfa7f7ba', 'request_id': 'req-fd30271e-1218-447f-b721-3369a1331b08'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:10.855850 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-fd30271e-1218-447f-b721-3369a1331b08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '193fa23ebf4646fbba06a892cfa7f7ba', 'request_id': 'req-fd30271e-1218-447f-b721-3369a1331b08'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:10.869635 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-fd30271e-1218-447f-b721-3369a1331b08 admin admin] The token cache is being invalidate because project 193fa23ebf4646fbba06a892cfa7f7ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:43:10.869928 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-fd30271e-1218-447f-b721-3369a1331b08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:10.870571 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-fd30271e-1218-447f-b721-3369a1331b08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:10.872522 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1171/2347] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:43:10 2021] DELETE /identity/v3/projects/193fa23ebf4646fbba06a892cfa7f7ba => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:10.879164 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8c431-4942-42b3-ae1f-c1591dd1f6c7 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:10.879164 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8c431-4942-42b3-ae1f-c1591dd1f6c7 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:10.879510 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8c431-4942-42b3-ae1f-c1591dd1f6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:10.903172 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-6af8c431-4942-42b3-ae1f-c1591dd1f6c7 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:10.904361 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-6af8c431-4942-42b3-ae1f-c1591dd1f6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:10.972736 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1177/2348] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:43:10.981861 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc87f6-aca4-460c-a8f6-9ed2bd320441 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:10.982145 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc87f6-aca4-460c-a8f6-9ed2bd320441 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:10.982453 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc87f6-aca4-460c-a8f6-9ed2bd320441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:11.015102 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-03cc87f6-aca4-460c-a8f6-9ed2bd320441 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:11.016268 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-03cc87f6-aca4-460c-a8f6-9ed2bd320441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:11.026502 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1172/2349] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:11.031324 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8c431-4942-42b3-ae1f-c1591dd1f6c7 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:11.040840 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8c431-4942-42b3-ae1f-c1591dd1f6c7 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:11.045351 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5fa4df-a32a-447b-a533-075de591d97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:11.046587 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fa4df-a32a-447b-a533-075de591d97a admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:11.046877 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fa4df-a32a-447b-a533-075de591d97a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:11.047157 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fa4df-a32a-447b-a533-075de591d97a admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:11.047863 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5fa4df-a32a-447b-a533-075de591d97a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:43:11.048162 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5fa4df-a32a-447b-a533-075de591d97a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:11.049806 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5fa4df-a32a-447b-a533-075de591d97a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:11.062826 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1178/2350] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:43:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:43:11.067281 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc87f6-aca4-460c-a8f6-9ed2bd320441 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:11.077720 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc87f6-aca4-460c-a8f6-9ed2bd320441 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:11.082209 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcce84f-0ed6-45b1-ab7d-e82ea3c4895d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:11.082811 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcce84f-0ed6-45b1-ab7d-e82ea3c4895d admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:11.083098 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcce84f-0ed6-45b1-ab7d-e82ea3c4895d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:11.083383 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcce84f-0ed6-45b1-ab7d-e82ea3c4895d admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:11.084047 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcce84f-0ed6-45b1-ab7d-e82ea3c4895d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:11.085976 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcce84f-0ed6-45b1-ab7d-e82ea3c4895d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:11.121213 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1173/2351] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:43:11 2021] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:43:11.122690 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5fa4df-a32a-447b-a533-075de591d97a admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:11.133003 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5fa4df-a32a-447b-a533-075de591d97a admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:11.201523 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3fcf9-40f8-4e7a-9978-de7ba41e5497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:11.202550 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3fcf9-40f8-4e7a-9978-de7ba41e5497 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:11.202847 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3fcf9-40f8-4e7a-9978-de7ba41e5497 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:11.203572 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3fcf9-40f8-4e7a-9978-de7ba41e5497 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:11.204272 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3fcf9-40f8-4e7a-9978-de7ba41e5497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:11.206270 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3fcf9-40f8-4e7a-9978-de7ba41e5497 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:11.231512 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1179/2352] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:43:11 2021] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:43:11.237484 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcce84f-0ed6-45b1-ab7d-e82ea3c4895d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:11.257608 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcce84f-0ed6-45b1-ab7d-e82ea3c4895d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:11.265964 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ccbd5-b075-4058-8cb0-b748db0c5a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:11.266977 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ccbd5-b075-4058-8cb0-b748db0c5a2d admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:11.267489 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ccbd5-b075-4058-8cb0-b748db0c5a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:11.267969 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ccbd5-b075-4058-8cb0-b748db0c5a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:11.269202 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ccbd5-b075-4058-8cb0-b748db0c5a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:11.271969 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ccbd5-b075-4058-8cb0-b748db0c5a2d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:11.298746 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1174/2353] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:11 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:43:11.300424 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3fcf9-40f8-4e7a-9978-de7ba41e5497 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:11.315468 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3fcf9-40f8-4e7a-9978-de7ba41e5497 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:11.321674 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd7958-cde5-4756-a40f-3c7b7b2ccccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:11.322450 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd7958-cde5-4756-a40f-3c7b7b2ccccd admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:11.322887 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd7958-cde5-4756-a40f-3c7b7b2ccccd admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:11.323349 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd7958-cde5-4756-a40f-3c7b7b2ccccd admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:11.324235 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd7958-cde5-4756-a40f-3c7b7b2ccccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:11.326209 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd7958-cde5-4756-a40f-3c7b7b2ccccd admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:11.341650 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1180/2354] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:11 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:43:11.346904 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ccbd5-b075-4058-8cb0-b748db0c5a2d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:11.359442 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ccbd5-b075-4058-8cb0-b748db0c5a2d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:11.365321 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8453fa-c631-4477-80b4-e797fff043d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:11.366214 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8453fa-c631-4477-80b4-e797fff043d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:11.366508 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8453fa-c631-4477-80b4-e797fff043d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:11.366794 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8453fa-c631-4477-80b4-e797fff043d5 admin admin] PATH_INFO: `/v3/projects/0dfb7374a3f54fc49d07be3877039b35/users/66f8c76703c347bd9166b5ad2bc41a6b/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:11.389086 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8453fa-c631-4477-80b4-e797fff043d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dfb7374a3f54fc49d07be3877039b35, user_id=66f8c76703c347bd9166b5ad2bc41a6b, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:11.392765 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8453fa-c631-4477-80b4-e797fff043d5 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:11.414480 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1175/2355] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:11 2021] PUT /identity/v3/projects/0dfb7374a3f54fc49d07be3877039b35/users/66f8c76703c347bd9166b5ad2bc41a6b/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:11.425962 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696f63c-1a55-4b73-a5ec-7cd8c664472d None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:11.426248 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696f63c-1a55-4b73-a5ec-7cd8c664472d None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:11.426654 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696f63c-1a55-4b73-a5ec-7cd8c664472d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:11.467602 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-1696f63c-1a55-4b73-a5ec-7cd8c664472d None None] MFA Rules not processed for user `66f8c76703c347bd9166b5ad2bc41a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:11.468668 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-1696f63c-1a55-4b73-a5ec-7cd8c664472d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:11.558504 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1181/2356] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:11 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:11.563727 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8453fa-c631-4477-80b4-e797fff043d5 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:11.635481 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8453fa-c631-4477-80b4-e797fff043d5 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:11.640953 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477abd5-35bf-4448-aa47-638835879380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:11.641548 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477abd5-35bf-4448-aa47-638835879380 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:11.641833 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477abd5-35bf-4448-aa47-638835879380 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:11.642112 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477abd5-35bf-4448-aa47-638835879380 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:11.642901 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477abd5-35bf-4448-aa47-638835879380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:11.644818 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477abd5-35bf-4448-aa47-638835879380 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:11.672993 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1176/2357] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:43:11 2021] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:43:11.677658 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696f63c-1a55-4b73-a5ec-7cd8c664472d None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:11.688855 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696f63c-1a55-4b73-a5ec-7cd8c664472d None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:11.755176 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30861e-003c-4a6d-a010-0175e5bfbdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:11.755694 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30861e-003c-4a6d-a010-0175e5bfbdda admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:11.755981 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30861e-003c-4a6d-a010-0175e5bfbdda admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:11.756260 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30861e-003c-4a6d-a010-0175e5bfbdda admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:11.756928 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30861e-003c-4a6d-a010-0175e5bfbdda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:11.758839 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30861e-003c-4a6d-a010-0175e5bfbdda admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:11.783775 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1182/2358] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:43:11 2021] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:43:11.784981 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477abd5-35bf-4448-aa47-638835879380 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:11.794871 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477abd5-35bf-4448-aa47-638835879380 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:11.800122 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8826a-4d21-4c8f-973c-633a40d8e794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:11.800768 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8826a-4d21-4c8f-973c-633a40d8e794 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:11.801092 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8826a-4d21-4c8f-973c-633a40d8e794 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:11.801375 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8826a-4d21-4c8f-973c-633a40d8e794 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:11.802087 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8826a-4d21-4c8f-973c-633a40d8e794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:11.803673 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8826a-4d21-4c8f-973c-633a40d8e794 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:11.817402 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1177/2359] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:11 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:43:11.821946 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30861e-003c-4a6d-a010-0175e5bfbdda admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:11.833472 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30861e-003c-4a6d-a010-0175e5bfbdda admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:11.838926 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ca784-916d-4c91-ae11-989684980acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:11.839563 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ca784-916d-4c91-ae11-989684980acc admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:11.839870 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ca784-916d-4c91-ae11-989684980acc admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:11.840194 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ca784-916d-4c91-ae11-989684980acc admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:11.840974 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ca784-916d-4c91-ae11-989684980acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:11.843552 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ca784-916d-4c91-ae11-989684980acc admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:11.870190 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1183/2360] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:11 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:43:11.875257 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8826a-4d21-4c8f-973c-633a40d8e794 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:11.890293 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8826a-4d21-4c8f-973c-633a40d8e794 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:11.895358 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03f777-5086-471c-be6f-7a08eee47774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:11.896181 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03f777-5086-471c-be6f-7a08eee47774 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:11.896474 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03f777-5086-471c-be6f-7a08eee47774 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:11.898262 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03f777-5086-471c-be6f-7a08eee47774 admin admin] PATH_INFO: `/v3/projects/4c8270446582436b85ff4b3e7f589da1/users/253ed89aa5f94961820ae1a235980172/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:11.919908 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03f777-5086-471c-be6f-7a08eee47774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c8270446582436b85ff4b3e7f589da1, user_id=253ed89aa5f94961820ae1a235980172, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:11.923304 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03f777-5086-471c-be6f-7a08eee47774 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:11.940859 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1178/2361] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:11 2021] PUT /identity/v3/projects/4c8270446582436b85ff4b3e7f589da1/users/253ed89aa5f94961820ae1a235980172/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:11.951288 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5b395-655a-46db-9fd4-2c188b386563 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:11.951613 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5b395-655a-46db-9fd4-2c188b386563 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:11.951805 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5b395-655a-46db-9fd4-2c188b386563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:11.997318 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-3db5b395-655a-46db-9fd4-2c188b386563 None None] MFA Rules not processed for user `253ed89aa5f94961820ae1a235980172`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:12.000491 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-3db5b395-655a-46db-9fd4-2c188b386563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:12.113063 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1184/2362] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:11 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:12.114500 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03f777-5086-471c-be6f-7a08eee47774 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:12.200228 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03f777-5086-471c-be6f-7a08eee47774 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:12.205188 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375dfbc-9b3b-4758-8d8f-86c2bedf69f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:12.205797 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375dfbc-9b3b-4758-8d8f-86c2bedf69f6 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:12.206087 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375dfbc-9b3b-4758-8d8f-86c2bedf69f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:12.206395 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375dfbc-9b3b-4758-8d8f-86c2bedf69f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:12.207022 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6375dfbc-9b3b-4758-8d8f-86c2bedf69f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:12.208943 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6375dfbc-9b3b-4758-8d8f-86c2bedf69f6 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:12.244296 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1179/2363] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:43:12 2021] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:43:12.248389 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5b395-655a-46db-9fd4-2c188b386563 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:12.259364 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5b395-655a-46db-9fd4-2c188b386563 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:12.322663 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fe748-2b5f-4385-a37b-d0ab175489cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:12.323600 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fe748-2b5f-4385-a37b-d0ab175489cb admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:12.323885 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fe748-2b5f-4385-a37b-d0ab175489cb admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:12.324192 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fe748-2b5f-4385-a37b-d0ab175489cb admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:12.324880 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fe748-2b5f-4385-a37b-d0ab175489cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:12.326803 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fe748-2b5f-4385-a37b-d0ab175489cb admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:12.348045 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1185/2364] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:43:12 2021] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:43:12.352022 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375dfbc-9b3b-4758-8d8f-86c2bedf69f6 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:12.362827 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375dfbc-9b3b-4758-8d8f-86c2bedf69f6 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:12.367978 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9eac19-b32d-4044-a83d-8ea569fc4a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:12.368577 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9eac19-b32d-4044-a83d-8ea569fc4a8d admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:12.368899 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9eac19-b32d-4044-a83d-8ea569fc4a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:12.369183 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9eac19-b32d-4044-a83d-8ea569fc4a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:12.369876 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9eac19-b32d-4044-a83d-8ea569fc4a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:12.371486 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9eac19-b32d-4044-a83d-8ea569fc4a8d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:12.382399 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1180/2365] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:12 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:43:12.386901 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fe748-2b5f-4385-a37b-d0ab175489cb admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:12.397076 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fe748-2b5f-4385-a37b-d0ab175489cb admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:12.401577 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd26a3f-a0fa-4597-9fd9-5fc2fe4ac9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:12.402402 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd26a3f-a0fa-4597-9fd9-5fc2fe4ac9d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:12.402691 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd26a3f-a0fa-4597-9fd9-5fc2fe4ac9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:12.402973 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd26a3f-a0fa-4597-9fd9-5fc2fe4ac9d7 admin admin] PATH_INFO: `/v3/projects/602967c6014e4ae8aaccfa036a0378d4/users/5c334f8bf6484776ba7771d8ee08a1f2/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:12.424009 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd26a3f-a0fa-4597-9fd9-5fc2fe4ac9d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=602967c6014e4ae8aaccfa036a0378d4, user_id=5c334f8bf6484776ba7771d8ee08a1f2, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:12.426669 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd26a3f-a0fa-4597-9fd9-5fc2fe4ac9d7 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:12.441120 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1186/2366] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:12 2021] PUT /identity/v3/projects/602967c6014e4ae8aaccfa036a0378d4/users/5c334f8bf6484776ba7771d8ee08a1f2/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:12.445595 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9eac19-b32d-4044-a83d-8ea569fc4a8d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:12.461376 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9eac19-b32d-4044-a83d-8ea569fc4a8d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:12.526773 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c09a1b-494e-463a-9026-771413204b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:12.527293 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c09a1b-494e-463a-9026-771413204b5b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:12.527582 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c09a1b-494e-463a-9026-771413204b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:12.527860 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c09a1b-494e-463a-9026-771413204b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:12.528558 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c09a1b-494e-463a-9026-771413204b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:12.530701 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c09a1b-494e-463a-9026-771413204b5b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:12.540647 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1181/2367] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:12 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:43:12.544765 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd26a3f-a0fa-4597-9fd9-5fc2fe4ac9d7 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:12.555029 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd26a3f-a0fa-4597-9fd9-5fc2fe4ac9d7 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:12.559389 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3084b-f1d8-40a2-aeb5-f8d60d654601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:12.560196 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3084b-f1d8-40a2-aeb5-f8d60d654601 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:12.560493 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3084b-f1d8-40a2-aeb5-f8d60d654601 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:12.560769 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3084b-f1d8-40a2-aeb5-f8d60d654601 admin admin] PATH_INFO: `/v3/projects/602967c6014e4ae8aaccfa036a0378d4/users/5c334f8bf6484776ba7771d8ee08a1f2/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:12.562588 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3084b-f1d8-40a2-aeb5-f8d60d654601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=602967c6014e4ae8aaccfa036a0378d4, user_id=5c334f8bf6484776ba7771d8ee08a1f2, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:12.565231 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3084b-f1d8-40a2-aeb5-f8d60d654601 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:12.574965 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1187/2368] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:12 2021] PUT /identity/v3/projects/602967c6014e4ae8aaccfa036a0378d4/users/5c334f8bf6484776ba7771d8ee08a1f2/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:12.586253 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3468a4c-8858-4df1-a943-8e9ab3ee6b39 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:12.586631 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3468a4c-8858-4df1-a943-8e9ab3ee6b39 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:12.586988 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3468a4c-8858-4df1-a943-8e9ab3ee6b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:12.623806 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-b3468a4c-8858-4df1-a943-8e9ab3ee6b39 None None] MFA Rules not processed for user `5c334f8bf6484776ba7771d8ee08a1f2`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:12.625005 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-b3468a4c-8858-4df1-a943-8e9ab3ee6b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:12.699227 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1182/2369] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:12 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:12.709779 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3084b-f1d8-40a2-aeb5-f8d60d654601 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:12.711453 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-6fb3084b-f1d8-40a2-aeb5-f8d60d654601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:12.779617 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3084b-f1d8-40a2-aeb5-f8d60d654601 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:12.783273 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25319c2f-51f3-4f5a-beed-7bb090e3bc05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:12.783918 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25319c2f-51f3-4f5a-beed-7bb090e3bc05 service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:12.784137 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25319c2f-51f3-4f5a-beed-7bb090e3bc05 service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:12.784427 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25319c2f-51f3-4f5a-beed-7bb090e3bc05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:12.793805 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25319c2f-51f3-4f5a-beed-7bb090e3bc05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:12.795241 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25319c2f-51f3-4f5a-beed-7bb090e3bc05 service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:12.805043 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1188/2370] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:43:12 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:43:13.357181 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3468a4c-8858-4df1-a943-8e9ab3ee6b39 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:13.362094 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3468a4c-8858-4df1-a943-8e9ab3ee6b39 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:13.365518 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e875a1-5638-458f-8a13-8e33a3900b71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:13.366091 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e875a1-5638-458f-8a13-8e33a3900b71 service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:13.366379 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e875a1-5638-458f-8a13-8e33a3900b71 service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:13.366654 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e875a1-5638-458f-8a13-8e33a3900b71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:13.434686 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e875a1-5638-458f-8a13-8e33a3900b71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:13.436111 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e875a1-5638-458f-8a13-8e33a3900b71 service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:13.446375 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1183/2371] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:43:13 2021] GET /identity/v3/auth/tokens => generated 3694 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:43:22.577815 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25319c2f-51f3-4f5a-beed-7bb090e3bc05 service cinder] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:22.596209 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25319c2f-51f3-4f5a-beed-7bb090e3bc05 service cinder] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:22.603111 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fd33c-923f-423b-bfa8-5e9eaacc1f2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:22.604857 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fd33c-923f-423b-bfa8-5e9eaacc1f2f service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:22.605742 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fd33c-923f-423b-bfa8-5e9eaacc1f2f service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:22.606379 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fd33c-923f-423b-bfa8-5e9eaacc1f2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:22.767956 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fd33c-923f-423b-bfa8-5e9eaacc1f2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:22.771238 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fd33c-923f-423b-bfa8-5e9eaacc1f2f service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:22.788891 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1189/2372] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:43:22 2021] GET /identity/v3/auth/tokens => generated 3694 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:43:23.109068 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e875a1-5638-458f-8a13-8e33a3900b71 service cinder] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:23.111831 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-13e875a1-5638-458f-8a13-8e33a3900b71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:23.196258 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e875a1-5638-458f-8a13-8e33a3900b71 service cinder] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:23.203675 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0921e-a9f6-4440-8866-5d9797e2042c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:23.205089 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0921e-a9f6-4440-8866-5d9797e2042c admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:23.205599 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0921e-a9f6-4440-8866-5d9797e2042c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:23.206181 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0921e-a9f6-4440-8866-5d9797e2042c admin admin] PATH_INFO: `/v3/users/309278edd3fe4259ab1d210cca892442` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:23.208105 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0921e-a9f6-4440-8866-5d9797e2042c admin admin] RBAC: Authorizing `identity:delete_user(user_id=309278edd3fe4259ab1d210cca892442)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:23.210172 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0921e-a9f6-4440-8866-5d9797e2042c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:23.268675 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-79e0921e-a9f6-4440-8866-5d9797e2042c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '309278edd3fe4259ab1d210cca892442'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:23.269345 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-79e0921e-a9f6-4440-8866-5d9797e2042c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '309278edd3fe4259ab1d210cca892442'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:23.285249 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-79e0921e-a9f6-4440-8866-5d9797e2042c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '309278edd3fe4259ab1d210cca892442'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:23.294795 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-79e0921e-a9f6-4440-8866-5d9797e2042c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '309278edd3fe4259ab1d210cca892442'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:23.309827 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-79e0921e-a9f6-4440-8866-5d9797e2042c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '309278edd3fe4259ab1d210cca892442'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:23.321575 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1184/2373] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:43:23 2021] DELETE /identity/v3/users/309278edd3fe4259ab1d210cca892442 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:23.330858 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd18576-4cdc-4315-9e17-1cda29c99a57 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:23.331158 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd18576-4cdc-4315-9e17-1cda29c99a57 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:23.331449 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd18576-4cdc-4315-9e17-1cda29c99a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:23.355331 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-3cd18576-4cdc-4315-9e17-1cda29c99a57 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:23.356516 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-3cd18576-4cdc-4315-9e17-1cda29c99a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:23.458596 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1190/2374] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:23.469370 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0921e-a9f6-4440-8866-5d9797e2042c admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:23.471248 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-79e0921e-a9f6-4440-8866-5d9797e2042c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:23.547680 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0921e-a9f6-4440-8866-5d9797e2042c admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:23.552505 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10fcad-5a81-4ea3-82dd-7b8c35195dc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:23.553119 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10fcad-5a81-4ea3-82dd-7b8c35195dc8 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:23.553435 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10fcad-5a81-4ea3-82dd-7b8c35195dc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:23.553868 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10fcad-5a81-4ea3-82dd-7b8c35195dc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:23.567732 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10fcad-5a81-4ea3-82dd-7b8c35195dc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:23.571151 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10fcad-5a81-4ea3-82dd-7b8c35195dc8 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:23.592691 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1185/2375] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:43:23 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:43:24.017157 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd18576-4cdc-4315-9e17-1cda29c99a57 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:24.019470 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-3cd18576-4cdc-4315-9e17-1cda29c99a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:24.034219 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd18576-4cdc-4315-9e17-1cda29c99a57 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:24.039061 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312ed7d-79c9-4191-af14-77c36844cd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:24.039877 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312ed7d-79c9-4191-af14-77c36844cd62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:24.040203 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312ed7d-79c9-4191-af14-77c36844cd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:24.040551 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312ed7d-79c9-4191-af14-77c36844cd62 admin admin] PATH_INFO: `/v3/projects/dc988a0f77ba4d9f8a2443542b107904` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:24.041769 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312ed7d-79c9-4191-af14-77c36844cd62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc988a0f77ba4d9f8a2443542b107904)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:24.043816 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312ed7d-79c9-4191-af14-77c36844cd62 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:24.095197 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-a312ed7d-79c9-4191-af14-77c36844cd62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc988a0f77ba4d9f8a2443542b107904', 'request_id': 'req-a312ed7d-79c9-4191-af14-77c36844cd62'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:24.100275 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-a312ed7d-79c9-4191-af14-77c36844cd62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc988a0f77ba4d9f8a2443542b107904', 'request_id': 'req-a312ed7d-79c9-4191-af14-77c36844cd62'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:24.107486 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-a312ed7d-79c9-4191-af14-77c36844cd62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc988a0f77ba4d9f8a2443542b107904', 'request_id': 'req-a312ed7d-79c9-4191-af14-77c36844cd62'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:24.123776 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-a312ed7d-79c9-4191-af14-77c36844cd62 admin admin] The token cache is being invalidate because project dc988a0f77ba4d9f8a2443542b107904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:43:24.124063 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-a312ed7d-79c9-4191-af14-77c36844cd62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:24.124944 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-a312ed7d-79c9-4191-af14-77c36844cd62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:24.126492 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1191/2376] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:43:24 2021] DELETE /identity/v3/projects/dc988a0f77ba4d9f8a2443542b107904 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:25.600573 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10fcad-5a81-4ea3-82dd-7b8c35195dc8 service neutron] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:25.602374 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-fb10fcad-5a81-4ea3-82dd-7b8c35195dc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:25.614895 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10fcad-5a81-4ea3-82dd-7b8c35195dc8 service neutron] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:25.685434 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903cb71-926e-4e76-9158-c55667bbf94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:25.686199 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903cb71-926e-4e76-9158-c55667bbf94d admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:25.686517 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903cb71-926e-4e76-9158-c55667bbf94d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:25.686806 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903cb71-926e-4e76-9158-c55667bbf94d admin admin] PATH_INFO: `/v3/users/66f8c76703c347bd9166b5ad2bc41a6b` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:25.687965 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903cb71-926e-4e76-9158-c55667bbf94d admin admin] RBAC: Authorizing `identity:delete_user(user_id=66f8c76703c347bd9166b5ad2bc41a6b)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:25.689911 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903cb71-926e-4e76-9158-c55667bbf94d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:25.741952 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-a903cb71-926e-4e76-9158-c55667bbf94d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66f8c76703c347bd9166b5ad2bc41a6b'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:25.742603 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-a903cb71-926e-4e76-9158-c55667bbf94d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66f8c76703c347bd9166b5ad2bc41a6b'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:25.754387 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-a903cb71-926e-4e76-9158-c55667bbf94d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66f8c76703c347bd9166b5ad2bc41a6b'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:25.761906 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-a903cb71-926e-4e76-9158-c55667bbf94d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66f8c76703c347bd9166b5ad2bc41a6b'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:25.771216 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-a903cb71-926e-4e76-9158-c55667bbf94d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66f8c76703c347bd9166b5ad2bc41a6b'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:25.777288 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1186/2377] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:43:25 2021] DELETE /identity/v3/users/66f8c76703c347bd9166b5ad2bc41a6b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:25.782238 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc1c0b-7f49-4bba-8589-5e591547f91c None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:25.782717 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc1c0b-7f49-4bba-8589-5e591547f91c None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:25.782797 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc1c0b-7f49-4bba-8589-5e591547f91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:25.806590 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-4ebc1c0b-7f49-4bba-8589-5e591547f91c None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:25.807739 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-4ebc1c0b-7f49-4bba-8589-5e591547f91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:25.883808 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1192/2378] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:25.891492 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903cb71-926e-4e76-9158-c55667bbf94d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:25.892881 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-a903cb71-926e-4e76-9158-c55667bbf94d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:25.958609 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903cb71-926e-4e76-9158-c55667bbf94d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:25.962465 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5707a-2369-4784-808b-be1c947b3eac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:25.963045 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5707a-2369-4784-808b-be1c947b3eac service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:25.963352 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5707a-2369-4784-808b-be1c947b3eac service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:25.963678 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5707a-2369-4784-808b-be1c947b3eac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:25.973256 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5707a-2369-4784-808b-be1c947b3eac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:25.974671 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5707a-2369-4784-808b-be1c947b3eac service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:25.984774 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1187/2379] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:43:25 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:43:26.472485 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc1c0b-7f49-4bba-8589-5e591547f91c None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:26.474127 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-4ebc1c0b-7f49-4bba-8589-5e591547f91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:26.485489 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc1c0b-7f49-4bba-8589-5e591547f91c None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:26.489779 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b890883-5549-4537-a7ff-613be8bb610b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:26.490557 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b890883-5549-4537-a7ff-613be8bb610b admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:26.490844 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b890883-5549-4537-a7ff-613be8bb610b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:26.491127 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b890883-5549-4537-a7ff-613be8bb610b admin admin] PATH_INFO: `/v3/projects/0dfb7374a3f54fc49d07be3877039b35` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:26.492209 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b890883-5549-4537-a7ff-613be8bb610b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dfb7374a3f54fc49d07be3877039b35)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:26.494117 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b890883-5549-4537-a7ff-613be8bb610b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:26.544821 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-1b890883-5549-4537-a7ff-613be8bb610b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dfb7374a3f54fc49d07be3877039b35', 'request_id': 'req-1b890883-5549-4537-a7ff-613be8bb610b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:26.549946 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-1b890883-5549-4537-a7ff-613be8bb610b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dfb7374a3f54fc49d07be3877039b35', 'request_id': 'req-1b890883-5549-4537-a7ff-613be8bb610b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:26.556821 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-1b890883-5549-4537-a7ff-613be8bb610b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dfb7374a3f54fc49d07be3877039b35', 'request_id': 'req-1b890883-5549-4537-a7ff-613be8bb610b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:26.572846 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-1b890883-5549-4537-a7ff-613be8bb610b admin admin] The token cache is being invalidate because project 0dfb7374a3f54fc49d07be3877039b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:43:26.573138 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-1b890883-5549-4537-a7ff-613be8bb610b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:26.573766 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-1b890883-5549-4537-a7ff-613be8bb610b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:26.575221 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1193/2380] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:43:26 2021] DELETE /identity/v3/projects/0dfb7374a3f54fc49d07be3877039b35 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:26.579849 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5707a-2369-4784-808b-be1c947b3eac service neutron] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:26.589227 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5707a-2369-4784-808b-be1c947b3eac service neutron] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:26.654614 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268365c6-085b-410c-84e1-b181d591755e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:26.655406 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268365c6-085b-410c-84e1-b181d591755e admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:26.655692 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268365c6-085b-410c-84e1-b181d591755e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:26.655969 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268365c6-085b-410c-84e1-b181d591755e admin admin] PATH_INFO: `/v3/users/253ed89aa5f94961820ae1a235980172` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:26.657103 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268365c6-085b-410c-84e1-b181d591755e admin admin] RBAC: Authorizing `identity:delete_user(user_id=253ed89aa5f94961820ae1a235980172)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:26.658983 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268365c6-085b-410c-84e1-b181d591755e admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:26.706255 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-268365c6-085b-410c-84e1-b181d591755e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '253ed89aa5f94961820ae1a235980172'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:26.706816 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-268365c6-085b-410c-84e1-b181d591755e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '253ed89aa5f94961820ae1a235980172'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:26.718440 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-268365c6-085b-410c-84e1-b181d591755e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '253ed89aa5f94961820ae1a235980172'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:26.725874 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-268365c6-085b-410c-84e1-b181d591755e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '253ed89aa5f94961820ae1a235980172'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:26.734986 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-268365c6-085b-410c-84e1-b181d591755e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '253ed89aa5f94961820ae1a235980172'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:26.741140 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1188/2381] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:43:26 2021] DELETE /identity/v3/users/253ed89aa5f94961820ae1a235980172 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:43:27.234356 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b890883-5549-4537-a7ff-613be8bb610b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:27.235736 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-1b890883-5549-4537-a7ff-613be8bb610b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:27.248046 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b890883-5549-4537-a7ff-613be8bb610b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:27.310401 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d167a07-3d5b-48aa-a163-6c1c895a84b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:27.311203 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d167a07-3d5b-48aa-a163-6c1c895a84b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:27.311494 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d167a07-3d5b-48aa-a163-6c1c895a84b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:27.311780 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d167a07-3d5b-48aa-a163-6c1c895a84b7 admin admin] PATH_INFO: `/v3/projects/4c8270446582436b85ff4b3e7f589da1` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:27.312928 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d167a07-3d5b-48aa-a163-6c1c895a84b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c8270446582436b85ff4b3e7f589da1)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:27.314829 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d167a07-3d5b-48aa-a163-6c1c895a84b7 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:27.362212 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-1d167a07-3d5b-48aa-a163-6c1c895a84b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c8270446582436b85ff4b3e7f589da1', 'request_id': 'req-1d167a07-3d5b-48aa-a163-6c1c895a84b7'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:27.367080 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-1d167a07-3d5b-48aa-a163-6c1c895a84b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c8270446582436b85ff4b3e7f589da1', 'request_id': 'req-1d167a07-3d5b-48aa-a163-6c1c895a84b7'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:27.373938 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-1d167a07-3d5b-48aa-a163-6c1c895a84b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c8270446582436b85ff4b3e7f589da1', 'request_id': 'req-1d167a07-3d5b-48aa-a163-6c1c895a84b7'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:27.390010 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-1d167a07-3d5b-48aa-a163-6c1c895a84b7 admin admin] The token cache is being invalidate because project 4c8270446582436b85ff4b3e7f589da1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:43:27.390295 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-1d167a07-3d5b-48aa-a163-6c1c895a84b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:27.390915 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-1d167a07-3d5b-48aa-a163-6c1c895a84b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:27.392346 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1194/2382] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:43:27 2021] DELETE /identity/v3/projects/4c8270446582436b85ff4b3e7f589da1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:43:27.396307 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268365c6-085b-410c-84e1-b181d591755e admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:27.397734 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-268365c6-085b-410c-84e1-b181d591755e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:27.410072 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268365c6-085b-410c-84e1-b181d591755e admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:27.473144 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95a70b-6abc-463f-9201-5fa6043d8356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:27.473877 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95a70b-6abc-463f-9201-5fa6043d8356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:27.474168 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95a70b-6abc-463f-9201-5fa6043d8356 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:27.474453 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95a70b-6abc-463f-9201-5fa6043d8356 admin admin] PATH_INFO: `/v3/users/5c334f8bf6484776ba7771d8ee08a1f2` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:27.475564 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95a70b-6abc-463f-9201-5fa6043d8356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c334f8bf6484776ba7771d8ee08a1f2)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:27.477521 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95a70b-6abc-463f-9201-5fa6043d8356 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:27.525492 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-2c95a70b-6abc-463f-9201-5fa6043d8356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c334f8bf6484776ba7771d8ee08a1f2'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:27.526113 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-2c95a70b-6abc-463f-9201-5fa6043d8356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c334f8bf6484776ba7771d8ee08a1f2'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:27.538268 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-2c95a70b-6abc-463f-9201-5fa6043d8356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c334f8bf6484776ba7771d8ee08a1f2'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:27.546334 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-2c95a70b-6abc-463f-9201-5fa6043d8356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c334f8bf6484776ba7771d8ee08a1f2'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:27.554265 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-2c95a70b-6abc-463f-9201-5fa6043d8356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c334f8bf6484776ba7771d8ee08a1f2'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:27.560348 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1189/2383] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:43:27 2021] DELETE /identity/v3/users/5c334f8bf6484776ba7771d8ee08a1f2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:28.019513 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d167a07-3d5b-48aa-a163-6c1c895a84b7 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:28.021818 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-1d167a07-3d5b-48aa-a163-6c1c895a84b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:28.035085 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d167a07-3d5b-48aa-a163-6c1c895a84b7 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:28.103400 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21360f62-a685-4c8e-a7b9-1fd398b490c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:28.104214 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21360f62-a685-4c8e-a7b9-1fd398b490c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:28.104628 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21360f62-a685-4c8e-a7b9-1fd398b490c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:28.104793 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21360f62-a685-4c8e-a7b9-1fd398b490c4 admin admin] PATH_INFO: `/v3/projects/602967c6014e4ae8aaccfa036a0378d4` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:28.105957 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21360f62-a685-4c8e-a7b9-1fd398b490c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=602967c6014e4ae8aaccfa036a0378d4)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:28.107966 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21360f62-a685-4c8e-a7b9-1fd398b490c4 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:28.166291 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-21360f62-a685-4c8e-a7b9-1fd398b490c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '602967c6014e4ae8aaccfa036a0378d4', 'request_id': 'req-21360f62-a685-4c8e-a7b9-1fd398b490c4'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:28.173309 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-21360f62-a685-4c8e-a7b9-1fd398b490c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '602967c6014e4ae8aaccfa036a0378d4', 'request_id': 'req-21360f62-a685-4c8e-a7b9-1fd398b490c4'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:28.183448 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-21360f62-a685-4c8e-a7b9-1fd398b490c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '602967c6014e4ae8aaccfa036a0378d4', 'request_id': 'req-21360f62-a685-4c8e-a7b9-1fd398b490c4'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:28.208180 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-21360f62-a685-4c8e-a7b9-1fd398b490c4 admin admin] The token cache is being invalidate because project 602967c6014e4ae8aaccfa036a0378d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:43:28.208754 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-21360f62-a685-4c8e-a7b9-1fd398b490c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:28.209551 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-21360f62-a685-4c8e-a7b9-1fd398b490c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:28.212288 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1195/2384] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:43:28 2021] DELETE /identity/v3/projects/602967c6014e4ae8aaccfa036a0378d4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:28.219036 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459d894-8829-447c-8059-f6a0272a1334 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:28.219557 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459d894-8829-447c-8059-f6a0272a1334 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:28.219886 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459d894-8829-447c-8059-f6a0272a1334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:28.250161 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-6459d894-8829-447c-8059-f6a0272a1334 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:28.252284 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-6459d894-8829-447c-8059-f6a0272a1334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:28.334125 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1190/2385] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:43:28.335967 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460ce1d-813e-4063-8e58-88e821d195e5 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:28.336460 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460ce1d-813e-4063-8e58-88e821d195e5 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:28.336876 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460ce1d-813e-4063-8e58-88e821d195e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:28.361786 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-9460ce1d-813e-4063-8e58-88e821d195e5 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:28.363342 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-9460ce1d-813e-4063-8e58-88e821d195e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:28.371984 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1196/2386] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:28.376862 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459d894-8829-447c-8059-f6a0272a1334 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:28.387541 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459d894-8829-447c-8059-f6a0272a1334 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:28.392464 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d179a-26f2-4ba6-becc-735417761935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:28.393122 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d179a-26f2-4ba6-becc-735417761935 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:28.393416 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d179a-26f2-4ba6-becc-735417761935 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:28.393739 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d179a-26f2-4ba6-becc-735417761935 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:28.394455 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d179a-26f2-4ba6-becc-735417761935 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:43:28.394759 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d179a-26f2-4ba6-becc-735417761935 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:28.396524 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d179a-26f2-4ba6-becc-735417761935 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:28.414256 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1191/2387] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:43:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:43:28.417971 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460ce1d-813e-4063-8e58-88e821d195e5 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:28.439692 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460ce1d-813e-4063-8e58-88e821d195e5 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:28.450797 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414db69e-1a9d-4b1e-90c5-1414a23b803f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:28.451941 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414db69e-1a9d-4b1e-90c5-1414a23b803f admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:28.452456 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414db69e-1a9d-4b1e-90c5-1414a23b803f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:28.453019 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414db69e-1a9d-4b1e-90c5-1414a23b803f admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:28.454208 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414db69e-1a9d-4b1e-90c5-1414a23b803f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:28.458662 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414db69e-1a9d-4b1e-90c5-1414a23b803f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:28.504399 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1197/2388] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:43:28 2021] POST /identity/v3/projects => generated 381 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:43:28.506221 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d179a-26f2-4ba6-becc-735417761935 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:28.520604 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d179a-26f2-4ba6-becc-735417761935 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:28.617213 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e27035-61b7-4832-afe5-1bdf8ba34b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:28.618339 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e27035-61b7-4832-afe5-1bdf8ba34b3b admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:28.618884 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e27035-61b7-4832-afe5-1bdf8ba34b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:28.619508 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e27035-61b7-4832-afe5-1bdf8ba34b3b admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:28.621032 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e27035-61b7-4832-afe5-1bdf8ba34b3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:28.625095 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e27035-61b7-4832-afe5-1bdf8ba34b3b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:28.659040 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1192/2389] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:43:28 2021] POST /identity/v3/users => generated 291 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:43:28.665128 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414db69e-1a9d-4b1e-90c5-1414a23b803f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:28.675476 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414db69e-1a9d-4b1e-90c5-1414a23b803f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:28.680691 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd361b9-1d80-4289-83d8-330ad69b326d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:28.681417 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd361b9-1d80-4289-83d8-330ad69b326d admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:28.681626 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd361b9-1d80-4289-83d8-330ad69b326d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:28.681907 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd361b9-1d80-4289-83d8-330ad69b326d admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:28.682609 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd361b9-1d80-4289-83d8-330ad69b326d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:28.684554 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd361b9-1d80-4289-83d8-330ad69b326d admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:28.695710 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1198/2390] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:28 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:43:28.700014 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e27035-61b7-4832-afe5-1bdf8ba34b3b admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:28.717718 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e27035-61b7-4832-afe5-1bdf8ba34b3b admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:28.722441 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203df8e1-510a-4103-a1b3-b89dc7bdeb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:28.722838 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203df8e1-510a-4103-a1b3-b89dc7bdeb71 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:28.723133 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203df8e1-510a-4103-a1b3-b89dc7bdeb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:28.723417 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203df8e1-510a-4103-a1b3-b89dc7bdeb71 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:28.724130 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203df8e1-510a-4103-a1b3-b89dc7bdeb71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:28.725785 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203df8e1-510a-4103-a1b3-b89dc7bdeb71 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:28.736706 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1193/2391] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:28 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:43:28.740917 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd361b9-1d80-4289-83d8-330ad69b326d admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:28.752668 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd361b9-1d80-4289-83d8-330ad69b326d admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:28.763111 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921711dc-bf14-4cc4-a974-508916aa2cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:28.765087 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921711dc-bf14-4cc4-a974-508916aa2cbf admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:28.765662 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921711dc-bf14-4cc4-a974-508916aa2cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:28.766056 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921711dc-bf14-4cc4-a974-508916aa2cbf admin admin] PATH_INFO: `/v3/projects/783259fb3de748a2a90ef580f777f798/users/a58fdf817568463e8a40b98a295e35bc/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:28.792478 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921711dc-bf14-4cc4-a974-508916aa2cbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=783259fb3de748a2a90ef580f777f798, user_id=a58fdf817568463e8a40b98a295e35bc, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:28.795819 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921711dc-bf14-4cc4-a974-508916aa2cbf admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:28.813660 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1199/2392] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:28 2021] PUT /identity/v3/projects/783259fb3de748a2a90ef580f777f798/users/a58fdf817568463e8a40b98a295e35bc/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:43:28.825222 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9a139-e80a-48e3-a4b5-9164ca8934a4 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:28.825788 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9a139-e80a-48e3-a4b5-9164ca8934a4 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:28.826835 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9a139-e80a-48e3-a4b5-9164ca8934a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:28.871505 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-47f9a139-e80a-48e3-a4b5-9164ca8934a4 None None] MFA Rules not processed for user `a58fdf817568463e8a40b98a295e35bc`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:28.873392 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-47f9a139-e80a-48e3-a4b5-9164ca8934a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:28.947687 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1194/2393] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:28 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:28.952745 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921711dc-bf14-4cc4-a974-508916aa2cbf admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:29.028613 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921711dc-bf14-4cc4-a974-508916aa2cbf admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:29.034190 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31187462-b31e-44b4-b25b-eb554aaf7c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:29.034786 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31187462-b31e-44b4-b25b-eb554aaf7c27 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:29.035113 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31187462-b31e-44b4-b25b-eb554aaf7c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:29.035406 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31187462-b31e-44b4-b25b-eb554aaf7c27 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:29.036078 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31187462-b31e-44b4-b25b-eb554aaf7c27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:29.038143 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31187462-b31e-44b4-b25b-eb554aaf7c27 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:29.072288 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1200/2394] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:43:28 2021] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:43:29.073427 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9a139-e80a-48e3-a4b5-9164ca8934a4 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:29.084643 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9a139-e80a-48e3-a4b5-9164ca8934a4 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:29.163293 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d9d60-6fa4-47b2-b487-cc3c6374a8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:29.163903 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d9d60-6fa4-47b2-b487-cc3c6374a8bc admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:29.164190 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d9d60-6fa4-47b2-b487-cc3c6374a8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:29.164471 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d9d60-6fa4-47b2-b487-cc3c6374a8bc admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:29.165167 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d9d60-6fa4-47b2-b487-cc3c6374a8bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:29.167715 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d9d60-6fa4-47b2-b487-cc3c6374a8bc admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:29.202580 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1195/2395] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:43:29 2021] POST /identity/v3/users => generated 298 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:43:29.206300 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31187462-b31e-44b4-b25b-eb554aaf7c27 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:29.224233 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31187462-b31e-44b4-b25b-eb554aaf7c27 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:29.230546 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342d3e6-5a62-42c7-8cad-9ba7188d0baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:29.231721 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342d3e6-5a62-42c7-8cad-9ba7188d0baa admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:29.232270 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342d3e6-5a62-42c7-8cad-9ba7188d0baa admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:29.232759 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342d3e6-5a62-42c7-8cad-9ba7188d0baa admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:29.234841 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342d3e6-5a62-42c7-8cad-9ba7188d0baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:29.237245 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342d3e6-5a62-42c7-8cad-9ba7188d0baa admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:29.253975 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1201/2396] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:29 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:43:29.258634 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d9d60-6fa4-47b2-b487-cc3c6374a8bc admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:29.275358 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d9d60-6fa4-47b2-b487-cc3c6374a8bc admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:29.283982 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b761012-4753-4df1-af94-9b120e849fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:29.284993 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b761012-4753-4df1-af94-9b120e849fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:29.285499 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b761012-4753-4df1-af94-9b120e849fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:29.285960 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b761012-4753-4df1-af94-9b120e849fd7 admin admin] PATH_INFO: `/v3/projects/159a190a9fe241009e4be214105bc533/users/77a9b54d73004bc3b0f16f5184b90fa2/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:29.313806 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b761012-4753-4df1-af94-9b120e849fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=159a190a9fe241009e4be214105bc533, user_id=77a9b54d73004bc3b0f16f5184b90fa2, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:29.317259 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b761012-4753-4df1-af94-9b120e849fd7 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:29.339540 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1196/2397] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:29 2021] PUT /identity/v3/projects/159a190a9fe241009e4be214105bc533/users/77a9b54d73004bc3b0f16f5184b90fa2/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:29.345076 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342d3e6-5a62-42c7-8cad-9ba7188d0baa admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:29.358473 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342d3e6-5a62-42c7-8cad-9ba7188d0baa admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:29.427669 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8586e-63b1-4e54-a0d1-1e70e6194e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:29.428591 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8586e-63b1-4e54-a0d1-1e70e6194e50 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:29.429080 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8586e-63b1-4e54-a0d1-1e70e6194e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:29.429524 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8586e-63b1-4e54-a0d1-1e70e6194e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:29.430382 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8586e-63b1-4e54-a0d1-1e70e6194e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:29.432156 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8586e-63b1-4e54-a0d1-1e70e6194e50 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:29.444620 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1202/2398] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:29 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:43:29.448934 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b761012-4753-4df1-af94-9b120e849fd7 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:29.462475 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b761012-4753-4df1-af94-9b120e849fd7 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:29.468694 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09763ef-a7bb-4409-81e0-51380b927214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:29.469570 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09763ef-a7bb-4409-81e0-51380b927214 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:29.470310 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09763ef-a7bb-4409-81e0-51380b927214 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:29.470310 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09763ef-a7bb-4409-81e0-51380b927214 admin admin] PATH_INFO: `/v3/projects/159a190a9fe241009e4be214105bc533/users/77a9b54d73004bc3b0f16f5184b90fa2/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:29.472350 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09763ef-a7bb-4409-81e0-51380b927214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=159a190a9fe241009e4be214105bc533, user_id=77a9b54d73004bc3b0f16f5184b90fa2, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:29.475175 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09763ef-a7bb-4409-81e0-51380b927214 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:29.488346 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1197/2399] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:29 2021] PUT /identity/v3/projects/159a190a9fe241009e4be214105bc533/users/77a9b54d73004bc3b0f16f5184b90fa2/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:29.499341 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c7998-3900-4fb3-a091-cc30890ab431 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:29.499708 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c7998-3900-4fb3-a091-cc30890ab431 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:29.500024 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c7998-3900-4fb3-a091-cc30890ab431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:29.538030 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-c54c7998-3900-4fb3-a091-cc30890ab431 None None] MFA Rules not processed for user `77a9b54d73004bc3b0f16f5184b90fa2`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:29.539113 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-c54c7998-3900-4fb3-a091-cc30890ab431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:29.617902 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1203/2400] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:29 2021] POST /identity/v3/auth/tokens => generated 3757 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:29.628810 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09763ef-a7bb-4409-81e0-51380b927214 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:29.630593 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-a09763ef-a7bb-4409-81e0-51380b927214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:29.695856 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09763ef-a7bb-4409-81e0-51380b927214 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:29.699418 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0f70a-051b-44f4-ba74-f565d63cc92d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:29.699988 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0f70a-051b-44f4-ba74-f565d63cc92d service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:29.700273 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0f70a-051b-44f4-ba74-f565d63cc92d service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:29.700550 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0f70a-051b-44f4-ba74-f565d63cc92d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:29.710088 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0f70a-051b-44f4-ba74-f565d63cc92d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:29.711483 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0f70a-051b-44f4-ba74-f565d63cc92d service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:29.720509 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1198/2401] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:43:29 2021] GET /identity/v3/auth/tokens => generated 3757 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:43:29.830341 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c7998-3900-4fb3-a091-cc30890ab431 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:29.841047 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c7998-3900-4fb3-a091-cc30890ab431 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:29.845538 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a414a8d-4e15-485a-9c04-660a5c9a272f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:29.846138 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a414a8d-4e15-485a-9c04-660a5c9a272f service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:29.846474 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a414a8d-4e15-485a-9c04-660a5c9a272f service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:29.846864 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a414a8d-4e15-485a-9c04-660a5c9a272f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:29.924392 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a414a8d-4e15-485a-9c04-660a5c9a272f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:29.925879 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a414a8d-4e15-485a-9c04-660a5c9a272f service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:29.935929 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1204/2402] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:43:29 2021] GET /identity/v3/auth/tokens => generated 3688 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:43:30.352225 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0f70a-051b-44f4-ba74-f565d63cc92d service cinder] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:30.428232 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0f70a-051b-44f4-ba74-f565d63cc92d service cinder] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:30.432646 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15e759-4aa9-4393-8912-52e230c6d8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:30.433480 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15e759-4aa9-4393-8912-52e230c6d8c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:30.434127 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15e759-4aa9-4393-8912-52e230c6d8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:30.434578 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15e759-4aa9-4393-8912-52e230c6d8c8 admin admin] PATH_INFO: `/v3/users/a58fdf817568463e8a40b98a295e35bc` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:30.435854 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15e759-4aa9-4393-8912-52e230c6d8c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a58fdf817568463e8a40b98a295e35bc)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:30.437846 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15e759-4aa9-4393-8912-52e230c6d8c8 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:30.493318 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-fd15e759-4aa9-4393-8912-52e230c6d8c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a58fdf817568463e8a40b98a295e35bc'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:30.493963 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-fd15e759-4aa9-4393-8912-52e230c6d8c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a58fdf817568463e8a40b98a295e35bc'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:30.506801 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-fd15e759-4aa9-4393-8912-52e230c6d8c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a58fdf817568463e8a40b98a295e35bc'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:30.515037 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-fd15e759-4aa9-4393-8912-52e230c6d8c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a58fdf817568463e8a40b98a295e35bc'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:30.523964 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-fd15e759-4aa9-4393-8912-52e230c6d8c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a58fdf817568463e8a40b98a295e35bc'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:30.535720 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1199/2403] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:43:30 2021] DELETE /identity/v3/users/a58fdf817568463e8a40b98a295e35bc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:43:30.537677 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948bbe4-8fce-40f3-8da1-1f79a3b502ea None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:30.538153 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948bbe4-8fce-40f3-8da1-1f79a3b502ea None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:30.538299 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948bbe4-8fce-40f3-8da1-1f79a3b502ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:30.561996 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-2948bbe4-8fce-40f3-8da1-1f79a3b502ea None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:30.563209 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-2948bbe4-8fce-40f3-8da1-1f79a3b502ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:30.628619 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1205/2404] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:30.639163 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15e759-4aa9-4393-8912-52e230c6d8c8 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:30.640624 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-fd15e759-4aa9-4393-8912-52e230c6d8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:30.709763 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15e759-4aa9-4393-8912-52e230c6d8c8 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:30.713331 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb429e-61e4-43a5-9243-055d13d2c32f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:30.713907 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb429e-61e4-43a5-9243-055d13d2c32f service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:30.714197 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb429e-61e4-43a5-9243-055d13d2c32f service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:30.714479 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb429e-61e4-43a5-9243-055d13d2c32f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:30.724592 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb429e-61e4-43a5-9243-055d13d2c32f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:30.726261 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb429e-61e4-43a5-9243-055d13d2c32f service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:30.735632 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1200/2405] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:43:30 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:43:31.141870 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948bbe4-8fce-40f3-8da1-1f79a3b502ea None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:31.143181 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-2948bbe4-8fce-40f3-8da1-1f79a3b502ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:31.154806 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948bbe4-8fce-40f3-8da1-1f79a3b502ea None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:31.159270 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275a175-b6d7-4577-9345-79fcd681f5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:31.160062 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275a175-b6d7-4577-9345-79fcd681f5f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:31.160352 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275a175-b6d7-4577-9345-79fcd681f5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:31.160632 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275a175-b6d7-4577-9345-79fcd681f5f7 admin admin] PATH_INFO: `/v3/projects/783259fb3de748a2a90ef580f777f798` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:31.161745 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275a175-b6d7-4577-9345-79fcd681f5f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=783259fb3de748a2a90ef580f777f798)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:31.163611 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275a175-b6d7-4577-9345-79fcd681f5f7 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:31.212627 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-e275a175-b6d7-4577-9345-79fcd681f5f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '783259fb3de748a2a90ef580f777f798', 'request_id': 'req-e275a175-b6d7-4577-9345-79fcd681f5f7'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:31.219096 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-e275a175-b6d7-4577-9345-79fcd681f5f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '783259fb3de748a2a90ef580f777f798', 'request_id': 'req-e275a175-b6d7-4577-9345-79fcd681f5f7'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:31.226582 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-e275a175-b6d7-4577-9345-79fcd681f5f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '783259fb3de748a2a90ef580f777f798', 'request_id': 'req-e275a175-b6d7-4577-9345-79fcd681f5f7'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:31.243669 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-e275a175-b6d7-4577-9345-79fcd681f5f7 admin admin] The token cache is being invalidate because project 783259fb3de748a2a90ef580f777f798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:43:31.243939 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-e275a175-b6d7-4577-9345-79fcd681f5f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:31.244596 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-e275a175-b6d7-4577-9345-79fcd681f5f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:31.246099 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1206/2406] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:43:31 2021] DELETE /identity/v3/projects/783259fb3de748a2a90ef580f777f798 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:31.250903 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb429e-61e4-43a5-9243-055d13d2c32f service neutron] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:31.260069 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb429e-61e4-43a5-9243-055d13d2c32f service neutron] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:31.325723 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc48ef-47b6-4698-9a37-b2ac08e7f2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:31.326505 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc48ef-47b6-4698-9a37-b2ac08e7f2bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:31.327146 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc48ef-47b6-4698-9a37-b2ac08e7f2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:31.330577 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc48ef-47b6-4698-9a37-b2ac08e7f2bf admin admin] PATH_INFO: `/v3/users/77a9b54d73004bc3b0f16f5184b90fa2` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:31.332091 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc48ef-47b6-4698-9a37-b2ac08e7f2bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=77a9b54d73004bc3b0f16f5184b90fa2)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:31.335047 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc48ef-47b6-4698-9a37-b2ac08e7f2bf admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:31.384137 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-80cc48ef-47b6-4698-9a37-b2ac08e7f2bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77a9b54d73004bc3b0f16f5184b90fa2'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:31.384960 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-80cc48ef-47b6-4698-9a37-b2ac08e7f2bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77a9b54d73004bc3b0f16f5184b90fa2'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:31.397263 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-80cc48ef-47b6-4698-9a37-b2ac08e7f2bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77a9b54d73004bc3b0f16f5184b90fa2'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:31.404385 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-80cc48ef-47b6-4698-9a37-b2ac08e7f2bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77a9b54d73004bc3b0f16f5184b90fa2'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:31.412714 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-80cc48ef-47b6-4698-9a37-b2ac08e7f2bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77a9b54d73004bc3b0f16f5184b90fa2'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:31.419243 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1201/2407] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:43:31 2021] DELETE /identity/v3/users/77a9b54d73004bc3b0f16f5184b90fa2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:43:31.797124 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275a175-b6d7-4577-9345-79fcd681f5f7 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:31.798558 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e275a175-b6d7-4577-9345-79fcd681f5f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:31.811593 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275a175-b6d7-4577-9345-79fcd681f5f7 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:31.886500 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a84e7-22e0-453e-9b5c-005bc88b363c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:31.887571 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a84e7-22e0-453e-9b5c-005bc88b363c admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:31.888007 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a84e7-22e0-453e-9b5c-005bc88b363c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:31.888751 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a84e7-22e0-453e-9b5c-005bc88b363c admin admin] PATH_INFO: `/v3/projects/159a190a9fe241009e4be214105bc533` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:31.891666 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a84e7-22e0-453e-9b5c-005bc88b363c admin admin] RBAC: Authorizing `identity:delete_project(project_id=159a190a9fe241009e4be214105bc533)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:31.892143 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a84e7-22e0-453e-9b5c-005bc88b363c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:31.946237 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-eb1a84e7-22e0-453e-9b5c-005bc88b363c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '159a190a9fe241009e4be214105bc533', 'request_id': 'req-eb1a84e7-22e0-453e-9b5c-005bc88b363c'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:31.952548 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-eb1a84e7-22e0-453e-9b5c-005bc88b363c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '159a190a9fe241009e4be214105bc533', 'request_id': 'req-eb1a84e7-22e0-453e-9b5c-005bc88b363c'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:31.961649 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-eb1a84e7-22e0-453e-9b5c-005bc88b363c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '159a190a9fe241009e4be214105bc533', 'request_id': 'req-eb1a84e7-22e0-453e-9b5c-005bc88b363c'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:31.980137 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-eb1a84e7-22e0-453e-9b5c-005bc88b363c admin admin] The token cache is being invalidate because project 159a190a9fe241009e4be214105bc533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:43:31.980696 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-eb1a84e7-22e0-453e-9b5c-005bc88b363c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:31.981480 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-eb1a84e7-22e0-453e-9b5c-005bc88b363c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:31.983719 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1207/2408] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:43:31 2021] DELETE /identity/v3/projects/159a190a9fe241009e4be214105bc533 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:31.989286 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd93752-cae9-4275-b26f-4fe2d02a67e2 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:31.989637 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd93752-cae9-4275-b26f-4fe2d02a67e2 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:31.989934 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd93752-cae9-4275-b26f-4fe2d02a67e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:32.013710 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-9cd93752-cae9-4275-b26f-4fe2d02a67e2 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:32.014884 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-9cd93752-cae9-4275-b26f-4fe2d02a67e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:32.084568 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1202/2409] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:43:32.093435 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474cc1d-532c-400e-8837-b5a4fb53236e None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:32.093730 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474cc1d-532c-400e-8837-b5a4fb53236e None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:32.094033 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474cc1d-532c-400e-8837-b5a4fb53236e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:32.118892 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-a474cc1d-532c-400e-8837-b5a4fb53236e None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:32.119970 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-a474cc1d-532c-400e-8837-b5a4fb53236e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:32.127565 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1208/2410] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:32.132278 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd93752-cae9-4275-b26f-4fe2d02a67e2 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:32.142983 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd93752-cae9-4275-b26f-4fe2d02a67e2 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:32.147758 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c796c2-88a7-43d7-b024-92d1296001c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:32.148355 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c796c2-88a7-43d7-b024-92d1296001c1 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:32.148646 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c796c2-88a7-43d7-b024-92d1296001c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:32.148966 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c796c2-88a7-43d7-b024-92d1296001c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:32.149659 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c796c2-88a7-43d7-b024-92d1296001c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:43:32.149961 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c796c2-88a7-43d7-b024-92d1296001c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:32.151566 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c796c2-88a7-43d7-b024-92d1296001c1 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:32.165116 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1203/2411] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:43:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:43:32.169673 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474cc1d-532c-400e-8837-b5a4fb53236e None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:32.178542 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474cc1d-532c-400e-8837-b5a4fb53236e None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:32.183013 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5ec99-8c4e-4e6f-a800-9c8ef7854be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:32.183607 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5ec99-8c4e-4e6f-a800-9c8ef7854be7 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:32.183896 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5ec99-8c4e-4e6f-a800-9c8ef7854be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:32.184180 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5ec99-8c4e-4e6f-a800-9c8ef7854be7 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:32.184850 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5ec99-8c4e-4e6f-a800-9c8ef7854be7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:32.186833 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5ec99-8c4e-4e6f-a800-9c8ef7854be7 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:32.214722 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1209/2412] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:43:32 2021] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:43:32.219702 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c796c2-88a7-43d7-b024-92d1296001c1 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:32.229597 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c796c2-88a7-43d7-b024-92d1296001c1 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:32.297037 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbd402-7f1a-4e78-9d73-d43374208fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:32.297656 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbd402-7f1a-4e78-9d73-d43374208fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:32.297949 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbd402-7f1a-4e78-9d73-d43374208fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:32.298358 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbd402-7f1a-4e78-9d73-d43374208fb9 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:32.298848 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbd402-7f1a-4e78-9d73-d43374208fb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:32.300730 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbd402-7f1a-4e78-9d73-d43374208fb9 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:32.322555 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1204/2413] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:43:32 2021] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:43:32.327636 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5ec99-8c4e-4e6f-a800-9c8ef7854be7 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:32.337808 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5ec99-8c4e-4e6f-a800-9c8ef7854be7 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:32.343150 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c81cc-fcb9-4e5e-ad6d-6e5527420cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:32.343764 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c81cc-fcb9-4e5e-ad6d-6e5527420cfc admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:32.344140 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c81cc-fcb9-4e5e-ad6d-6e5527420cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:32.344465 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c81cc-fcb9-4e5e-ad6d-6e5527420cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:32.345275 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c81cc-fcb9-4e5e-ad6d-6e5527420cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:32.347001 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c81cc-fcb9-4e5e-ad6d-6e5527420cfc admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:32.358717 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1210/2414] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:32 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:43:32.363193 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbd402-7f1a-4e78-9d73-d43374208fb9 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:32.373253 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbd402-7f1a-4e78-9d73-d43374208fb9 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:32.377828 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187de7a-ac2c-4925-b283-ff25b586a08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:32.378420 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187de7a-ac2c-4925-b283-ff25b586a08c admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:32.378712 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187de7a-ac2c-4925-b283-ff25b586a08c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:32.378998 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187de7a-ac2c-4925-b283-ff25b586a08c admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:32.379700 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9187de7a-ac2c-4925-b283-ff25b586a08c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:32.381315 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9187de7a-ac2c-4925-b283-ff25b586a08c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:32.392583 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1205/2415] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:32 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:43:32.396806 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c81cc-fcb9-4e5e-ad6d-6e5527420cfc admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:32.407165 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c81cc-fcb9-4e5e-ad6d-6e5527420cfc admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:32.411652 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71be4e6-f1de-4c7f-8573-f66321cf9664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:32.412474 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71be4e6-f1de-4c7f-8573-f66321cf9664 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:32.412766 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71be4e6-f1de-4c7f-8573-f66321cf9664 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:32.413082 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71be4e6-f1de-4c7f-8573-f66321cf9664 admin admin] PATH_INFO: `/v3/projects/bed21a1e88bf46c49beba44b174b57dd/users/dd6995638c134e74b541bf0cbb929449/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:32.432578 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71be4e6-f1de-4c7f-8573-f66321cf9664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bed21a1e88bf46c49beba44b174b57dd, user_id=dd6995638c134e74b541bf0cbb929449, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:32.435813 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71be4e6-f1de-4c7f-8573-f66321cf9664 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:32.450069 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1211/2416] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:32 2021] PUT /identity/v3/projects/bed21a1e88bf46c49beba44b174b57dd/users/dd6995638c134e74b541bf0cbb929449/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:32.462150 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a7526-4961-46b8-b21d-05937ad8ea2e None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:32.462449 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a7526-4961-46b8-b21d-05937ad8ea2e None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:32.462740 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a7526-4961-46b8-b21d-05937ad8ea2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:32.500498 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-200a7526-4961-46b8-b21d-05937ad8ea2e None None] MFA Rules not processed for user `dd6995638c134e74b541bf0cbb929449`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:32.501627 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-200a7526-4961-46b8-b21d-05937ad8ea2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:32.575998 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1206/2417] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:32 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:32.586738 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71be4e6-f1de-4c7f-8573-f66321cf9664 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:32.588527 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-b71be4e6-f1de-4c7f-8573-f66321cf9664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:32.655450 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71be4e6-f1de-4c7f-8573-f66321cf9664 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:32.658936 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edcb7b-f9b4-4881-94c8-ac90452eeb39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:32.659518 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edcb7b-f9b4-4881-94c8-ac90452eeb39 service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:32.659807 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edcb7b-f9b4-4881-94c8-ac90452eeb39 service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:32.660091 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edcb7b-f9b4-4881-94c8-ac90452eeb39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:32.669473 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19edcb7b-f9b4-4881-94c8-ac90452eeb39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:32.671136 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19edcb7b-f9b4-4881-94c8-ac90452eeb39 service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:32.680022 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1212/2418] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:43:32 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:43:35.305245 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83c229-075c-49f4-be83-0c38c2da80a4 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:35.305754 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83c229-075c-49f4-be83-0c38c2da80a4 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:35.305868 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83c229-075c-49f4-be83-0c38c2da80a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:35.327861 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-8b83c229-075c-49f4-be83-0c38c2da80a4 None None] MFA Rules not processed for user `dd6995638c134e74b541bf0cbb929449`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:35.329065 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-8b83c229-075c-49f4-be83-0c38c2da80a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:35.335440 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1207/2419] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:35 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:46.071200 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edcb7b-f9b4-4881-94c8-ac90452eeb39 service cinder] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:46.073566 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-19edcb7b-f9b4-4881-94c8-ac90452eeb39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:46.157152 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edcb7b-f9b4-4881-94c8-ac90452eeb39 service cinder] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:46.161751 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242121b-a987-4e2b-9b42-34b31e6ed6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:46.162570 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242121b-a987-4e2b-9b42-34b31e6ed6a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:46.162861 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242121b-a987-4e2b-9b42-34b31e6ed6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:46.163195 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242121b-a987-4e2b-9b42-34b31e6ed6a7 admin admin] PATH_INFO: `/v3/users/eeb2dde456a8408d820d765c54f8a868` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:46.164521 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242121b-a987-4e2b-9b42-34b31e6ed6a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeb2dde456a8408d820d765c54f8a868)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:46.167106 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242121b-a987-4e2b-9b42-34b31e6ed6a7 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:46.247610 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-d242121b-a987-4e2b-9b42-34b31e6ed6a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeb2dde456a8408d820d765c54f8a868'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:46.249147 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-d242121b-a987-4e2b-9b42-34b31e6ed6a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeb2dde456a8408d820d765c54f8a868'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:46.266881 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-d242121b-a987-4e2b-9b42-34b31e6ed6a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeb2dde456a8408d820d765c54f8a868'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:46.282856 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-d242121b-a987-4e2b-9b42-34b31e6ed6a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeb2dde456a8408d820d765c54f8a868'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:46.291859 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-d242121b-a987-4e2b-9b42-34b31e6ed6a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeb2dde456a8408d820d765c54f8a868'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:46.300828 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1213/2420] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:43:46 2021] DELETE /identity/v3/users/eeb2dde456a8408d820d765c54f8a868 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:43:46.674033 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83c229-075c-49f4-be83-0c38c2da80a4 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:46.688651 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83c229-075c-49f4-be83-0c38c2da80a4 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:46.780451 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56782786-e05f-446e-9fa1-36afdb1a44ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:46.781528 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56782786-e05f-446e-9fa1-36afdb1a44ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:46.781971 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56782786-e05f-446e-9fa1-36afdb1a44ed admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:46.782355 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56782786-e05f-446e-9fa1-36afdb1a44ed admin admin] PATH_INFO: `/v3/projects/5a10c6d1e7e7425bb59f6efad4231db3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:46.783757 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56782786-e05f-446e-9fa1-36afdb1a44ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a10c6d1e7e7425bb59f6efad4231db3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:46.786241 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56782786-e05f-446e-9fa1-36afdb1a44ed admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:46.860512 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-56782786-e05f-446e-9fa1-36afdb1a44ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a10c6d1e7e7425bb59f6efad4231db3', 'request_id': 'req-56782786-e05f-446e-9fa1-36afdb1a44ed'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:46.876216 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-56782786-e05f-446e-9fa1-36afdb1a44ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a10c6d1e7e7425bb59f6efad4231db3', 'request_id': 'req-56782786-e05f-446e-9fa1-36afdb1a44ed'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:46.883239 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-56782786-e05f-446e-9fa1-36afdb1a44ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a10c6d1e7e7425bb59f6efad4231db3', 'request_id': 'req-56782786-e05f-446e-9fa1-36afdb1a44ed'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:46.900843 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-56782786-e05f-446e-9fa1-36afdb1a44ed admin admin] The token cache is being invalidate because project 5a10c6d1e7e7425bb59f6efad4231db3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:43:46.901243 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-56782786-e05f-446e-9fa1-36afdb1a44ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:46.902018 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-56782786-e05f-446e-9fa1-36afdb1a44ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:46.910146 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1208/2421] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:43:46 2021] DELETE /identity/v3/projects/5a10c6d1e7e7425bb59f6efad4231db3 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:46.911096 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf080fa-a39e-443c-b72c-b7dc2bca6f9f None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:46.911395 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf080fa-a39e-443c-b72c-b7dc2bca6f9f None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:46.911683 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf080fa-a39e-443c-b72c-b7dc2bca6f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:46.967611 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-dbf080fa-a39e-443c-b72c-b7dc2bca6f9f None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:46.969157 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-dbf080fa-a39e-443c-b72c-b7dc2bca6f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:47.115215 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1214/2422] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:43:47.126784 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2570354-636e-46b5-aa87-9f7070eaf010 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:47.127151 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2570354-636e-46b5-aa87-9f7070eaf010 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:47.127383 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2570354-636e-46b5-aa87-9f7070eaf010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:47.171177 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-c2570354-636e-46b5-aa87-9f7070eaf010 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:47.172352 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-c2570354-636e-46b5-aa87-9f7070eaf010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:47.195399 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1209/2423] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:47.199435 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf080fa-a39e-443c-b72c-b7dc2bca6f9f None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:47.213464 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf080fa-a39e-443c-b72c-b7dc2bca6f9f None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:47.218367 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab0e30-86a5-4415-9d47-3ee3aa8f55fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:47.219053 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab0e30-86a5-4415-9d47-3ee3aa8f55fc admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:47.219424 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab0e30-86a5-4415-9d47-3ee3aa8f55fc admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:47.219787 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab0e30-86a5-4415-9d47-3ee3aa8f55fc admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:47.220565 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab0e30-86a5-4415-9d47-3ee3aa8f55fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:43:47.221280 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab0e30-86a5-4415-9d47-3ee3aa8f55fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:47.222972 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab0e30-86a5-4415-9d47-3ee3aa8f55fc admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:47.240819 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1215/2424] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:43:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:43:47.245188 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2570354-636e-46b5-aa87-9f7070eaf010 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:47.256040 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2570354-636e-46b5-aa87-9f7070eaf010 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:47.261423 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706efdd3-2fcb-463b-817b-e303733895c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:47.262782 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706efdd3-2fcb-463b-817b-e303733895c3 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:47.263056 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706efdd3-2fcb-463b-817b-e303733895c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:47.263365 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706efdd3-2fcb-463b-817b-e303733895c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:47.264007 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706efdd3-2fcb-463b-817b-e303733895c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:47.265929 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706efdd3-2fcb-463b-817b-e303733895c3 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:47.297680 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1210/2425] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:43:47 2021] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:43:47.301929 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab0e30-86a5-4415-9d47-3ee3aa8f55fc admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:47.312152 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab0e30-86a5-4415-9d47-3ee3aa8f55fc admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:47.379170 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853ec99-b7b1-435d-be7b-c38f6ea4df2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:47.379713 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853ec99-b7b1-435d-be7b-c38f6ea4df2e admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:47.380027 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853ec99-b7b1-435d-be7b-c38f6ea4df2e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:47.380282 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853ec99-b7b1-435d-be7b-c38f6ea4df2e admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:47.381026 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853ec99-b7b1-435d-be7b-c38f6ea4df2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:47.382970 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853ec99-b7b1-435d-be7b-c38f6ea4df2e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:47.405620 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1216/2426] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:43:47 2021] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:43:47.409428 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706efdd3-2fcb-463b-817b-e303733895c3 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:47.421083 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706efdd3-2fcb-463b-817b-e303733895c3 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:47.426553 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ece112-e341-43aa-8967-316043214842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:47.427418 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ece112-e341-43aa-8967-316043214842 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:47.427873 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ece112-e341-43aa-8967-316043214842 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:47.428158 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ece112-e341-43aa-8967-316043214842 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:47.428926 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ece112-e341-43aa-8967-316043214842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:47.430507 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ece112-e341-43aa-8967-316043214842 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:47.442032 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1211/2427] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:47 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:43:47.446059 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853ec99-b7b1-435d-be7b-c38f6ea4df2e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:47.458659 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853ec99-b7b1-435d-be7b-c38f6ea4df2e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:47.464425 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28dc5c-8d2d-4889-865d-a9e5ed0218a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:47.465322 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28dc5c-8d2d-4889-865d-a9e5ed0218a6 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:47.465610 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28dc5c-8d2d-4889-865d-a9e5ed0218a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:47.466026 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28dc5c-8d2d-4889-865d-a9e5ed0218a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:47.466723 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28dc5c-8d2d-4889-865d-a9e5ed0218a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:47.468311 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28dc5c-8d2d-4889-865d-a9e5ed0218a6 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:47.483824 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1217/2428] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:47 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:43:47.488112 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ece112-e341-43aa-8967-316043214842 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:47.499275 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ece112-e341-43aa-8967-316043214842 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:47.504013 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8923427-5000-4d2c-aa40-f030b20eaf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:47.504863 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8923427-5000-4d2c-aa40-f030b20eaf9e admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:47.505159 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8923427-5000-4d2c-aa40-f030b20eaf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:47.505449 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8923427-5000-4d2c-aa40-f030b20eaf9e admin admin] PATH_INFO: `/v3/projects/a78931ffbc604f36bf5e937f9240221d/users/e717e8636e6c4335abdb2099cbb103c0/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:47.530820 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8923427-5000-4d2c-aa40-f030b20eaf9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a78931ffbc604f36bf5e937f9240221d, user_id=e717e8636e6c4335abdb2099cbb103c0, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:47.534224 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8923427-5000-4d2c-aa40-f030b20eaf9e admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:47.551300 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1212/2429] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:47 2021] PUT /identity/v3/projects/a78931ffbc604f36bf5e937f9240221d/users/e717e8636e6c4335abdb2099cbb103c0/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:47.561924 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29db12-fdfb-42ff-a80a-9b2f2991026a None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:47.562492 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29db12-fdfb-42ff-a80a-9b2f2991026a None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:47.562981 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29db12-fdfb-42ff-a80a-9b2f2991026a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:47.603419 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-fc29db12-fdfb-42ff-a80a-9b2f2991026a None None] MFA Rules not processed for user `e717e8636e6c4335abdb2099cbb103c0`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:47.604946 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-fc29db12-fdfb-42ff-a80a-9b2f2991026a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:47.746041 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1218/2430] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:47 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:47.750838 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8923427-5000-4d2c-aa40-f030b20eaf9e admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:47.861931 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8923427-5000-4d2c-aa40-f030b20eaf9e admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:47.876381 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cad9a2-11a3-4e2c-8d59-741130ecc3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:47.877046 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cad9a2-11a3-4e2c-8d59-741130ecc3cd admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:47.877324 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cad9a2-11a3-4e2c-8d59-741130ecc3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:47.877611 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cad9a2-11a3-4e2c-8d59-741130ecc3cd admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:47.878263 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cad9a2-11a3-4e2c-8d59-741130ecc3cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:47.880172 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cad9a2-11a3-4e2c-8d59-741130ecc3cd admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:47.930511 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1213/2431] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:43:47 2021] POST /identity/v3/projects => generated 371 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:43:47.934713 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29db12-fdfb-42ff-a80a-9b2f2991026a None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:47.947341 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29db12-fdfb-42ff-a80a-9b2f2991026a None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:48.047877 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca27f8-b717-4429-8767-e4a87339ea1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:48.049017 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca27f8-b717-4429-8767-e4a87339ea1a admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:48.049479 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca27f8-b717-4429-8767-e4a87339ea1a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:48.049930 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca27f8-b717-4429-8767-e4a87339ea1a admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:48.050740 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca27f8-b717-4429-8767-e4a87339ea1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:48.054263 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca27f8-b717-4429-8767-e4a87339ea1a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:48.096192 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1219/2432] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:43:47 2021] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:43:48.100322 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cad9a2-11a3-4e2c-8d59-741130ecc3cd admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:48.116135 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cad9a2-11a3-4e2c-8d59-741130ecc3cd admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:48.126446 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730351d-ad1b-4fa4-b5f4-7d487728a23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:48.134213 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730351d-ad1b-4fa4-b5f4-7d487728a23f admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:48.135021 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730351d-ad1b-4fa4-b5f4-7d487728a23f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:48.135751 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730351d-ad1b-4fa4-b5f4-7d487728a23f admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:48.136667 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730351d-ad1b-4fa4-b5f4-7d487728a23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:48.139040 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730351d-ad1b-4fa4-b5f4-7d487728a23f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:48.181522 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca27f8-b717-4429-8767-e4a87339ea1a admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:48.183564 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1214/2433] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:48 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:43:48.201994 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca27f8-b717-4429-8767-e4a87339ea1a admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:48.208470 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a4568-23d8-456b-99a3-b8f56380862e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:48.209516 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a4568-23d8-456b-99a3-b8f56380862e admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:48.209818 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a4568-23d8-456b-99a3-b8f56380862e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:48.210112 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a4568-23d8-456b-99a3-b8f56380862e admin admin] PATH_INFO: `/v3/projects/a515cb98fb224ddabb3e749a9b6bc7eb/users/499dbc1a6c1c430184483483468d2185/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:48.240703 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a4568-23d8-456b-99a3-b8f56380862e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a515cb98fb224ddabb3e749a9b6bc7eb, user_id=499dbc1a6c1c430184483483468d2185, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:48.243718 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a4568-23d8-456b-99a3-b8f56380862e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:48.289294 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1220/2434] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:48 2021] PUT /identity/v3/projects/a515cb98fb224ddabb3e749a9b6bc7eb/users/499dbc1a6c1c430184483483468d2185/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:48.294150 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730351d-ad1b-4fa4-b5f4-7d487728a23f admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:48.310179 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730351d-ad1b-4fa4-b5f4-7d487728a23f admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:48.465769 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e34ce5-93e5-471f-9e96-3bdcd20c74ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:48.466387 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e34ce5-93e5-471f-9e96-3bdcd20c74ac admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:48.466678 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e34ce5-93e5-471f-9e96-3bdcd20c74ac admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:48.466962 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e34ce5-93e5-471f-9e96-3bdcd20c74ac admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:48.467665 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e34ce5-93e5-471f-9e96-3bdcd20c74ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:48.469292 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e34ce5-93e5-471f-9e96-3bdcd20c74ac admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:48.486255 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1215/2435] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:48 2021] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:43:48.487447 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a4568-23d8-456b-99a3-b8f56380862e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:48.502053 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a4568-23d8-456b-99a3-b8f56380862e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:48.515692 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48239da0-e1f4-4180-8dbf-efb0838a8ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:48.517061 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48239da0-e1f4-4180-8dbf-efb0838a8ae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:48.517686 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48239da0-e1f4-4180-8dbf-efb0838a8ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:48.518235 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48239da0-e1f4-4180-8dbf-efb0838a8ae0 admin admin] PATH_INFO: `/v3/projects/a515cb98fb224ddabb3e749a9b6bc7eb/users/499dbc1a6c1c430184483483468d2185/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:48.523749 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48239da0-e1f4-4180-8dbf-efb0838a8ae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a515cb98fb224ddabb3e749a9b6bc7eb, user_id=499dbc1a6c1c430184483483468d2185, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:48.530727 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48239da0-e1f4-4180-8dbf-efb0838a8ae0 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:48.558994 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1221/2436] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:48 2021] PUT /identity/v3/projects/a515cb98fb224ddabb3e749a9b6bc7eb/users/499dbc1a6c1c430184483483468d2185/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:48.569700 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c54aa-6e6d-49fc-8231-2a5b12ffac52 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:48.569995 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c54aa-6e6d-49fc-8231-2a5b12ffac52 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:48.570286 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c54aa-6e6d-49fc-8231-2a5b12ffac52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:48.624229 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-272c54aa-6e6d-49fc-8231-2a5b12ffac52 None None] MFA Rules not processed for user `499dbc1a6c1c430184483483468d2185`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:48.625409 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-272c54aa-6e6d-49fc-8231-2a5b12ffac52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:48.708906 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1216/2437] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:48 2021] POST /identity/v3/auth/tokens => generated 3745 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:48.720936 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48239da0-e1f4-4180-8dbf-efb0838a8ae0 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:48.722674 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-48239da0-e1f4-4180-8dbf-efb0838a8ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:48.797081 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48239da0-e1f4-4180-8dbf-efb0838a8ae0 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:48.801620 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68864a42-c40a-41f7-965a-eba0d0971172 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:48.802270 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68864a42-c40a-41f7-965a-eba0d0971172 service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:48.802712 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68864a42-c40a-41f7-965a-eba0d0971172 service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:48.803004 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68864a42-c40a-41f7-965a-eba0d0971172 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:48.813783 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68864a42-c40a-41f7-965a-eba0d0971172 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:48.815242 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68864a42-c40a-41f7-965a-eba0d0971172 service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:48.825597 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1222/2438] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:43:48 2021] GET /identity/v3/auth/tokens => generated 3745 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:43:48.938073 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c54aa-6e6d-49fc-8231-2a5b12ffac52 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:48.948476 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c54aa-6e6d-49fc-8231-2a5b12ffac52 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:48.953498 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9da42-8699-4db2-b1ba-885b25065fc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:48.953760 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9da42-8699-4db2-b1ba-885b25065fc1 service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:48.954086 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9da42-8699-4db2-b1ba-885b25065fc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:48.954279 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9da42-8699-4db2-b1ba-885b25065fc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:49.032688 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9da42-8699-4db2-b1ba-885b25065fc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:49.034372 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9da42-8699-4db2-b1ba-885b25065fc1 service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:49.048935 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1217/2439] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:43:48 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:43:51.391322 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc471a-7c4e-4e9a-bfe6-840b11df46fe None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:51.392262 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc471a-7c4e-4e9a-bfe6-840b11df46fe None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:51.392562 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc471a-7c4e-4e9a-bfe6-840b11df46fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:51.415861 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-dedc471a-7c4e-4e9a-bfe6-840b11df46fe None None] MFA Rules not processed for user `18d85bcc0aeb413aa2ade769fd10e431`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:51.417051 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-dedc471a-7c4e-4e9a-bfe6-840b11df46fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:51.482874 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1223/2440] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:51 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:58.204101 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9da42-8699-4db2-b1ba-885b25065fc1 service cinder] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:58.205536 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-57b9da42-8699-4db2-b1ba-885b25065fc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:58.282103 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9da42-8699-4db2-b1ba-885b25065fc1 service cinder] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:58.288706 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313a398-89fc-4cc3-b20f-6dcee1812b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:58.290096 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313a398-89fc-4cc3-b20f-6dcee1812b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:58.290096 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313a398-89fc-4cc3-b20f-6dcee1812b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:58.290570 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313a398-89fc-4cc3-b20f-6dcee1812b93 admin admin] PATH_INFO: `/v3/users/cb0d5bf878154c6fa174db6389f2ea70` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:58.291713 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313a398-89fc-4cc3-b20f-6dcee1812b93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb0d5bf878154c6fa174db6389f2ea70)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:58.294005 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313a398-89fc-4cc3-b20f-6dcee1812b93 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:58.356140 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b313a398-89fc-4cc3-b20f-6dcee1812b93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb0d5bf878154c6fa174db6389f2ea70'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:58.357161 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b313a398-89fc-4cc3-b20f-6dcee1812b93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb0d5bf878154c6fa174db6389f2ea70'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:58.370137 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b313a398-89fc-4cc3-b20f-6dcee1812b93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb0d5bf878154c6fa174db6389f2ea70'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:58.381012 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b313a398-89fc-4cc3-b20f-6dcee1812b93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb0d5bf878154c6fa174db6389f2ea70'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:58.390843 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b313a398-89fc-4cc3-b20f-6dcee1812b93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb0d5bf878154c6fa174db6389f2ea70'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:58.397957 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1218/2441] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:43:58 2021] DELETE /identity/v3/users/cb0d5bf878154c6fa174db6389f2ea70 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:58.864117 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba47a75-6282-412a-98d9-4f3f49b25546 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:58.864563 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba47a75-6282-412a-98d9-4f3f49b25546 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:58.864704 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba47a75-6282-412a-98d9-4f3f49b25546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:58.925036 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-cba47a75-6282-412a-98d9-4f3f49b25546 None None] MFA Rules not processed for user `fa7dedfceea346ca997eedec181935c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:58.926321 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-cba47a75-6282-412a-98d9-4f3f49b25546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:58.962065 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313a398-89fc-4cc3-b20f-6dcee1812b93 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:58.963559 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-b313a398-89fc-4cc3-b20f-6dcee1812b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:59.031336 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1224/2442] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Dec 16 14:43:58 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:59.063179 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba47a75-6282-412a-98d9-4f3f49b25546 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:59.071236 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-cba47a75-6282-412a-98d9-4f3f49b25546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:59.077443 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313a398-89fc-4cc3-b20f-6dcee1812b93 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:59.082618 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f6421-c1a7-4c90-97d3-431b9adc2594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:59.083273 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f6421-c1a7-4c90-97d3-431b9adc2594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:59.083569 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f6421-c1a7-4c90-97d3-431b9adc2594 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:59.084308 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f6421-c1a7-4c90-97d3-431b9adc2594 admin admin] PATH_INFO: `/v3/projects/cd04f3d6f9ef4788bb01db0c11ba554f` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:59.085494 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f6421-c1a7-4c90-97d3-431b9adc2594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd04f3d6f9ef4788bb01db0c11ba554f)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:59.087524 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f6421-c1a7-4c90-97d3-431b9adc2594 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:59.151218 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-441f6421-c1a7-4c90-97d3-431b9adc2594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'request_id': 'req-441f6421-c1a7-4c90-97d3-431b9adc2594'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:59.162057 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba47a75-6282-412a-98d9-4f3f49b25546 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:59.165204 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-441f6421-c1a7-4c90-97d3-431b9adc2594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'request_id': 'req-441f6421-c1a7-4c90-97d3-431b9adc2594'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:59.171960 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-441f6421-c1a7-4c90-97d3-431b9adc2594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'request_id': 'req-441f6421-c1a7-4c90-97d3-431b9adc2594'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:59.191101 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-441f6421-c1a7-4c90-97d3-431b9adc2594 admin admin] The token cache is being invalidate because project cd04f3d6f9ef4788bb01db0c11ba554f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:43:59.191432 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-441f6421-c1a7-4c90-97d3-431b9adc2594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:59.192376 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-441f6421-c1a7-4c90-97d3-431b9adc2594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:59.194717 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1219/2443] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:43:58 2021] DELETE /identity/v3/projects/cd04f3d6f9ef4788bb01db0c11ba554f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:59.200929 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2640e-9b2f-4c93-ab2a-cd2c83712038 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:59.201219 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2640e-9b2f-4c93-ab2a-cd2c83712038 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:59.201507 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2640e-9b2f-4c93-ab2a-cd2c83712038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:59.226467 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-e1b2640e-9b2f-4c93-ab2a-cd2c83712038 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:59.227627 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e1b2640e-9b2f-4c93-ab2a-cd2c83712038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:59.244276 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d62719-26ff-450a-af48-5f3b89e71367 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de4c90e44b96488aa47fbbc302e4f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:59.244986 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d62719-26ff-450a-af48-5f3b89e71367 service swift] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:59.247046 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d62719-26ff-450a-af48-5f3b89e71367 service swift] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:59.247046 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d62719-26ff-450a-af48-5f3b89e71367 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:59.248310 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-b9d62719-26ff-450a-af48-5f3b89e71367 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:59.306829 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1220/2444] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:43:59.316337 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ca8d4-70a8-49f1-88d6-90c7d3e8c2fb None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:59.316554 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ca8d4-70a8-49f1-88d6-90c7d3e8c2fb None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:59.317020 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ca8d4-70a8-49f1-88d6-90c7d3e8c2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:59.340373 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d62719-26ff-450a-af48-5f3b89e71367 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:59.342212 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d62719-26ff-450a-af48-5f3b89e71367 service swift] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:59.346882 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-873ca8d4-70a8-49f1-88d6-90c7d3e8c2fb None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:59.348173 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-873ca8d4-70a8-49f1-88d6-90c7d3e8c2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:59.354843 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1225/2445] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Dec 16 14:43:59 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:43:59.365373 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1221/2446] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:59.370132 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d62719-26ff-450a-af48-5f3b89e71367 service swift] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:59.381809 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d62719-26ff-450a-af48-5f3b89e71367 service swift] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:59.387613 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697556d1-58b2-4b03-b827-f786b9f9fcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:59.388110 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697556d1-58b2-4b03-b827-f786b9f9fcc8 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:59.388412 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697556d1-58b2-4b03-b827-f786b9f9fcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:59.388699 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697556d1-58b2-4b03-b827-f786b9f9fcc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:59.389476 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697556d1-58b2-4b03-b827-f786b9f9fcc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:43:59.389725 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697556d1-58b2-4b03-b827-f786b9f9fcc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:59.391365 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697556d1-58b2-4b03-b827-f786b9f9fcc8 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:59.412465 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1226/2447] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:43:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:43:59.413678 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ca8d4-70a8-49f1-88d6-90c7d3e8c2fb None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:59.423364 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ca8d4-70a8-49f1-88d6-90c7d3e8c2fb None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:59.427958 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148dd69-ba5d-465d-8cf6-fdf63c44abf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:59.428694 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148dd69-ba5d-465d-8cf6-fdf63c44abf3 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:59.428965 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148dd69-ba5d-465d-8cf6-fdf63c44abf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:59.429246 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148dd69-ba5d-465d-8cf6-fdf63c44abf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:59.429883 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148dd69-ba5d-465d-8cf6-fdf63c44abf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:59.432955 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148dd69-ba5d-465d-8cf6-fdf63c44abf3 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:59.470026 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1222/2448] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:43:59 2021] POST /identity/v3/projects => generated 397 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:43:59.471347 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697556d1-58b2-4b03-b827-f786b9f9fcc8 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:59.486651 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697556d1-58b2-4b03-b827-f786b9f9fcc8 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:59.563695 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696525c-6193-4366-91d9-8cf63720ddf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:59.564313 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696525c-6193-4366-91d9-8cf63720ddf1 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:59.564600 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696525c-6193-4366-91d9-8cf63720ddf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:59.564981 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696525c-6193-4366-91d9-8cf63720ddf1 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:59.565623 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696525c-6193-4366-91d9-8cf63720ddf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:59.567590 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696525c-6193-4366-91d9-8cf63720ddf1 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:59.592441 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1227/2449] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:43:59 2021] POST /identity/v3/users => generated 299 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:43:59.594497 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148dd69-ba5d-465d-8cf6-fdf63c44abf3 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:59.607633 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148dd69-ba5d-465d-8cf6-fdf63c44abf3 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:59.615208 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee06514-802a-4bb4-a15d-d567e22599e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:59.615956 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee06514-802a-4bb4-a15d-d567e22599e2 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:59.616331 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee06514-802a-4bb4-a15d-d567e22599e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:59.616729 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee06514-802a-4bb4-a15d-d567e22599e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:59.617673 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee06514-802a-4bb4-a15d-d567e22599e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:59.619584 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee06514-802a-4bb4-a15d-d567e22599e2 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:59.633348 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1223/2450] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:59 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:43:59.637940 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696525c-6193-4366-91d9-8cf63720ddf1 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:59.650512 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696525c-6193-4366-91d9-8cf63720ddf1 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:59.659474 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a204a-12ec-4c23-8f4e-77beec755c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:59.660535 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a204a-12ec-4c23-8f4e-77beec755c8a admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:59.661060 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a204a-12ec-4c23-8f4e-77beec755c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:59.661586 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a204a-12ec-4c23-8f4e-77beec755c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:59.662510 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a204a-12ec-4c23-8f4e-77beec755c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:59.664992 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a204a-12ec-4c23-8f4e-77beec755c8a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:59.680026 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1228/2451] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:59 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:43:59.684613 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee06514-802a-4bb4-a15d-d567e22599e2 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:59.696966 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee06514-802a-4bb4-a15d-d567e22599e2 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:59.702348 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f1ce3-1926-4899-b2b7-d831337e0231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:59.703230 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f1ce3-1926-4899-b2b7-d831337e0231 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:59.703459 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f1ce3-1926-4899-b2b7-d831337e0231 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:59.703748 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f1ce3-1926-4899-b2b7-d831337e0231 admin admin] PATH_INFO: `/v3/projects/4adf7287b539497f9cb11c625ebc5b75/users/40b8df7a62584ce882d7fe0895caf348/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:59.729416 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f1ce3-1926-4899-b2b7-d831337e0231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4adf7287b539497f9cb11c625ebc5b75, user_id=40b8df7a62584ce882d7fe0895caf348, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:59.733653 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f1ce3-1926-4899-b2b7-d831337e0231 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:43:59.754088 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1224/2452] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:59 2021] PUT /identity/v3/projects/4adf7287b539497f9cb11c625ebc5b75/users/40b8df7a62584ce882d7fe0895caf348/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:43:59.766860 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed242ec-7bcc-4bd5-b267-a95b8213fab4 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:59.767188 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed242ec-7bcc-4bd5-b267-a95b8213fab4 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:59.767445 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed242ec-7bcc-4bd5-b267-a95b8213fab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:59.825310 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-2ed242ec-7bcc-4bd5-b267-a95b8213fab4 None None] MFA Rules not processed for user `40b8df7a62584ce882d7fe0895caf348`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:59.826503 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-2ed242ec-7bcc-4bd5-b267-a95b8213fab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:59.912636 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1229/2453] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:43:59 2021] POST /identity/v3/auth/tokens => generated 3704 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:59.928279 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f1ce3-1926-4899-b2b7-d831337e0231 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:59.931221 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-6f0f1ce3-1926-4899-b2b7-d831337e0231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:00.017092 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f1ce3-1926-4899-b2b7-d831337e0231 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:00.021250 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8881476-e180-492b-b9c3-809b66e730f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:00.022083 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8881476-e180-492b-b9c3-809b66e730f8 service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:00.022479 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8881476-e180-492b-b9c3-809b66e730f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:00.022880 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8881476-e180-492b-b9c3-809b66e730f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:00.034292 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8881476-e180-492b-b9c3-809b66e730f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:00.035787 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8881476-e180-492b-b9c3-809b66e730f8 service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:00.053091 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1225/2454] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:43:59 2021] GET /identity/v3/auth/tokens => generated 3704 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:00.149931 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8653245-fc78-47b4-9438-203902d80103 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:00.150771 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8653245-fc78-47b4-9438-203902d80103 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:00.151068 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8653245-fc78-47b4-9438-203902d80103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:00.175612 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-f8653245-fc78-47b4-9438-203902d80103 None None] MFA Rules not processed for user `fa7dedfceea346ca997eedec181935c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:00.176800 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-f8653245-fc78-47b4-9438-203902d80103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:00.254166 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1230/2455] 10.222.0.64 () {58 vars in 967 bytes} [Thu Dec 16 14:44:00 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:00.267482 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8881476-e180-492b-b9c3-809b66e730f8 service cinder] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:00.268871 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-a8881476-e180-492b-b9c3-809b66e730f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:00.343793 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8881476-e180-492b-b9c3-809b66e730f8 service cinder] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:00.348600 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b4d16-4a6f-472a-bb6c-2cf7e27e8d8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de4c90e44b96488aa47fbbc302e4f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:00.349220 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b4d16-4a6f-472a-bb6c-2cf7e27e8d8f service swift] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:00.349512 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b4d16-4a6f-472a-bb6c-2cf7e27e8d8f service swift] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:00.349798 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b4d16-4a6f-472a-bb6c-2cf7e27e8d8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:00.358254 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b4d16-4a6f-472a-bb6c-2cf7e27e8d8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:00.359816 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b4d16-4a6f-472a-bb6c-2cf7e27e8d8f service swift] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:00.368161 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1226/2456] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Dec 16 14:44:00 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:44:00.656997 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed5ce2-0eac-4d7b-b388-2fe410069acc None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:00.657454 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed5ce2-0eac-4d7b-b388-2fe410069acc None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:00.658076 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed5ce2-0eac-4d7b-b388-2fe410069acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:00.688323 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-99ed5ce2-0eac-4d7b-b388-2fe410069acc None None] MFA Rules not processed for user `fa7dedfceea346ca997eedec181935c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:00.689979 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-99ed5ce2-0eac-4d7b-b388-2fe410069acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:00.700460 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1231/2457] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Dec 16 14:44:00 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:00.715632 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b4d16-4a6f-472a-bb6c-2cf7e27e8d8f service swift] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:00.726505 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b4d16-4a6f-472a-bb6c-2cf7e27e8d8f service swift] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:00.732007 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c565cea-ffb1-45a7-b798-40b2c84d5d48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de4c90e44b96488aa47fbbc302e4f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:00.732573 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c565cea-ffb1-45a7-b798-40b2c84d5d48 service swift] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:00.732899 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c565cea-ffb1-45a7-b798-40b2c84d5d48 service swift] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:00.733215 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c565cea-ffb1-45a7-b798-40b2c84d5d48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:00.741120 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c565cea-ffb1-45a7-b798-40b2c84d5d48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:00.742838 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c565cea-ffb1-45a7-b798-40b2c84d5d48 service swift] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:00.750757 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1227/2458] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Dec 16 14:44:00 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:44:01.130843 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db935d27-6c39-4502-add9-d7562c8a87e6 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:01.131302 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db935d27-6c39-4502-add9-d7562c8a87e6 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:01.131422 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db935d27-6c39-4502-add9-d7562c8a87e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:01.154470 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-db935d27-6c39-4502-add9-d7562c8a87e6 None None] MFA Rules not processed for user `fa7dedfceea346ca997eedec181935c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:01.155608 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-db935d27-6c39-4502-add9-d7562c8a87e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:01.162149 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1232/2459] 10.222.0.64 () {58 vars in 967 bytes} [Thu Dec 16 14:44:01 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:01.174084 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c565cea-ffb1-45a7-b798-40b2c84d5d48 service swift] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:01.184161 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c565cea-ffb1-45a7-b798-40b2c84d5d48 service swift] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:01.189166 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afd099-731a-4338-b382-d2dc06bfb229 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de4c90e44b96488aa47fbbc302e4f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:01.189744 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afd099-731a-4338-b382-d2dc06bfb229 service swift] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:01.190039 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afd099-731a-4338-b382-d2dc06bfb229 service swift] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:01.190757 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afd099-731a-4338-b382-d2dc06bfb229 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:01.199414 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33afd099-731a-4338-b382-d2dc06bfb229 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:01.201002 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33afd099-731a-4338-b382-d2dc06bfb229 service swift] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:01.209858 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1228/2460] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Dec 16 14:44:01 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:44:06.225389 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db935d27-6c39-4502-add9-d7562c8a87e6 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:06.226847 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-db935d27-6c39-4502-add9-d7562c8a87e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:06.313036 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db935d27-6c39-4502-add9-d7562c8a87e6 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:06.317073 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83401f39-3646-433f-b2a4-2301896c20ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:06.317889 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83401f39-3646-433f-b2a4-2301896c20ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:06.318177 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83401f39-3646-433f-b2a4-2301896c20ae admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:06.318463 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83401f39-3646-433f-b2a4-2301896c20ae admin admin] PATH_INFO: `/v3/users/dd6995638c134e74b541bf0cbb929449` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:06.319747 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83401f39-3646-433f-b2a4-2301896c20ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd6995638c134e74b541bf0cbb929449)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:06.321912 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83401f39-3646-433f-b2a4-2301896c20ae admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:06.388274 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-83401f39-3646-433f-b2a4-2301896c20ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd6995638c134e74b541bf0cbb929449'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:06.389298 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-83401f39-3646-433f-b2a4-2301896c20ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd6995638c134e74b541bf0cbb929449'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:06.409457 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-83401f39-3646-433f-b2a4-2301896c20ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd6995638c134e74b541bf0cbb929449'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:06.419807 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-83401f39-3646-433f-b2a4-2301896c20ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd6995638c134e74b541bf0cbb929449'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:06.428920 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-83401f39-3646-433f-b2a4-2301896c20ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd6995638c134e74b541bf0cbb929449'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:06.435620 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1233/2461] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:44:06 2021] DELETE /identity/v3/users/dd6995638c134e74b541bf0cbb929449 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:06.441954 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd7d2a-8c46-4162-9bcc-c956178928d6 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:06.442440 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd7d2a-8c46-4162-9bcc-c956178928d6 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:06.442567 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd7d2a-8c46-4162-9bcc-c956178928d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:06.465676 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-89dd7d2a-8c46-4162-9bcc-c956178928d6 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:06.466822 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-89dd7d2a-8c46-4162-9bcc-c956178928d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:06.538038 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1229/2462] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:06.549019 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83401f39-3646-433f-b2a4-2301896c20ae admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:06.550481 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-83401f39-3646-433f-b2a4-2301896c20ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:06.618508 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83401f39-3646-433f-b2a4-2301896c20ae admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:06.622185 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987da1c-63cc-4acb-b31c-95580c9e8ca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:06.622778 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987da1c-63cc-4acb-b31c-95580c9e8ca0 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:06.623068 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987da1c-63cc-4acb-b31c-95580c9e8ca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:06.623345 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987da1c-63cc-4acb-b31c-95580c9e8ca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:06.632648 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987da1c-63cc-4acb-b31c-95580c9e8ca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:06.634114 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987da1c-63cc-4acb-b31c-95580c9e8ca0 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:06.643811 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1234/2463] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:44:06.967613 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd7d2a-8c46-4162-9bcc-c956178928d6 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:06.969201 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-89dd7d2a-8c46-4162-9bcc-c956178928d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:06.985413 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd7d2a-8c46-4162-9bcc-c956178928d6 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:06.990388 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c818d44-376d-41ce-b47b-70965cabb4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:06.991189 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c818d44-376d-41ce-b47b-70965cabb4a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:06.991478 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c818d44-376d-41ce-b47b-70965cabb4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:06.991761 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c818d44-376d-41ce-b47b-70965cabb4a5 admin admin] PATH_INFO: `/v3/projects/bed21a1e88bf46c49beba44b174b57dd` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:06.992934 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c818d44-376d-41ce-b47b-70965cabb4a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bed21a1e88bf46c49beba44b174b57dd)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:06.995205 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c818d44-376d-41ce-b47b-70965cabb4a5 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:07.060106 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-2c818d44-376d-41ce-b47b-70965cabb4a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bed21a1e88bf46c49beba44b174b57dd', 'request_id': 'req-2c818d44-376d-41ce-b47b-70965cabb4a5'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:07.070951 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-2c818d44-376d-41ce-b47b-70965cabb4a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bed21a1e88bf46c49beba44b174b57dd', 'request_id': 'req-2c818d44-376d-41ce-b47b-70965cabb4a5'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:07.075894 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-2c818d44-376d-41ce-b47b-70965cabb4a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bed21a1e88bf46c49beba44b174b57dd', 'request_id': 'req-2c818d44-376d-41ce-b47b-70965cabb4a5'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:07.088218 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-2c818d44-376d-41ce-b47b-70965cabb4a5 admin admin] The token cache is being invalidate because project bed21a1e88bf46c49beba44b174b57dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:44:07.088503 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-2c818d44-376d-41ce-b47b-70965cabb4a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:07.089191 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-2c818d44-376d-41ce-b47b-70965cabb4a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:07.090754 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1230/2464] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:44:06 2021] DELETE /identity/v3/projects/bed21a1e88bf46c49beba44b174b57dd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:07.100146 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a76a3b-ed93-4d47-82f2-885563bc9a60 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:07.100719 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a76a3b-ed93-4d47-82f2-885563bc9a60 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:07.101037 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a76a3b-ed93-4d47-82f2-885563bc9a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:07.124558 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-43a76a3b-ed93-4d47-82f2-885563bc9a60 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:07.125752 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-43a76a3b-ed93-4d47-82f2-885563bc9a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:07.193076 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1235/2465] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:44:07.200560 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa83e2-a54f-4383-ba12-77d35fad1c6b None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:07.200978 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa83e2-a54f-4383-ba12-77d35fad1c6b None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:07.201330 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa83e2-a54f-4383-ba12-77d35fad1c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:07.225683 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-56fa83e2-a54f-4383-ba12-77d35fad1c6b None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:07.226960 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-56fa83e2-a54f-4383-ba12-77d35fad1c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:07.235487 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1231/2466] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:07.240327 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a76a3b-ed93-4d47-82f2-885563bc9a60 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:07.250896 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a76a3b-ed93-4d47-82f2-885563bc9a60 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:07.255768 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d6836-1365-48d3-9c12-f88314f82618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:07.256390 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d6836-1365-48d3-9c12-f88314f82618 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:07.256680 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d6836-1365-48d3-9c12-f88314f82618 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:07.257004 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d6836-1365-48d3-9c12-f88314f82618 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:07.257769 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d6836-1365-48d3-9c12-f88314f82618 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:44:07.258001 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d6836-1365-48d3-9c12-f88314f82618 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:07.259598 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d6836-1365-48d3-9c12-f88314f82618 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:07.275907 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1236/2467] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:44:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:44:07.277811 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa83e2-a54f-4383-ba12-77d35fad1c6b None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:07.286688 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa83e2-a54f-4383-ba12-77d35fad1c6b None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:07.291070 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101c1d9-bbd2-4068-b399-9ffa325feeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:07.291655 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101c1d9-bbd2-4068-b399-9ffa325feeb8 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:07.291947 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101c1d9-bbd2-4068-b399-9ffa325feeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:07.292229 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101c1d9-bbd2-4068-b399-9ffa325feeb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:07.293503 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101c1d9-bbd2-4068-b399-9ffa325feeb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:07.295367 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101c1d9-bbd2-4068-b399-9ffa325feeb8 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:07.321643 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1232/2468] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:44:07 2021] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:44:07.325959 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d6836-1365-48d3-9c12-f88314f82618 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:07.335827 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d6836-1365-48d3-9c12-f88314f82618 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:07.407487 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffb27f-2f34-4577-88b4-0b2a1d222dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:07.408375 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffb27f-2f34-4577-88b4-0b2a1d222dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:07.408717 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffb27f-2f34-4577-88b4-0b2a1d222dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:07.409076 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffb27f-2f34-4577-88b4-0b2a1d222dd9 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:07.409948 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffb27f-2f34-4577-88b4-0b2a1d222dd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:07.412011 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffb27f-2f34-4577-88b4-0b2a1d222dd9 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:07.440069 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1237/2469] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:44:07 2021] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:44:07.445554 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101c1d9-bbd2-4068-b399-9ffa325feeb8 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:07.458765 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101c1d9-bbd2-4068-b399-9ffa325feeb8 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:07.463497 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd799bf0-2f5a-4199-a160-3e5634f655b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:07.464137 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd799bf0-2f5a-4199-a160-3e5634f655b2 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:07.465170 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd799bf0-2f5a-4199-a160-3e5634f655b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:07.465460 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd799bf0-2f5a-4199-a160-3e5634f655b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:07.466162 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd799bf0-2f5a-4199-a160-3e5634f655b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:07.467772 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd799bf0-2f5a-4199-a160-3e5634f655b2 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:07.481070 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1233/2470] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:07 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:44:07.484074 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffb27f-2f34-4577-88b4-0b2a1d222dd9 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:07.497051 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffb27f-2f34-4577-88b4-0b2a1d222dd9 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:07.501669 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933dccbe-38a7-4203-b33e-68b54e655fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:07.502277 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dccbe-38a7-4203-b33e-68b54e655fea admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:07.502573 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dccbe-38a7-4203-b33e-68b54e655fea admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:07.503298 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dccbe-38a7-4203-b33e-68b54e655fea admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:07.503558 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933dccbe-38a7-4203-b33e-68b54e655fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:07.505363 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933dccbe-38a7-4203-b33e-68b54e655fea admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:07.517058 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1238/2471] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:07 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:44:07.521301 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd799bf0-2f5a-4199-a160-3e5634f655b2 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:07.531016 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd799bf0-2f5a-4199-a160-3e5634f655b2 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:07.535543 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb6064-9e23-477f-805c-d3cf6e0a0f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:07.536432 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb6064-9e23-477f-805c-d3cf6e0a0f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:07.536819 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb6064-9e23-477f-805c-d3cf6e0a0f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:07.537175 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb6064-9e23-477f-805c-d3cf6e0a0f67 admin admin] PATH_INFO: `/v3/projects/90b1e0c2f8144613a8e65e6b0e208a87/users/c993a63eecd0427bb688f1fd6d435168/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:07.559190 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb6064-9e23-477f-805c-d3cf6e0a0f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90b1e0c2f8144613a8e65e6b0e208a87, user_id=c993a63eecd0427bb688f1fd6d435168, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:07.562488 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb6064-9e23-477f-805c-d3cf6e0a0f67 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:07.577866 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1234/2472] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:44:07 2021] PUT /identity/v3/projects/90b1e0c2f8144613a8e65e6b0e208a87/users/c993a63eecd0427bb688f1fd6d435168/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:44:07.583829 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155849d-4f00-4e54-8a6c-eb111015cfd8 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:07.584139 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155849d-4f00-4e54-8a6c-eb111015cfd8 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:07.584427 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155849d-4f00-4e54-8a6c-eb111015cfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:07.608897 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-b155849d-4f00-4e54-8a6c-eb111015cfd8 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:07.610213 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-b155849d-4f00-4e54-8a6c-eb111015cfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:07.708422 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1239/2473] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:07.723185 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb6064-9e23-477f-805c-d3cf6e0a0f67 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:07.725012 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-4edb6064-9e23-477f-805c-d3cf6e0a0f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:07.801412 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb6064-9e23-477f-805c-d3cf6e0a0f67 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:07.805070 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3bb96-b45b-45b5-832a-45cfcfafd19e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:07.805740 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3bb96-b45b-45b5-832a-45cfcfafd19e service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:07.806031 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3bb96-b45b-45b5-832a-45cfcfafd19e service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:07.806456 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3bb96-b45b-45b5-832a-45cfcfafd19e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:07.817503 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3bb96-b45b-45b5-832a-45cfcfafd19e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:07.818924 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3bb96-b45b-45b5-832a-45cfcfafd19e service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:07.828063 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1235/2474] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:07 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:08.851465 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155849d-4f00-4e54-8a6c-eb111015cfd8 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:08.852845 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-b155849d-4f00-4e54-8a6c-eb111015cfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:08.874578 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155849d-4f00-4e54-8a6c-eb111015cfd8 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:08.883232 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58aa42-0d34-47e3-8e89-52f19d947dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:08.884063 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58aa42-0d34-47e3-8e89-52f19d947dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:08.884352 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58aa42-0d34-47e3-8e89-52f19d947dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:08.884629 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58aa42-0d34-47e3-8e89-52f19d947dc8 admin admin] PATH_INFO: `/v3/users/40b8df7a62584ce882d7fe0895caf348` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:08.887299 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58aa42-0d34-47e3-8e89-52f19d947dc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40b8df7a62584ce882d7fe0895caf348)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:08.889610 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58aa42-0d34-47e3-8e89-52f19d947dc8 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:09.006623 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-1a58aa42-0d34-47e3-8e89-52f19d947dc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40b8df7a62584ce882d7fe0895caf348'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:09.007417 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-1a58aa42-0d34-47e3-8e89-52f19d947dc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40b8df7a62584ce882d7fe0895caf348'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:09.026179 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-1a58aa42-0d34-47e3-8e89-52f19d947dc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40b8df7a62584ce882d7fe0895caf348'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:09.035983 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-1a58aa42-0d34-47e3-8e89-52f19d947dc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40b8df7a62584ce882d7fe0895caf348'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:09.046280 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-1a58aa42-0d34-47e3-8e89-52f19d947dc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40b8df7a62584ce882d7fe0895caf348'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:09.056932 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1240/2475] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:44:08 2021] DELETE /identity/v3/users/40b8df7a62584ce882d7fe0895caf348 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:09.058955 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954d6ea-b2b6-4199-b2e6-c549876e2d83 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:09.059507 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954d6ea-b2b6-4199-b2e6-c549876e2d83 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:09.059507 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954d6ea-b2b6-4199-b2e6-c549876e2d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:09.084775 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-1954d6ea-b2b6-4199-b2e6-c549876e2d83 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:09.086001 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-1954d6ea-b2b6-4199-b2e6-c549876e2d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:09.155662 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1236/2476] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:09.169748 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58aa42-0d34-47e3-8e89-52f19d947dc8 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:09.171433 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-1a58aa42-0d34-47e3-8e89-52f19d947dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:09.253449 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58aa42-0d34-47e3-8e89-52f19d947dc8 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:09.257870 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39189bf7-fd0e-4a89-869d-df49c14aad6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:09.259747 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39189bf7-fd0e-4a89-869d-df49c14aad6c service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:09.259747 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39189bf7-fd0e-4a89-869d-df49c14aad6c service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:09.259747 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39189bf7-fd0e-4a89-869d-df49c14aad6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:09.270133 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39189bf7-fd0e-4a89-869d-df49c14aad6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:09.271741 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39189bf7-fd0e-4a89-869d-df49c14aad6c service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:09.282257 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1241/2477] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:09 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:10.155142 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954d6ea-b2b6-4199-b2e6-c549876e2d83 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:10.157066 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-1954d6ea-b2b6-4199-b2e6-c549876e2d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:10.171681 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954d6ea-b2b6-4199-b2e6-c549876e2d83 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:10.188983 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46e3c1-730c-44fb-8710-85676dcdf32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:10.189788 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46e3c1-730c-44fb-8710-85676dcdf32c admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:10.190135 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46e3c1-730c-44fb-8710-85676dcdf32c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:10.190405 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46e3c1-730c-44fb-8710-85676dcdf32c admin admin] PATH_INFO: `/v3/projects/4adf7287b539497f9cb11c625ebc5b75` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:10.191522 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46e3c1-730c-44fb-8710-85676dcdf32c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4adf7287b539497f9cb11c625ebc5b75)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:10.193438 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46e3c1-730c-44fb-8710-85676dcdf32c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:10.270122 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ca46e3c1-730c-44fb-8710-85676dcdf32c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4adf7287b539497f9cb11c625ebc5b75', 'request_id': 'req-ca46e3c1-730c-44fb-8710-85676dcdf32c'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:10.290523 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ca46e3c1-730c-44fb-8710-85676dcdf32c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4adf7287b539497f9cb11c625ebc5b75', 'request_id': 'req-ca46e3c1-730c-44fb-8710-85676dcdf32c'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:10.300618 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ca46e3c1-730c-44fb-8710-85676dcdf32c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4adf7287b539497f9cb11c625ebc5b75', 'request_id': 'req-ca46e3c1-730c-44fb-8710-85676dcdf32c'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:10.318917 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ca46e3c1-730c-44fb-8710-85676dcdf32c admin admin] The token cache is being invalidate because project 4adf7287b539497f9cb11c625ebc5b75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:44:10.319283 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ca46e3c1-730c-44fb-8710-85676dcdf32c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:10.320451 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ca46e3c1-730c-44fb-8710-85676dcdf32c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:10.322893 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1237/2478] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:44:10 2021] DELETE /identity/v3/projects/4adf7287b539497f9cb11c625ebc5b75 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:10.329398 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14041855-a6e2-4c11-8344-38b5bcb32f3d None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:10.329881 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14041855-a6e2-4c11-8344-38b5bcb32f3d None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:10.329977 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14041855-a6e2-4c11-8344-38b5bcb32f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:10.371146 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-14041855-a6e2-4c11-8344-38b5bcb32f3d None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:10.373550 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-14041855-a6e2-4c11-8344-38b5bcb32f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:10.479242 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1242/2479] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:10.487817 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb911d73-91f3-4088-a9f5-78d613cb57a7 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:10.488495 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb911d73-91f3-4088-a9f5-78d613cb57a7 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:10.489069 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb911d73-91f3-4088-a9f5-78d613cb57a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:10.544704 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-fb911d73-91f3-4088-a9f5-78d613cb57a7 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:10.545939 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-fb911d73-91f3-4088-a9f5-78d613cb57a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:10.557309 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1238/2480] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:44:10.561473 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14041855-a6e2-4c11-8344-38b5bcb32f3d None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:10.571592 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14041855-a6e2-4c11-8344-38b5bcb32f3d None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:10.577600 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bc8d3-012a-496b-ad4a-1c9c78e6115e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:10.578430 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bc8d3-012a-496b-ad4a-1c9c78e6115e admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:10.578728 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bc8d3-012a-496b-ad4a-1c9c78e6115e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:10.579016 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bc8d3-012a-496b-ad4a-1c9c78e6115e admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:10.579750 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bc8d3-012a-496b-ad4a-1c9c78e6115e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:44:10.580107 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bc8d3-012a-496b-ad4a-1c9c78e6115e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:10.581842 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bc8d3-012a-496b-ad4a-1c9c78e6115e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:10.600451 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1243/2481] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:44:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:44:10.601766 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb911d73-91f3-4088-a9f5-78d613cb57a7 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:10.615751 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb911d73-91f3-4088-a9f5-78d613cb57a7 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:10.624717 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c33c1e-540e-4fea-9639-1db4afb797e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:10.625623 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c33c1e-540e-4fea-9639-1db4afb797e0 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:10.626242 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c33c1e-540e-4fea-9639-1db4afb797e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:10.626794 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c33c1e-540e-4fea-9639-1db4afb797e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:10.627615 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c33c1e-540e-4fea-9639-1db4afb797e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:10.629977 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c33c1e-540e-4fea-9639-1db4afb797e0 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:10.676174 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1239/2482] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:44:10 2021] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:44:10.680162 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bc8d3-012a-496b-ad4a-1c9c78e6115e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:10.691043 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bc8d3-012a-496b-ad4a-1c9c78e6115e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:10.785581 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a298b-63fe-43da-acd5-651f72e13e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:10.786547 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a298b-63fe-43da-acd5-651f72e13e55 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:10.787223 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a298b-63fe-43da-acd5-651f72e13e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:10.787893 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a298b-63fe-43da-acd5-651f72e13e55 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:10.788770 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a298b-63fe-43da-acd5-651f72e13e55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:10.791420 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a298b-63fe-43da-acd5-651f72e13e55 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:10.817036 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1244/2483] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:44:10 2021] POST /identity/v3/users => generated 286 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:44:10.820691 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c33c1e-540e-4fea-9639-1db4afb797e0 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:10.832240 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c33c1e-540e-4fea-9639-1db4afb797e0 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:10.838907 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726ba0b-161b-4add-a5ba-55d7cde9311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:10.840324 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726ba0b-161b-4add-a5ba-55d7cde9311d admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:10.841081 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726ba0b-161b-4add-a5ba-55d7cde9311d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:10.841561 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726ba0b-161b-4add-a5ba-55d7cde9311d admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:10.842423 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726ba0b-161b-4add-a5ba-55d7cde9311d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:10.844264 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726ba0b-161b-4add-a5ba-55d7cde9311d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:10.856143 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1240/2484] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:10 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:44:10.860381 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a298b-63fe-43da-acd5-651f72e13e55 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:10.873119 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a298b-63fe-43da-acd5-651f72e13e55 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:10.880656 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1b9a0-20cf-44ff-a3e3-e3eb3fd01c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:10.881770 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1b9a0-20cf-44ff-a3e3-e3eb3fd01c26 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:10.882179 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1b9a0-20cf-44ff-a3e3-e3eb3fd01c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:10.882690 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1b9a0-20cf-44ff-a3e3-e3eb3fd01c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:10.885314 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1b9a0-20cf-44ff-a3e3-e3eb3fd01c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:10.888832 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1b9a0-20cf-44ff-a3e3-e3eb3fd01c26 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:10.916197 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1245/2485] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:10 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:44:10.916711 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726ba0b-161b-4add-a5ba-55d7cde9311d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:10.932284 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726ba0b-161b-4add-a5ba-55d7cde9311d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:10.938002 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02ade3-735d-458d-945f-105a14ddc604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:10.939656 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02ade3-735d-458d-945f-105a14ddc604 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:10.940249 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02ade3-735d-458d-945f-105a14ddc604 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:10.940637 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02ade3-735d-458d-945f-105a14ddc604 admin admin] PATH_INFO: `/v3/projects/46480af5f9db43618ad0897695518251/users/c00d30670c444605a25d63560d82fcbf/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:10.965790 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02ade3-735d-458d-945f-105a14ddc604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46480af5f9db43618ad0897695518251, user_id=c00d30670c444605a25d63560d82fcbf, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:10.970704 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02ade3-735d-458d-945f-105a14ddc604 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:11.019721 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1241/2486] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:44:10 2021] PUT /identity/v3/projects/46480af5f9db43618ad0897695518251/users/c00d30670c444605a25d63560d82fcbf/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:44:11.022301 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513e992-eda7-4af2-8102-690d4341b1d6 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:11.025563 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513e992-eda7-4af2-8102-690d4341b1d6 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:11.027722 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513e992-eda7-4af2-8102-690d4341b1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:11.078124 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-0513e992-eda7-4af2-8102-690d4341b1d6 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:11.079325 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-0513e992-eda7-4af2-8102-690d4341b1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:11.178156 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1246/2487] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:11.194803 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02ade3-735d-458d-945f-105a14ddc604 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:11.197428 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-6f02ade3-735d-458d-945f-105a14ddc604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:11.279666 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02ade3-735d-458d-945f-105a14ddc604 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:11.283308 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51508ba-55d3-4d62-b15f-f615ee820a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:11.283943 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51508ba-55d3-4d62-b15f-f615ee820a9d service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:11.284234 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51508ba-55d3-4d62-b15f-f615ee820a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:11.284514 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51508ba-55d3-4d62-b15f-f615ee820a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:11.294972 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51508ba-55d3-4d62-b15f-f615ee820a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:11.296381 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51508ba-55d3-4d62-b15f-f615ee820a9d service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:11.307364 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1242/2488] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:15.831418 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f946c-c4b5-44ac-97fc-d7c641be7b4d None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:15.831989 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f946c-c4b5-44ac-97fc-d7c641be7b4d None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:15.832092 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f946c-c4b5-44ac-97fc-d7c641be7b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:15.882267 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-a03f946c-c4b5-44ac-97fc-d7c641be7b4d None None] MFA Rules not processed for user `c993a63eecd0427bb688f1fd6d435168`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:15.887621 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-a03f946c-c4b5-44ac-97fc-d7c641be7b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:16.031245 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1247/2489] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:15 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:16.035657 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51508ba-55d3-4d62-b15f-f615ee820a9d service neutron] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:16.038533 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-b51508ba-55d3-4d62-b15f-f615ee820a9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:16.058812 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51508ba-55d3-4d62-b15f-f615ee820a9d service neutron] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:16.073170 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a3a9b-63b7-43d0-9c25-f5d51dcea439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:16.074898 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a3a9b-63b7-43d0-9c25-f5d51dcea439 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:16.075475 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a3a9b-63b7-43d0-9c25-f5d51dcea439 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:16.075766 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a3a9b-63b7-43d0-9c25-f5d51dcea439 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:16.076591 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a3a9b-63b7-43d0-9c25-f5d51dcea439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:16.078565 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a3a9b-63b7-43d0-9c25-f5d51dcea439 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:16.137290 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1243/2490] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:44:16 2021] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:44:16.142991 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f946c-c4b5-44ac-97fc-d7c641be7b4d None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:16.161350 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f946c-c4b5-44ac-97fc-d7c641be7b4d None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:16.236841 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c6141-78d1-42c1-9980-5c25eab8f380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:16.237505 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c6141-78d1-42c1-9980-5c25eab8f380 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:16.237946 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c6141-78d1-42c1-9980-5c25eab8f380 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:16.238245 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c6141-78d1-42c1-9980-5c25eab8f380 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:16.239049 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c6141-78d1-42c1-9980-5c25eab8f380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:16.245001 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c6141-78d1-42c1-9980-5c25eab8f380 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:16.271960 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1248/2491] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:44:16 2021] POST /identity/v3/users => generated 299 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:44:16.276015 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a3a9b-63b7-43d0-9c25-f5d51dcea439 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:16.287329 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a3a9b-63b7-43d0-9c25-f5d51dcea439 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:16.292261 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4af0a-3c24-485b-9c39-ae835f84c3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:16.293114 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4af0a-3c24-485b-9c39-ae835f84c3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:16.293484 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4af0a-3c24-485b-9c39-ae835f84c3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:16.293846 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4af0a-3c24-485b-9c39-ae835f84c3f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:16.294655 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4af0a-3c24-485b-9c39-ae835f84c3f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:16.296430 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4af0a-3c24-485b-9c39-ae835f84c3f8 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:16.312278 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1244/2492] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:16 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:44:16.313770 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c6141-78d1-42c1-9980-5c25eab8f380 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:16.325234 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c6141-78d1-42c1-9980-5c25eab8f380 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:16.330298 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67645b-f91b-427e-b17a-b69aa550c070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:16.331416 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67645b-f91b-427e-b17a-b69aa550c070 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:16.331885 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67645b-f91b-427e-b17a-b69aa550c070 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:16.332286 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67645b-f91b-427e-b17a-b69aa550c070 admin admin] PATH_INFO: `/v3/projects/b7c077a4a4cb41c88ca8e94033742898/users/099b9345883a443cb28eda6c85005683/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:16.361552 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67645b-f91b-427e-b17a-b69aa550c070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c077a4a4cb41c88ca8e94033742898, user_id=099b9345883a443cb28eda6c85005683, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:16.364402 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67645b-f91b-427e-b17a-b69aa550c070 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:16.381429 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1249/2493] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:44:16 2021] PUT /identity/v3/projects/b7c077a4a4cb41c88ca8e94033742898/users/099b9345883a443cb28eda6c85005683/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:16.385518 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4af0a-3c24-485b-9c39-ae835f84c3f8 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:16.396924 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4af0a-3c24-485b-9c39-ae835f84c3f8 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:16.511985 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ce6b4-9638-4905-a606-39557747f340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:16.513215 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ce6b4-9638-4905-a606-39557747f340 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:16.513676 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ce6b4-9638-4905-a606-39557747f340 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:16.514251 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ce6b4-9638-4905-a606-39557747f340 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:16.515551 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ce6b4-9638-4905-a606-39557747f340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:16.518358 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ce6b4-9638-4905-a606-39557747f340 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:16.533003 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1245/2494] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:16 2021] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:44:16.536737 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67645b-f91b-427e-b17a-b69aa550c070 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:16.547802 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67645b-f91b-427e-b17a-b69aa550c070 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:16.552738 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cd974-a140-42b1-ada2-880cfa6df29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:16.553742 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cd974-a140-42b1-ada2-880cfa6df29c admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:16.554116 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cd974-a140-42b1-ada2-880cfa6df29c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:16.554495 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cd974-a140-42b1-ada2-880cfa6df29c admin admin] PATH_INFO: `/v3/projects/b7c077a4a4cb41c88ca8e94033742898/users/099b9345883a443cb28eda6c85005683/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:16.559894 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90cd974-a140-42b1-ada2-880cfa6df29c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c077a4a4cb41c88ca8e94033742898, user_id=099b9345883a443cb28eda6c85005683, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:16.563128 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90cd974-a140-42b1-ada2-880cfa6df29c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:16.575337 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1250/2495] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:44:16 2021] PUT /identity/v3/projects/b7c077a4a4cb41c88ca8e94033742898/users/099b9345883a443cb28eda6c85005683/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:20.852553 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f1b0c-36ee-4bb1-b3f5-47df8b53bd0e None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:20.853428 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f1b0c-36ee-4bb1-b3f5-47df8b53bd0e None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:20.853428 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f1b0c-36ee-4bb1-b3f5-47df8b53bd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:20.938604 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-c66f1b0c-36ee-4bb1-b3f5-47df8b53bd0e None None] MFA Rules not processed for user `c00d30670c444605a25d63560d82fcbf`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:20.940767 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-c66f1b0c-36ee-4bb1-b3f5-47df8b53bd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:21.039798 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1246/2496] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:20 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:21.046288 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cd974-a140-42b1-ada2-880cfa6df29c admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:21.165098 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cd974-a140-42b1-ada2-880cfa6df29c admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:21.175141 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5459c1-84d6-46f6-b1aa-a2c5dd44eeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:21.175952 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5459c1-84d6-46f6-b1aa-a2c5dd44eeb6 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:21.176419 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5459c1-84d6-46f6-b1aa-a2c5dd44eeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:21.176918 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5459c1-84d6-46f6-b1aa-a2c5dd44eeb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:21.177890 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5459c1-84d6-46f6-b1aa-a2c5dd44eeb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:21.180058 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5459c1-84d6-46f6-b1aa-a2c5dd44eeb6 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:21.215645 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1251/2497] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:44:21 2021] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:44:21.218341 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f1b0c-36ee-4bb1-b3f5-47df8b53bd0e None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:21.232989 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f1b0c-36ee-4bb1-b3f5-47df8b53bd0e None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:21.323083 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab1d3c-954a-4a0f-8f4e-5a132af03dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:21.323719 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab1d3c-954a-4a0f-8f4e-5a132af03dbe admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:21.324016 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab1d3c-954a-4a0f-8f4e-5a132af03dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:21.324742 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab1d3c-954a-4a0f-8f4e-5a132af03dbe admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:21.325025 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab1d3c-954a-4a0f-8f4e-5a132af03dbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:21.327387 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab1d3c-954a-4a0f-8f4e-5a132af03dbe admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:21.359518 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1247/2498] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:44:21 2021] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:44:21.363034 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5459c1-84d6-46f6-b1aa-a2c5dd44eeb6 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:21.380648 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5459c1-84d6-46f6-b1aa-a2c5dd44eeb6 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:21.390026 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cdcd7-7d11-4a0d-a5da-9a6bc6a4d683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:21.390979 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cdcd7-7d11-4a0d-a5da-9a6bc6a4d683 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:21.391870 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cdcd7-7d11-4a0d-a5da-9a6bc6a4d683 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:21.392352 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cdcd7-7d11-4a0d-a5da-9a6bc6a4d683 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:21.393418 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62cdcd7-7d11-4a0d-a5da-9a6bc6a4d683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:21.395609 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62cdcd7-7d11-4a0d-a5da-9a6bc6a4d683 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:21.414477 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1252/2499] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:21 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:44:21.419050 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab1d3c-954a-4a0f-8f4e-5a132af03dbe admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:21.429160 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab1d3c-954a-4a0f-8f4e-5a132af03dbe admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:21.435540 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5a83a-5bd8-43fc-9158-acd727ed1b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:21.436366 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5a83a-5bd8-43fc-9158-acd727ed1b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:21.436657 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5a83a-5bd8-43fc-9158-acd727ed1b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:21.436978 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5a83a-5bd8-43fc-9158-acd727ed1b1c admin admin] PATH_INFO: `/v3/projects/480d2c7547e541e190f2af602bbff8e5/users/6e5e9e91777c4aa2ae9c3fb2471df9ff/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:21.463701 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5a83a-5bd8-43fc-9158-acd727ed1b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=480d2c7547e541e190f2af602bbff8e5, user_id=6e5e9e91777c4aa2ae9c3fb2471df9ff, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:21.467427 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5a83a-5bd8-43fc-9158-acd727ed1b1c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:21.488664 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cdcd7-7d11-4a0d-a5da-9a6bc6a4d683 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:21.489689 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1248/2500] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:44:21 2021] PUT /identity/v3/projects/480d2c7547e541e190f2af602bbff8e5/users/6e5e9e91777c4aa2ae9c3fb2471df9ff/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:44:21.501008 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cdcd7-7d11-4a0d-a5da-9a6bc6a4d683 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:21.579887 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7131a2e-5581-4c06-873e-05105f08aa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:21.580513 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7131a2e-5581-4c06-873e-05105f08aa6b admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:21.580827 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7131a2e-5581-4c06-873e-05105f08aa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:21.581116 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7131a2e-5581-4c06-873e-05105f08aa6b admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:21.581826 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7131a2e-5581-4c06-873e-05105f08aa6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:21.584007 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7131a2e-5581-4c06-873e-05105f08aa6b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:21.601268 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5a83a-5bd8-43fc-9158-acd727ed1b1c admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:21.612890 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1253/2501] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:21 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:44:21.613140 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5a83a-5bd8-43fc-9158-acd727ed1b1c admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:21.617766 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcbebff-4264-4729-bc7b-24fd89f41eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:21.618594 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbebff-4264-4729-bc7b-24fd89f41eeb admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:21.618883 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbebff-4264-4729-bc7b-24fd89f41eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:21.619166 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbebff-4264-4729-bc7b-24fd89f41eeb admin admin] PATH_INFO: `/v3/projects/480d2c7547e541e190f2af602bbff8e5/users/6e5e9e91777c4aa2ae9c3fb2471df9ff/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:21.621557 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcbebff-4264-4729-bc7b-24fd89f41eeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=480d2c7547e541e190f2af602bbff8e5, user_id=6e5e9e91777c4aa2ae9c3fb2471df9ff, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:21.624651 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcbebff-4264-4729-bc7b-24fd89f41eeb admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:21.641787 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1249/2502] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:44:21 2021] PUT /identity/v3/projects/480d2c7547e541e190f2af602bbff8e5/users/6e5e9e91777c4aa2ae9c3fb2471df9ff/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:25.266191 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedee5ce-d4c6-4181-a85e-55817b22b3a4 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:25.266633 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedee5ce-d4c6-4181-a85e-55817b22b3a4 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:25.266865 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedee5ce-d4c6-4181-a85e-55817b22b3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:25.365042 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-cedee5ce-d4c6-4181-a85e-55817b22b3a4 None None] MFA Rules not processed for user `099b9345883a443cb28eda6c85005683`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:25.367959 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-cedee5ce-d4c6-4181-a85e-55817b22b3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:25.530920 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1254/2503] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:25 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:25.540510 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcbebff-4264-4729-bc7b-24fd89f41eeb admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:25.544099 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-efcbebff-4264-4729-bc7b-24fd89f41eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:25.642535 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcbebff-4264-4729-bc7b-24fd89f41eeb admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:25.646596 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050998e9-ef1b-43cb-acf6-86bee7465df1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ccebf28ac494f608c33437fc34139be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:25.647176 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050998e9-ef1b-43cb-acf6-86bee7465df1 service glance] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:25.647467 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050998e9-ef1b-43cb-acf6-86bee7465df1 service glance] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:25.647765 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050998e9-ef1b-43cb-acf6-86bee7465df1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:25.762824 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050998e9-ef1b-43cb-acf6-86bee7465df1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:25.767805 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050998e9-ef1b-43cb-acf6-86bee7465df1 service glance] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:25.789338 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1250/2504] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:25 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:26.046578 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083883ea-4616-4d7b-b11a-eff643ee2ef0 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:26.046927 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083883ea-4616-4d7b-b11a-eff643ee2ef0 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:26.047222 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083883ea-4616-4d7b-b11a-eff643ee2ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:26.092378 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-083883ea-4616-4d7b-b11a-eff643ee2ef0 None None] MFA Rules not processed for user `fa7dedfceea346ca997eedec181935c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:26.094588 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-083883ea-4616-4d7b-b11a-eff643ee2ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:26.229413 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1255/2505] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Dec 16 14:44:26 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:44:26.230444 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050998e9-ef1b-43cb-acf6-86bee7465df1 service glance] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:26.231932 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-050998e9-ef1b-43cb-acf6-86bee7465df1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:26.366916 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050998e9-ef1b-43cb-acf6-86bee7465df1 service glance] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:26.379484 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3beaaf-4c59-4536-b791-39db9b41d95b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de4c90e44b96488aa47fbbc302e4f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:26.380049 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3beaaf-4c59-4536-b791-39db9b41d95b service swift] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:26.380350 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3beaaf-4c59-4536-b791-39db9b41d95b service swift] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:26.380638 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3beaaf-4c59-4536-b791-39db9b41d95b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:26.407296 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3beaaf-4c59-4536-b791-39db9b41d95b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:26.410717 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3beaaf-4c59-4536-b791-39db9b41d95b service swift] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:26.450663 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1251/2506] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Dec 16 14:44:26 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:44:31.024415 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa8f8b-c8fd-414d-b84c-afc9f3cd38ce None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:31.026121 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa8f8b-c8fd-414d-b84c-afc9f3cd38ce None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:31.026573 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa8f8b-c8fd-414d-b84c-afc9f3cd38ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:31.118258 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-14aa8f8b-c8fd-414d-b84c-afc9f3cd38ce None None] MFA Rules not processed for user `6e5e9e91777c4aa2ae9c3fb2471df9ff`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:31.119898 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-14aa8f8b-c8fd-414d-b84c-afc9f3cd38ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:31.326908 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1256/2507] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:31 2021] POST /identity/v3/auth/tokens => generated 3747 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:31.336319 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3beaaf-4c59-4536-b791-39db9b41d95b service swift] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:31.337740 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-4c3beaaf-4c59-4536-b791-39db9b41d95b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:31.517633 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3beaaf-4c59-4536-b791-39db9b41d95b service swift] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:31.525230 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488771ef-6992-4425-8e47-a5d3e12be45e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:31.526578 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488771ef-6992-4425-8e47-a5d3e12be45e service nova] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:31.527048 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488771ef-6992-4425-8e47-a5d3e12be45e service nova] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:31.527973 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488771ef-6992-4425-8e47-a5d3e12be45e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:31.642337 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488771ef-6992-4425-8e47-a5d3e12be45e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:31.643959 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488771ef-6992-4425-8e47-a5d3e12be45e service nova] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:31.660515 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1252/2508] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:31 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:33.444837 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa8f8b-c8fd-414d-b84c-afc9f3cd38ce None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:33.477068 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa8f8b-c8fd-414d-b84c-afc9f3cd38ce None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:33.503381 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7f479-eb02-4bd0-a253-38e183df1db2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:33.504250 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7f479-eb02-4bd0-a253-38e183df1db2 service nova] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:33.504728 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7f479-eb02-4bd0-a253-38e183df1db2 service nova] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:33.505193 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7f479-eb02-4bd0-a253-38e183df1db2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:33.507140 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e0c7f479-eb02-4bd0-a253-38e183df1db2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:33.676013 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7f479-eb02-4bd0-a253-38e183df1db2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:33.678113 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7f479-eb02-4bd0-a253-38e183df1db2 service nova] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:33.701390 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1257/2509] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:33 2021] GET /identity/v3/auth/tokens => generated 3694 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:34.535685 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b44e4-f4e0-4ee0-8227-ed27c5adbd35 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:34.536139 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b44e4-f4e0-4ee0-8227-ed27c5adbd35 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:34.536252 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b44e4-f4e0-4ee0-8227-ed27c5adbd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:34.570927 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-e85b44e4-f4e0-4ee0-8227-ed27c5adbd35 None None] MFA Rules not processed for user `c00d30670c444605a25d63560d82fcbf`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:34.572177 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e85b44e4-f4e0-4ee0-8227-ed27c5adbd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:34.579506 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1253/2510] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:34 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:41.081838 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7f479-eb02-4bd0-a253-38e183df1db2 service nova] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:41.083356 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e0c7f479-eb02-4bd0-a253-38e183df1db2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:41.256250 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7f479-eb02-4bd0-a253-38e183df1db2 service nova] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:41.269507 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd6b25-e6bb-4a58-8c9a-ea1ad44c1ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:41.270515 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd6b25-e6bb-4a58-8c9a-ea1ad44c1ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:41.270944 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd6b25-e6bb-4a58-8c9a-ea1ad44c1ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:41.271372 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd6b25-e6bb-4a58-8c9a-ea1ad44c1ab7 admin admin] PATH_INFO: `/v3/users/e717e8636e6c4335abdb2099cbb103c0` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:41.272693 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd6b25-e6bb-4a58-8c9a-ea1ad44c1ab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e717e8636e6c4335abdb2099cbb103c0)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:41.274836 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd6b25-e6bb-4a58-8c9a-ea1ad44c1ab7 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:41.347850 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-d8bd6b25-e6bb-4a58-8c9a-ea1ad44c1ab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e717e8636e6c4335abdb2099cbb103c0'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:41.348561 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-d8bd6b25-e6bb-4a58-8c9a-ea1ad44c1ab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e717e8636e6c4335abdb2099cbb103c0'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:41.361201 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-d8bd6b25-e6bb-4a58-8c9a-ea1ad44c1ab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e717e8636e6c4335abdb2099cbb103c0'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:41.371468 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-d8bd6b25-e6bb-4a58-8c9a-ea1ad44c1ab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e717e8636e6c4335abdb2099cbb103c0'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:41.391358 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-d8bd6b25-e6bb-4a58-8c9a-ea1ad44c1ab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e717e8636e6c4335abdb2099cbb103c0'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:41.403911 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1258/2511] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:44:41 2021] DELETE /identity/v3/users/e717e8636e6c4335abdb2099cbb103c0 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:41.410042 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da716b-1525-4a01-8e75-48430d516bd7 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:41.410953 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da716b-1525-4a01-8e75-48430d516bd7 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:41.411401 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da716b-1525-4a01-8e75-48430d516bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:41.446678 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-02da716b-1525-4a01-8e75-48430d516bd7 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:41.448425 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-02da716b-1525-4a01-8e75-48430d516bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:41.544474 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1254/2512] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:41.558174 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd6b25-e6bb-4a58-8c9a-ea1ad44c1ab7 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:41.559915 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-d8bd6b25-e6bb-4a58-8c9a-ea1ad44c1ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:41.645546 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd6b25-e6bb-4a58-8c9a-ea1ad44c1ab7 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:41.649312 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f014d-17b4-494e-af79-1196769cf772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:41.652223 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f014d-17b4-494e-af79-1196769cf772 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:41.652798 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f014d-17b4-494e-af79-1196769cf772 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:41.654539 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f014d-17b4-494e-af79-1196769cf772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:41.666561 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f014d-17b4-494e-af79-1196769cf772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:41.668067 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f014d-17b4-494e-af79-1196769cf772 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:41.686111 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1259/2513] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:41 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:41.882171 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b745d27-a7b8-4c5c-bf1c-dbf30af8bf02 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:41.882648 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b745d27-a7b8-4c5c-bf1c-dbf30af8bf02 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:41.883030 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b745d27-a7b8-4c5c-bf1c-dbf30af8bf02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:41.920487 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-0b745d27-a7b8-4c5c-bf1c-dbf30af8bf02 None None] MFA Rules not processed for user `c993a63eecd0427bb688f1fd6d435168`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:41.922357 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-0b745d27-a7b8-4c5c-bf1c-dbf30af8bf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:42.032655 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1255/2514] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:41 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:42.083197 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f014d-17b4-494e-af79-1196769cf772 service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:42.085706 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e36f014d-17b4-494e-af79-1196769cf772 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:42.172257 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f014d-17b4-494e-af79-1196769cf772 service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:42.176735 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86f145-4828-48fb-ae6b-75872a9e3d6f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ccebf28ac494f608c33437fc34139be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:42.177417 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86f145-4828-48fb-ae6b-75872a9e3d6f service glance] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:42.177712 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86f145-4828-48fb-ae6b-75872a9e3d6f service glance] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:42.178007 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86f145-4828-48fb-ae6b-75872a9e3d6f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:42.181471 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-2c86f145-4828-48fb-ae6b-75872a9e3d6f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:42.222189 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b745d27-a7b8-4c5c-bf1c-dbf30af8bf02 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:42.233983 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-0b745d27-a7b8-4c5c-bf1c-dbf30af8bf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:42.251403 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b745d27-a7b8-4c5c-bf1c-dbf30af8bf02 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:42.258250 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68caca-6abb-419a-9c94-33d84cbd503f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:42.259087 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68caca-6abb-419a-9c94-33d84cbd503f admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:42.259378 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68caca-6abb-419a-9c94-33d84cbd503f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:42.259655 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68caca-6abb-419a-9c94-33d84cbd503f admin admin] PATH_INFO: `/v3/projects/a78931ffbc604f36bf5e937f9240221d` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:42.261158 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68caca-6abb-419a-9c94-33d84cbd503f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a78931ffbc604f36bf5e937f9240221d)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:42.263964 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68caca-6abb-419a-9c94-33d84cbd503f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:42.290218 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86f145-4828-48fb-ae6b-75872a9e3d6f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:42.292259 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86f145-4828-48fb-ae6b-75872a9e3d6f service glance] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:42.329288 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1260/2515] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:42 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:42.343447 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-8d68caca-6abb-419a-9c94-33d84cbd503f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a78931ffbc604f36bf5e937f9240221d', 'request_id': 'req-8d68caca-6abb-419a-9c94-33d84cbd503f'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:42.355300 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-8d68caca-6abb-419a-9c94-33d84cbd503f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a78931ffbc604f36bf5e937f9240221d', 'request_id': 'req-8d68caca-6abb-419a-9c94-33d84cbd503f'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:42.361726 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-8d68caca-6abb-419a-9c94-33d84cbd503f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a78931ffbc604f36bf5e937f9240221d', 'request_id': 'req-8d68caca-6abb-419a-9c94-33d84cbd503f'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:42.375747 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-8d68caca-6abb-419a-9c94-33d84cbd503f admin admin] The token cache is being invalidate because project a78931ffbc604f36bf5e937f9240221d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:44:42.376028 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-8d68caca-6abb-419a-9c94-33d84cbd503f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:42.376645 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-8d68caca-6abb-419a-9c94-33d84cbd503f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:42.378151 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1256/2516] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:44:42 2021] DELETE /identity/v3/projects/a78931ffbc604f36bf5e937f9240221d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:42.382469 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86f145-4828-48fb-ae6b-75872a9e3d6f service glance] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:42.394470 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86f145-4828-48fb-ae6b-75872a9e3d6f service glance] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:42.458726 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79a5bd-1e47-4138-bad2-46f0f262accd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:42.459647 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79a5bd-1e47-4138-bad2-46f0f262accd admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:42.459995 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79a5bd-1e47-4138-bad2-46f0f262accd admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:42.460282 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79a5bd-1e47-4138-bad2-46f0f262accd admin admin] PATH_INFO: `/v3/users/499dbc1a6c1c430184483483468d2185` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:42.461533 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79a5bd-1e47-4138-bad2-46f0f262accd admin admin] RBAC: Authorizing `identity:delete_user(user_id=499dbc1a6c1c430184483483468d2185)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:42.463975 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79a5bd-1e47-4138-bad2-46f0f262accd admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:42.516226 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-9f79a5bd-1e47-4138-bad2-46f0f262accd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '499dbc1a6c1c430184483483468d2185'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:42.516927 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-9f79a5bd-1e47-4138-bad2-46f0f262accd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '499dbc1a6c1c430184483483468d2185'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:42.529538 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-9f79a5bd-1e47-4138-bad2-46f0f262accd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '499dbc1a6c1c430184483483468d2185'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:42.541312 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-9f79a5bd-1e47-4138-bad2-46f0f262accd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '499dbc1a6c1c430184483483468d2185'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:42.549256 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-9f79a5bd-1e47-4138-bad2-46f0f262accd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '499dbc1a6c1c430184483483468d2185'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:42.555607 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1261/2517] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:44:42 2021] DELETE /identity/v3/users/499dbc1a6c1c430184483483468d2185 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:42.658878 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68caca-6abb-419a-9c94-33d84cbd503f admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:42.660895 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-8d68caca-6abb-419a-9c94-33d84cbd503f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:42.731962 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68caca-6abb-419a-9c94-33d84cbd503f admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:42.797438 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9026b-d4c5-44a0-b1ad-a3dd28d97a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:42.798059 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9026b-d4c5-44a0-b1ad-a3dd28d97a6e service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:42.798391 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9026b-d4c5-44a0-b1ad-a3dd28d97a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:42.798700 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9026b-d4c5-44a0-b1ad-a3dd28d97a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:42.800687 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-afe9026b-d4c5-44a0-b1ad-a3dd28d97a6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:42.811058 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9026b-d4c5-44a0-b1ad-a3dd28d97a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:42.813004 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9026b-d4c5-44a0-b1ad-a3dd28d97a6e service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:42.826808 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1257/2518] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:42 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:43.133054 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79a5bd-1e47-4138-bad2-46f0f262accd admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:43.134705 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-9f79a5bd-1e47-4138-bad2-46f0f262accd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:43.215624 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79a5bd-1e47-4138-bad2-46f0f262accd admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:43.219928 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77c8e4-e866-4322-90f5-318797951832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:43.220875 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77c8e4-e866-4322-90f5-318797951832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:43.221018 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77c8e4-e866-4322-90f5-318797951832 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:43.221298 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77c8e4-e866-4322-90f5-318797951832 admin admin] PATH_INFO: `/v3/projects/a515cb98fb224ddabb3e749a9b6bc7eb` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:43.222425 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77c8e4-e866-4322-90f5-318797951832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a515cb98fb224ddabb3e749a9b6bc7eb)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:43.224329 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77c8e4-e866-4322-90f5-318797951832 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:43.276927 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ca77c8e4-e866-4322-90f5-318797951832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a515cb98fb224ddabb3e749a9b6bc7eb', 'request_id': 'req-ca77c8e4-e866-4322-90f5-318797951832'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:43.282251 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ca77c8e4-e866-4322-90f5-318797951832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a515cb98fb224ddabb3e749a9b6bc7eb', 'request_id': 'req-ca77c8e4-e866-4322-90f5-318797951832'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:43.289740 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ca77c8e4-e866-4322-90f5-318797951832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a515cb98fb224ddabb3e749a9b6bc7eb', 'request_id': 'req-ca77c8e4-e866-4322-90f5-318797951832'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:43.307315 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ca77c8e4-e866-4322-90f5-318797951832 admin admin] The token cache is being invalidate because project a515cb98fb224ddabb3e749a9b6bc7eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:44:43.307607 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ca77c8e4-e866-4322-90f5-318797951832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:43.308261 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ca77c8e4-e866-4322-90f5-318797951832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:43.313720 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1262/2519] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:44:43 2021] DELETE /identity/v3/projects/a515cb98fb224ddabb3e749a9b6bc7eb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:43.313911 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9026b-d4c5-44a0-b1ad-a3dd28d97a6e service neutron] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:43.314006 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-afe9026b-d4c5-44a0-b1ad-a3dd28d97a6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:43.315091 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107dabf-3d05-4fbc-b29b-243dee14d6e6 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:43.315460 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107dabf-3d05-4fbc-b29b-243dee14d6e6 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:43.315668 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107dabf-3d05-4fbc-b29b-243dee14d6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:43.345192 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-1107dabf-3d05-4fbc-b29b-243dee14d6e6 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:43.346398 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-1107dabf-3d05-4fbc-b29b-243dee14d6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:43.398875 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9026b-d4c5-44a0-b1ad-a3dd28d97a6e service neutron] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:43.433340 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1263/2520] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:44:43.433340 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107dabf-3d05-4fbc-b29b-243dee14d6e6 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:43.433340 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-1107dabf-3d05-4fbc-b29b-243dee14d6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:43.491735 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900ec89-e878-4835-8ad5-fc2d78db68a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9a2114d29c4edeb20f394140d390bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:43.492417 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900ec89-e878-4835-8ad5-fc2d78db68a1 service placement] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:43.492709 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900ec89-e878-4835-8ad5-fc2d78db68a1 service placement] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:43.493029 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900ec89-e878-4835-8ad5-fc2d78db68a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:43.495569 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-9900ec89-e878-4835-8ad5-fc2d78db68a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:43.506865 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900ec89-e878-4835-8ad5-fc2d78db68a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:43.508419 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900ec89-e878-4835-8ad5-fc2d78db68a1 service placement] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:43.510804 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107dabf-3d05-4fbc-b29b-243dee14d6e6 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:43.514626 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edfaf7-2c36-4b4b-bc0c-c6fd8838fa2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:43.515282 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edfaf7-2c36-4b4b-bc0c-c6fd8838fa2b service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:43.515568 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edfaf7-2c36-4b4b-bc0c-c6fd8838fa2b service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:43.515846 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edfaf7-2c36-4b4b-bc0c-c6fd8838fa2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:43.517587 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e7edfaf7-2c36-4b4b-bc0c-c6fd8838fa2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:43.519068 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1258/2521] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:43 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:43.520591 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c295f-f963-4d99-b485-f78a73796987 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:43.520925 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c295f-f963-4d99-b485-f78a73796987 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:43.521279 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c295f-f963-4d99-b485-f78a73796987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:43.544153 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-857c295f-f963-4d99-b485-f78a73796987 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:43.545454 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-857c295f-f963-4d99-b485-f78a73796987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:43.553036 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1259/2522] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:43.557877 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c295f-f963-4d99-b485-f78a73796987 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:43.566882 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c295f-f963-4d99-b485-f78a73796987 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:43.576181 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73e2c8-5136-4ae3-8279-19d92cb86722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:43.577260 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73e2c8-5136-4ae3-8279-19d92cb86722 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:43.577674 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73e2c8-5136-4ae3-8279-19d92cb86722 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:43.577962 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73e2c8-5136-4ae3-8279-19d92cb86722 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:43.578976 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73e2c8-5136-4ae3-8279-19d92cb86722 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:44:43.579278 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73e2c8-5136-4ae3-8279-19d92cb86722 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:43.580889 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73e2c8-5136-4ae3-8279-19d92cb86722 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:43.594624 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1260/2523] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:44:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:44:43.598633 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73e2c8-5136-4ae3-8279-19d92cb86722 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:43.605573 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edfaf7-2c36-4b4b-bc0c-c6fd8838fa2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:43.606902 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edfaf7-2c36-4b4b-bc0c-c6fd8838fa2b service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:43.608582 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73e2c8-5136-4ae3-8279-19d92cb86722 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:43.613661 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3efc55c-bed5-4764-b5da-f0896e11193b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:43.614970 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efc55c-bed5-4764-b5da-f0896e11193b admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:43.615592 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efc55c-bed5-4764-b5da-f0896e11193b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:43.616152 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efc55c-bed5-4764-b5da-f0896e11193b admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:43.616830 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3efc55c-bed5-4764-b5da-f0896e11193b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:43.619492 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3efc55c-bed5-4764-b5da-f0896e11193b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:43.620983 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1264/2524] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:43 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:43.653946 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edfaf7-2c36-4b4b-bc0c-c6fd8838fa2b service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:43.655477 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e7edfaf7-2c36-4b4b-bc0c-c6fd8838fa2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:43.666448 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1261/2525] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:44:43 2021] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:44:43.669958 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3efc55c-bed5-4764-b5da-f0896e11193b admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:43.675764 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edfaf7-2c36-4b4b-bc0c-c6fd8838fa2b service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:43.755770 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79495b0f-0cf0-4378-bbd5-94b38a8d09ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9a2114d29c4edeb20f394140d390bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:43.757647 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79495b0f-0cf0-4378-bbd5-94b38a8d09ce service placement] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:43.758027 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79495b0f-0cf0-4378-bbd5-94b38a8d09ce service placement] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:43.758323 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79495b0f-0cf0-4378-bbd5-94b38a8d09ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:43.760817 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-79495b0f-0cf0-4378-bbd5-94b38a8d09ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:43.768449 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3efc55c-bed5-4764-b5da-f0896e11193b admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:43.773867 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79495b0f-0cf0-4378-bbd5-94b38a8d09ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:43.775054 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d005eb-9479-4eec-8264-d24df8bea866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:43.775558 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79495b0f-0cf0-4378-bbd5-94b38a8d09ce service placement] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:43.775874 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d005eb-9479-4eec-8264-d24df8bea866 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:43.776294 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d005eb-9479-4eec-8264-d24df8bea866 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:43.776675 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d005eb-9479-4eec-8264-d24df8bea866 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:43.777469 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d005eb-9479-4eec-8264-d24df8bea866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:43.779544 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d005eb-9479-4eec-8264-d24df8bea866 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:43.787250 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1265/2526] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:43 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:44:43.804950 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1262/2527] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:44:43 2021] POST /identity/v3/users => generated 287 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:44:43.807709 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79495b0f-0cf0-4378-bbd5-94b38a8d09ce service placement] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:43.841836 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79495b0f-0cf0-4378-bbd5-94b38a8d09ce service placement] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:43.853963 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e5648-2bf6-414d-b1ed-8da8f15607a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:43.854637 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e5648-2bf6-414d-b1ed-8da8f15607a4 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:43.855792 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e5648-2bf6-414d-b1ed-8da8f15607a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:43.856342 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e5648-2bf6-414d-b1ed-8da8f15607a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:43.857253 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e5648-2bf6-414d-b1ed-8da8f15607a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:43.858984 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e5648-2bf6-414d-b1ed-8da8f15607a4 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:43.880828 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1266/2528] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:43 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:44:43.881991 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d005eb-9479-4eec-8264-d24df8bea866 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:43.897483 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d005eb-9479-4eec-8264-d24df8bea866 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:43.902676 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ad554-c518-4db8-80be-36f8aa48a718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:43.903462 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ad554-c518-4db8-80be-36f8aa48a718 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:43.903873 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ad554-c518-4db8-80be-36f8aa48a718 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:43.904287 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ad554-c518-4db8-80be-36f8aa48a718 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:43.905170 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ad554-c518-4db8-80be-36f8aa48a718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:43.906909 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ad554-c518-4db8-80be-36f8aa48a718 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:43.923916 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1263/2529] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:43 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:44:43.928008 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e5648-2bf6-414d-b1ed-8da8f15607a4 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:43.941302 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e5648-2bf6-414d-b1ed-8da8f15607a4 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:43.946980 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53378228-c89d-49ff-a77e-35c6382f3b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:43.947814 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53378228-c89d-49ff-a77e-35c6382f3b0b admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:43.948106 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53378228-c89d-49ff-a77e-35c6382f3b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:43.948392 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53378228-c89d-49ff-a77e-35c6382f3b0b admin admin] PATH_INFO: `/v3/projects/774a9b2694614edca87fb0d51b106d8e/users/e36df85964434cfaa5db94e044c9931b/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:43.972167 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53378228-c89d-49ff-a77e-35c6382f3b0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=774a9b2694614edca87fb0d51b106d8e, user_id=e36df85964434cfaa5db94e044c9931b, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:43.975533 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53378228-c89d-49ff-a77e-35c6382f3b0b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:43.988948 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1267/2530] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:44:43 2021] PUT /identity/v3/projects/774a9b2694614edca87fb0d51b106d8e/users/e36df85964434cfaa5db94e044c9931b/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:44:44.007051 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16922911-675e-435f-9198-6490588b689a None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:44.007844 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16922911-675e-435f-9198-6490588b689a None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:44.008168 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16922911-675e-435f-9198-6490588b689a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:44.045661 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-16922911-675e-435f-9198-6490588b689a None None] MFA Rules not processed for user `e36df85964434cfaa5db94e044c9931b`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:44.046814 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-16922911-675e-435f-9198-6490588b689a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:44.124560 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1264/2531] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:44 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:44.129157 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53378228-c89d-49ff-a77e-35c6382f3b0b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:44.207654 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53378228-c89d-49ff-a77e-35c6382f3b0b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:44.212280 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39952099-0085-419a-b1ee-33c75d923d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:44.212978 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39952099-0085-419a-b1ee-33c75d923d28 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:44.213281 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39952099-0085-419a-b1ee-33c75d923d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:44.213570 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39952099-0085-419a-b1ee-33c75d923d28 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:44.214224 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39952099-0085-419a-b1ee-33c75d923d28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:44.216261 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39952099-0085-419a-b1ee-33c75d923d28 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:44.242632 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1268/2532] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:44:44 2021] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:44:44.247205 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16922911-675e-435f-9198-6490588b689a None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:44.258064 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16922911-675e-435f-9198-6490588b689a None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:44.325883 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafd199-e417-45cb-b1a8-3633067234f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:44.326392 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafd199-e417-45cb-b1a8-3633067234f9 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:44.326683 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafd199-e417-45cb-b1a8-3633067234f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:44.326968 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafd199-e417-45cb-b1a8-3633067234f9 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:44.327648 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afafd199-e417-45cb-b1a8-3633067234f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:44.329572 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afafd199-e417-45cb-b1a8-3633067234f9 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:44.348651 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1265/2533] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:44:44 2021] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:44:44.352730 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39952099-0085-419a-b1ee-33c75d923d28 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:44.362710 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39952099-0085-419a-b1ee-33c75d923d28 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:44.367099 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9f807-2856-458c-a936-6fa7536d405d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:44.367696 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9f807-2856-458c-a936-6fa7536d405d admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:44.367989 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9f807-2856-458c-a936-6fa7536d405d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:44.368761 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9f807-2856-458c-a936-6fa7536d405d admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:44.369493 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9f807-2856-458c-a936-6fa7536d405d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:44.371272 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9f807-2856-458c-a936-6fa7536d405d admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:44.383122 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1269/2534] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:44 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:44:44.388243 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafd199-e417-45cb-b1a8-3633067234f9 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:44.397999 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafd199-e417-45cb-b1a8-3633067234f9 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:44.403068 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecfbf6-2869-4c7e-a1bd-0cd2533f902f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:44.403639 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecfbf6-2869-4c7e-a1bd-0cd2533f902f admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:44.403929 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecfbf6-2869-4c7e-a1bd-0cd2533f902f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:44.404208 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecfbf6-2869-4c7e-a1bd-0cd2533f902f admin admin] PATH_INFO: `/v3/projects/eb897a629a3a49699d4e28d684598b55/users/6716e485e195490ab80a823b9b18d96d/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:44.428148 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fecfbf6-2869-4c7e-a1bd-0cd2533f902f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb897a629a3a49699d4e28d684598b55, user_id=6716e485e195490ab80a823b9b18d96d, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:44.432327 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fecfbf6-2869-4c7e-a1bd-0cd2533f902f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:44.446820 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1266/2535] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:44:44 2021] PUT /identity/v3/projects/eb897a629a3a49699d4e28d684598b55/users/6716e485e195490ab80a823b9b18d96d/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:44:44.451131 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9f807-2856-458c-a936-6fa7536d405d admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:44.461796 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9f807-2856-458c-a936-6fa7536d405d admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:44.528546 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a23a2-240d-41f6-a9a8-828a4ad0b1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:44.529196 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a23a2-240d-41f6-a9a8-828a4ad0b1ba admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:44.529488 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a23a2-240d-41f6-a9a8-828a4ad0b1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:44.529772 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a23a2-240d-41f6-a9a8-828a4ad0b1ba admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:44.530722 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a23a2-240d-41f6-a9a8-828a4ad0b1ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:44.532320 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a23a2-240d-41f6-a9a8-828a4ad0b1ba admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:44.543589 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1270/2536] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:44 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:44:44.547975 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecfbf6-2869-4c7e-a1bd-0cd2533f902f admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:44.561370 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecfbf6-2869-4c7e-a1bd-0cd2533f902f admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:44.566640 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d53c59-acf7-4624-81c6-ad696a3de22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:44.567493 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d53c59-acf7-4624-81c6-ad696a3de22a admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:44.567903 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d53c59-acf7-4624-81c6-ad696a3de22a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:44.568049 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d53c59-acf7-4624-81c6-ad696a3de22a admin admin] PATH_INFO: `/v3/projects/eb897a629a3a49699d4e28d684598b55/users/6716e485e195490ab80a823b9b18d96d/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:44.569968 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d53c59-acf7-4624-81c6-ad696a3de22a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb897a629a3a49699d4e28d684598b55, user_id=6716e485e195490ab80a823b9b18d96d, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:44.572672 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d53c59-acf7-4624-81c6-ad696a3de22a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:44.583502 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1267/2537] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:44:44 2021] PUT /identity/v3/projects/eb897a629a3a49699d4e28d684598b55/users/6716e485e195490ab80a823b9b18d96d/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:44.593441 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000c8e8-a383-4e3e-b4db-76324d11e0da None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:44.593828 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000c8e8-a383-4e3e-b4db-76324d11e0da None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:44.594174 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000c8e8-a383-4e3e-b4db-76324d11e0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:44.631773 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-2000c8e8-a383-4e3e-b4db-76324d11e0da None None] MFA Rules not processed for user `6716e485e195490ab80a823b9b18d96d`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:44.633066 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-2000c8e8-a383-4e3e-b4db-76324d11e0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:44.708893 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1271/2538] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:44 2021] POST /identity/v3/auth/tokens => generated 3747 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:44.718894 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d53c59-acf7-4624-81c6-ad696a3de22a admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:44.720865 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-a3d53c59-acf7-4624-81c6-ad696a3de22a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:44.796321 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d53c59-acf7-4624-81c6-ad696a3de22a admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:44.800141 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aadebc-1499-40d4-a5cb-43b005ce2b2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:44.800724 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aadebc-1499-40d4-a5cb-43b005ce2b2e service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:44.801047 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aadebc-1499-40d4-a5cb-43b005ce2b2e service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:44.801330 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aadebc-1499-40d4-a5cb-43b005ce2b2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:44.817758 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aadebc-1499-40d4-a5cb-43b005ce2b2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:44.819392 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aadebc-1499-40d4-a5cb-43b005ce2b2e service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:44.836560 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1268/2539] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:44 2021] GET /identity/v3/auth/tokens => generated 3747 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:45.223420 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000c8e8-a383-4e3e-b4db-76324d11e0da None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:45.293679 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000c8e8-a383-4e3e-b4db-76324d11e0da None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:45.297957 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8250a1-1769-4110-a2da-1f6eed99d1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:45.298779 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8250a1-1769-4110-a2da-1f6eed99d1fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:45.299175 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8250a1-1769-4110-a2da-1f6eed99d1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:45.301856 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8250a1-1769-4110-a2da-1f6eed99d1fa admin admin] PATH_INFO: `/v3/users/e36df85964434cfaa5db94e044c9931b` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:45.303046 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8250a1-1769-4110-a2da-1f6eed99d1fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e36df85964434cfaa5db94e044c9931b)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:45.304995 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8250a1-1769-4110-a2da-1f6eed99d1fa admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:45.360525 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-bd8250a1-1769-4110-a2da-1f6eed99d1fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e36df85964434cfaa5db94e044c9931b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:45.361217 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-bd8250a1-1769-4110-a2da-1f6eed99d1fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e36df85964434cfaa5db94e044c9931b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:45.373874 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-bd8250a1-1769-4110-a2da-1f6eed99d1fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e36df85964434cfaa5db94e044c9931b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:45.381850 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-bd8250a1-1769-4110-a2da-1f6eed99d1fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e36df85964434cfaa5db94e044c9931b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:45.383382 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb6f04-3813-4e3b-8acc-5ead6ca5fd41 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:45.383754 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb6f04-3813-4e3b-8acc-5ead6ca5fd41 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:45.384674 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb6f04-3813-4e3b-8acc-5ead6ca5fd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:45.392468 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-bd8250a1-1769-4110-a2da-1f6eed99d1fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e36df85964434cfaa5db94e044c9931b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:45.399162 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1272/2540] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:44:45 2021] DELETE /identity/v3/users/e36df85964434cfaa5db94e044c9931b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:45.404418 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86d38b-7f4b-400a-a476-cd2334acd197 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:45.404975 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86d38b-7f4b-400a-a476-cd2334acd197 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:45.405306 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86d38b-7f4b-400a-a476-cd2334acd197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:45.408662 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-05fb6f04-3813-4e3b-8acc-5ead6ca5fd41 None None] MFA Rules not processed for user `fa7dedfceea346ca997eedec181935c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:45.409920 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-05fb6f04-3813-4e3b-8acc-5ead6ca5fd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:45.431344 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-5d86d38b-7f4b-400a-a476-cd2334acd197 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:45.432339 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-5d86d38b-7f4b-400a-a476-cd2334acd197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:45.493651 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1269/2541] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Dec 16 14:44:45 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:44:45.506510 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1273/2542] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:44:45.510299 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb6f04-3813-4e3b-8acc-5ead6ca5fd41 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:45.511684 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-05fb6f04-3813-4e3b-8acc-5ead6ca5fd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:45.517786 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86d38b-7f4b-400a-a476-cd2334acd197 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:45.519111 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-5d86d38b-7f4b-400a-a476-cd2334acd197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:45.611884 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86d38b-7f4b-400a-a476-cd2334acd197 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:45.615607 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb6f04-3813-4e3b-8acc-5ead6ca5fd41 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:45.622051 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cd88d-8859-4042-87f2-517252631c9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de4c90e44b96488aa47fbbc302e4f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:45.622805 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cd88d-8859-4042-87f2-517252631c9a service swift] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:45.623168 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cd88d-8859-4042-87f2-517252631c9a service swift] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:45.623513 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cd88d-8859-4042-87f2-517252631c9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:45.628880 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95711d22-0402-474d-a511-3fe6607313ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:45.629660 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95711d22-0402-474d-a511-3fe6607313ac service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:45.630053 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95711d22-0402-474d-a511-3fe6607313ac service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:45.631061 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95711d22-0402-474d-a511-3fe6607313ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:45.636028 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cd88d-8859-4042-87f2-517252631c9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:45.637963 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cd88d-8859-4042-87f2-517252631c9a service swift] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:45.647572 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95711d22-0402-474d-a511-3fe6607313ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:45.647572 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95711d22-0402-474d-a511-3fe6607313ac service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:45.655329 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1270/2543] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Dec 16 14:44:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:44:45.667020 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1274/2544] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:45 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:46.543514 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cd88d-8859-4042-87f2-517252631c9a service swift] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:46.545461 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-9c6cd88d-8859-4042-87f2-517252631c9a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:46.558692 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cd88d-8859-4042-87f2-517252631c9a service swift] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:46.563224 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cdf08-fadd-4f43-b815-2de5bdc5138f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:46.564028 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cdf08-fadd-4f43-b815-2de5bdc5138f admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:46.564327 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cdf08-fadd-4f43-b815-2de5bdc5138f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:46.564618 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cdf08-fadd-4f43-b815-2de5bdc5138f admin admin] PATH_INFO: `/v3/projects/774a9b2694614edca87fb0d51b106d8e` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:46.565791 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6cdf08-fadd-4f43-b815-2de5bdc5138f admin admin] RBAC: Authorizing `identity:delete_project(project_id=774a9b2694614edca87fb0d51b106d8e)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:46.567679 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6cdf08-fadd-4f43-b815-2de5bdc5138f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:46.624969 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-9b6cdf08-fadd-4f43-b815-2de5bdc5138f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '774a9b2694614edca87fb0d51b106d8e', 'request_id': 'req-9b6cdf08-fadd-4f43-b815-2de5bdc5138f'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:46.655972 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-9b6cdf08-fadd-4f43-b815-2de5bdc5138f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '774a9b2694614edca87fb0d51b106d8e', 'request_id': 'req-9b6cdf08-fadd-4f43-b815-2de5bdc5138f'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:46.662034 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-9b6cdf08-fadd-4f43-b815-2de5bdc5138f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '774a9b2694614edca87fb0d51b106d8e', 'request_id': 'req-9b6cdf08-fadd-4f43-b815-2de5bdc5138f'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:46.676719 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-9b6cdf08-fadd-4f43-b815-2de5bdc5138f admin admin] The token cache is being invalidate because project 774a9b2694614edca87fb0d51b106d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:44:46.677038 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-9b6cdf08-fadd-4f43-b815-2de5bdc5138f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:46.677930 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-9b6cdf08-fadd-4f43-b815-2de5bdc5138f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:46.680040 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1271/2545] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:44:46 2021] DELETE /identity/v3/projects/774a9b2694614edca87fb0d51b106d8e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:46.684026 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95711d22-0402-474d-a511-3fe6607313ac service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:46.694211 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95711d22-0402-474d-a511-3fe6607313ac service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:46.768678 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102e689-1d75-4a5d-a997-79e669db376f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:46.769628 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102e689-1d75-4a5d-a997-79e669db376f admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:46.769924 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102e689-1d75-4a5d-a997-79e669db376f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:46.770211 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102e689-1d75-4a5d-a997-79e669db376f admin admin] PATH_INFO: `/v3/users/6716e485e195490ab80a823b9b18d96d` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:46.771687 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102e689-1d75-4a5d-a997-79e669db376f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6716e485e195490ab80a823b9b18d96d)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:46.773873 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102e689-1d75-4a5d-a997-79e669db376f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:46.840336 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-0102e689-1d75-4a5d-a997-79e669db376f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6716e485e195490ab80a823b9b18d96d'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:46.841095 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-0102e689-1d75-4a5d-a997-79e669db376f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6716e485e195490ab80a823b9b18d96d'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:46.865569 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-0102e689-1d75-4a5d-a997-79e669db376f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6716e485e195490ab80a823b9b18d96d'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:46.875751 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-0102e689-1d75-4a5d-a997-79e669db376f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6716e485e195490ab80a823b9b18d96d'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:46.888072 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-0102e689-1d75-4a5d-a997-79e669db376f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6716e485e195490ab80a823b9b18d96d'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:46.904865 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1275/2546] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:44:46 2021] DELETE /identity/v3/users/6716e485e195490ab80a823b9b18d96d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:47.372257 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cdf08-fadd-4f43-b815-2de5bdc5138f admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:47.373515 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-9b6cdf08-fadd-4f43-b815-2de5bdc5138f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:47.386314 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cdf08-fadd-4f43-b815-2de5bdc5138f admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:47.458833 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33aec2-d007-4474-80a7-39a17f17132d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:47.459604 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33aec2-d007-4474-80a7-39a17f17132d admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:47.459891 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33aec2-d007-4474-80a7-39a17f17132d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:47.460456 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33aec2-d007-4474-80a7-39a17f17132d admin admin] PATH_INFO: `/v3/projects/eb897a629a3a49699d4e28d684598b55` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:47.461889 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33aec2-d007-4474-80a7-39a17f17132d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb897a629a3a49699d4e28d684598b55)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:47.464538 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33aec2-d007-4474-80a7-39a17f17132d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:47.537205 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-eb33aec2-d007-4474-80a7-39a17f17132d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb897a629a3a49699d4e28d684598b55', 'request_id': 'req-eb33aec2-d007-4474-80a7-39a17f17132d'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:47.549749 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-eb33aec2-d007-4474-80a7-39a17f17132d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb897a629a3a49699d4e28d684598b55', 'request_id': 'req-eb33aec2-d007-4474-80a7-39a17f17132d'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:47.555531 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-eb33aec2-d007-4474-80a7-39a17f17132d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb897a629a3a49699d4e28d684598b55', 'request_id': 'req-eb33aec2-d007-4474-80a7-39a17f17132d'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:47.571413 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-eb33aec2-d007-4474-80a7-39a17f17132d admin admin] The token cache is being invalidate because project eb897a629a3a49699d4e28d684598b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:44:47.571869 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-eb33aec2-d007-4474-80a7-39a17f17132d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:47.572598 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-eb33aec2-d007-4474-80a7-39a17f17132d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:47.574243 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1272/2547] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:44:47 2021] DELETE /identity/v3/projects/eb897a629a3a49699d4e28d684598b55 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:47.580021 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5c586-691b-4ccd-a34f-7e46d98b7b9a None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:47.580455 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5c586-691b-4ccd-a34f-7e46d98b7b9a None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:47.580956 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5c586-691b-4ccd-a34f-7e46d98b7b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:47.606356 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-cec5c586-691b-4ccd-a34f-7e46d98b7b9a None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:47.607522 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-cec5c586-691b-4ccd-a34f-7e46d98b7b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:47.699027 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1276/2548] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:47.706920 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d92ee7-2949-498d-b4d5-778a089809aa None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:47.707526 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d92ee7-2949-498d-b4d5-778a089809aa None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:47.708727 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d92ee7-2949-498d-b4d5-778a089809aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:47.737362 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-b2d92ee7-2949-498d-b4d5-778a089809aa None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:47.737362 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-b2d92ee7-2949-498d-b4d5-778a089809aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:47.744578 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1273/2549] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:47.749522 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5c586-691b-4ccd-a34f-7e46d98b7b9a None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:47.762633 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5c586-691b-4ccd-a34f-7e46d98b7b9a None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:47.767269 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270242a9-240f-4046-8501-ac7d480a0d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:47.767875 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270242a9-240f-4046-8501-ac7d480a0d76 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:47.768162 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270242a9-240f-4046-8501-ac7d480a0d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:47.768442 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270242a9-240f-4046-8501-ac7d480a0d76 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:47.769171 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270242a9-240f-4046-8501-ac7d480a0d76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:44:47.769665 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270242a9-240f-4046-8501-ac7d480a0d76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:47.771426 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270242a9-240f-4046-8501-ac7d480a0d76 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:47.797282 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1277/2550] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:44:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:44:47.798594 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d92ee7-2949-498d-b4d5-778a089809aa None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:47.808045 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d92ee7-2949-498d-b4d5-778a089809aa None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:47.813688 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b102d2-3f7b-4816-8a2c-6cd19af720e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:47.814471 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b102d2-3f7b-4816-8a2c-6cd19af720e3 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:47.815018 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b102d2-3f7b-4816-8a2c-6cd19af720e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:47.815314 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b102d2-3f7b-4816-8a2c-6cd19af720e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:47.815958 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b102d2-3f7b-4816-8a2c-6cd19af720e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:47.818347 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b102d2-3f7b-4816-8a2c-6cd19af720e3 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:47.871458 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1274/2551] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:44:47 2021] POST /identity/v3/projects => generated 387 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:44:47.875409 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270242a9-240f-4046-8501-ac7d480a0d76 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:47.904912 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270242a9-240f-4046-8501-ac7d480a0d76 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:47.976532 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e0657-c77e-4b62-a980-4ea8212f4482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:47.977193 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e0657-c77e-4b62-a980-4ea8212f4482 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:47.977567 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e0657-c77e-4b62-a980-4ea8212f4482 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:47.978370 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e0657-c77e-4b62-a980-4ea8212f4482 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:47.979021 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e0657-c77e-4b62-a980-4ea8212f4482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:47.980981 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e0657-c77e-4b62-a980-4ea8212f4482 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:48.007539 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1278/2552] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:44:47 2021] POST /identity/v3/users => generated 294 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:44:48.009008 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b102d2-3f7b-4816-8a2c-6cd19af720e3 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:48.019708 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b102d2-3f7b-4816-8a2c-6cd19af720e3 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:48.025959 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7781d89-415a-4f6a-be02-12dca12338db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:48.025959 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7781d89-415a-4f6a-be02-12dca12338db admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:48.026403 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7781d89-415a-4f6a-be02-12dca12338db admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:48.026403 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7781d89-415a-4f6a-be02-12dca12338db admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:48.027047 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7781d89-415a-4f6a-be02-12dca12338db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:48.028612 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7781d89-415a-4f6a-be02-12dca12338db admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:48.041456 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1275/2553] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:48 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:44:48.045358 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e0657-c77e-4b62-a980-4ea8212f4482 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:48.056145 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e0657-c77e-4b62-a980-4ea8212f4482 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:48.060888 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6cdef-a824-4d16-90a5-cd5c9c1ad1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:48.061577 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6cdef-a824-4d16-90a5-cd5c9c1ad1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:48.061946 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6cdef-a824-4d16-90a5-cd5c9c1ad1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:48.062291 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6cdef-a824-4d16-90a5-cd5c9c1ad1b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:48.063011 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b6cdef-a824-4d16-90a5-cd5c9c1ad1b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:48.064611 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b6cdef-a824-4d16-90a5-cd5c9c1ad1b7 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:48.075598 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1279/2554] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:48 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:44:48.079921 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7781d89-415a-4f6a-be02-12dca12338db admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:48.090397 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7781d89-415a-4f6a-be02-12dca12338db admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:48.095296 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f268c5-87dc-4d1a-85cf-981043aa3130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:48.096172 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f268c5-87dc-4d1a-85cf-981043aa3130 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:48.096477 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f268c5-87dc-4d1a-85cf-981043aa3130 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:48.096804 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f268c5-87dc-4d1a-85cf-981043aa3130 admin admin] PATH_INFO: `/v3/projects/a4d3eef1335d4c9eb1c9f8e2700d18bf/users/06f37616825f46ab81bb85e4bd971c48/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:48.118971 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f268c5-87dc-4d1a-85cf-981043aa3130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4d3eef1335d4c9eb1c9f8e2700d18bf, user_id=06f37616825f46ab81bb85e4bd971c48, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:48.121652 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f268c5-87dc-4d1a-85cf-981043aa3130 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:48.138813 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1276/2555] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:44:48 2021] PUT /identity/v3/projects/a4d3eef1335d4c9eb1c9f8e2700d18bf/users/06f37616825f46ab81bb85e4bd971c48/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:44:48.150655 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40c6b1-8f8c-478c-8638-30179155485d None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:48.150936 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40c6b1-8f8c-478c-8638-30179155485d None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:48.151253 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40c6b1-8f8c-478c-8638-30179155485d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:48.195640 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-8b40c6b1-8f8c-478c-8638-30179155485d None None] MFA Rules not processed for user `06f37616825f46ab81bb85e4bd971c48`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:48.197496 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-8b40c6b1-8f8c-478c-8638-30179155485d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:48.283692 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1280/2556] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:48 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:48.284339 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f268c5-87dc-4d1a-85cf-981043aa3130 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:48.366647 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f268c5-87dc-4d1a-85cf-981043aa3130 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:48.371635 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc41699-4976-4eac-99e3-117e87cd4175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:48.372043 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc41699-4976-4eac-99e3-117e87cd4175 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:48.372333 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc41699-4976-4eac-99e3-117e87cd4175 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:48.372620 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc41699-4976-4eac-99e3-117e87cd4175 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:48.373376 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc41699-4976-4eac-99e3-117e87cd4175 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:48.375343 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc41699-4976-4eac-99e3-117e87cd4175 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:48.407453 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1277/2557] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:44:48 2021] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:44:48.412231 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40c6b1-8f8c-478c-8638-30179155485d None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:48.430276 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40c6b1-8f8c-478c-8638-30179155485d None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:48.510711 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48830a-be02-410c-8d48-eee9fd9037b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:48.511335 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48830a-be02-410c-8d48-eee9fd9037b1 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:48.511631 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48830a-be02-410c-8d48-eee9fd9037b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:48.511989 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48830a-be02-410c-8d48-eee9fd9037b1 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:48.512733 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48830a-be02-410c-8d48-eee9fd9037b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:48.514671 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48830a-be02-410c-8d48-eee9fd9037b1 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:48.538977 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1281/2558] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:44:48 2021] POST /identity/v3/users => generated 299 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:44:48.543367 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc41699-4976-4eac-99e3-117e87cd4175 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:48.553795 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc41699-4976-4eac-99e3-117e87cd4175 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:48.558884 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939178d-12cc-44ed-9d81-74888fb60755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:48.559482 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939178d-12cc-44ed-9d81-74888fb60755 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:48.559774 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939178d-12cc-44ed-9d81-74888fb60755 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:48.560059 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939178d-12cc-44ed-9d81-74888fb60755 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:48.560752 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939178d-12cc-44ed-9d81-74888fb60755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:48.562368 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939178d-12cc-44ed-9d81-74888fb60755 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:48.580289 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1278/2559] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:48 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:44:48.585595 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48830a-be02-410c-8d48-eee9fd9037b1 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:48.595349 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48830a-be02-410c-8d48-eee9fd9037b1 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:48.600066 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab982c-435e-4166-9c7d-f5c61e39f7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:48.600967 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab982c-435e-4166-9c7d-f5c61e39f7bd admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:48.601258 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab982c-435e-4166-9c7d-f5c61e39f7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:48.601541 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab982c-435e-4166-9c7d-f5c61e39f7bd admin admin] PATH_INFO: `/v3/projects/9df1a58c25b54bf48fc9e7f163a6abea/users/87e62de2290748b893dd3cba141223b4/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:48.622706 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab982c-435e-4166-9c7d-f5c61e39f7bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9df1a58c25b54bf48fc9e7f163a6abea, user_id=87e62de2290748b893dd3cba141223b4, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:48.625410 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab982c-435e-4166-9c7d-f5c61e39f7bd admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:48.641804 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1282/2560] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:44:48 2021] PUT /identity/v3/projects/9df1a58c25b54bf48fc9e7f163a6abea/users/87e62de2290748b893dd3cba141223b4/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:48.645928 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939178d-12cc-44ed-9d81-74888fb60755 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:48.655932 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939178d-12cc-44ed-9d81-74888fb60755 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:48.722706 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e1fb4-7f44-4433-b30f-fbc2b2fdc00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:48.723439 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e1fb4-7f44-4433-b30f-fbc2b2fdc00d admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:48.723734 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e1fb4-7f44-4433-b30f-fbc2b2fdc00d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:48.724017 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e1fb4-7f44-4433-b30f-fbc2b2fdc00d admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:48.724719 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e1fb4-7f44-4433-b30f-fbc2b2fdc00d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:48.726378 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e1fb4-7f44-4433-b30f-fbc2b2fdc00d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:48.737405 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1279/2561] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:48 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:44:48.741527 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab982c-435e-4166-9c7d-f5c61e39f7bd admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:48.752339 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab982c-435e-4166-9c7d-f5c61e39f7bd admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:48.757142 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20315ca-9f8e-4061-b7e9-34a56735e42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:48.758042 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20315ca-9f8e-4061-b7e9-34a56735e42e admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:48.758231 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20315ca-9f8e-4061-b7e9-34a56735e42e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:48.758518 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20315ca-9f8e-4061-b7e9-34a56735e42e admin admin] PATH_INFO: `/v3/projects/9df1a58c25b54bf48fc9e7f163a6abea/users/87e62de2290748b893dd3cba141223b4/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:48.761432 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20315ca-9f8e-4061-b7e9-34a56735e42e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9df1a58c25b54bf48fc9e7f163a6abea, user_id=87e62de2290748b893dd3cba141223b4, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:48.764725 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20315ca-9f8e-4061-b7e9-34a56735e42e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:48.776370 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1283/2562] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:44:48 2021] PUT /identity/v3/projects/9df1a58c25b54bf48fc9e7f163a6abea/users/87e62de2290748b893dd3cba141223b4/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:48.787120 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e2dde-29cf-499b-bb84-a94d05f1634b None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:48.787777 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e2dde-29cf-499b-bb84-a94d05f1634b None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:48.788270 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e2dde-29cf-499b-bb84-a94d05f1634b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:48.839804 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-e98e2dde-29cf-499b-bb84-a94d05f1634b None None] MFA Rules not processed for user `87e62de2290748b893dd3cba141223b4`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:48.847152 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e98e2dde-29cf-499b-bb84-a94d05f1634b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:48.958919 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1280/2563] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:48 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:48.965221 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20315ca-9f8e-4061-b7e9-34a56735e42e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:48.973559 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-a20315ca-9f8e-4061-b7e9-34a56735e42e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:49.059396 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20315ca-9f8e-4061-b7e9-34a56735e42e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:49.062931 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2e105-534d-4a93-8974-cc2e9acdc4d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:49.063523 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2e105-534d-4a93-8974-cc2e9acdc4d8 service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:49.063815 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2e105-534d-4a93-8974-cc2e9acdc4d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:49.064104 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2e105-534d-4a93-8974-cc2e9acdc4d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:49.073872 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2e105-534d-4a93-8974-cc2e9acdc4d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:49.075330 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2e105-534d-4a93-8974-cc2e9acdc4d8 service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:49.090448 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1284/2564] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:48 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:49.118015 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e2dde-29cf-499b-bb84-a94d05f1634b None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:49.204450 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e2dde-29cf-499b-bb84-a94d05f1634b None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:49.208888 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499de262-5880-43c2-bc29-e0745c78201f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:49.209718 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499de262-5880-43c2-bc29-e0745c78201f admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:49.210011 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499de262-5880-43c2-bc29-e0745c78201f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:49.210290 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499de262-5880-43c2-bc29-e0745c78201f admin admin] PATH_INFO: `/v3/users/06f37616825f46ab81bb85e4bd971c48` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:49.211406 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499de262-5880-43c2-bc29-e0745c78201f admin admin] RBAC: Authorizing `identity:delete_user(user_id=06f37616825f46ab81bb85e4bd971c48)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:49.215605 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499de262-5880-43c2-bc29-e0745c78201f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:49.277598 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-499de262-5880-43c2-bc29-e0745c78201f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06f37616825f46ab81bb85e4bd971c48'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:49.278395 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-499de262-5880-43c2-bc29-e0745c78201f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06f37616825f46ab81bb85e4bd971c48'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:49.293430 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-499de262-5880-43c2-bc29-e0745c78201f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06f37616825f46ab81bb85e4bd971c48'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:49.301801 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-499de262-5880-43c2-bc29-e0745c78201f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06f37616825f46ab81bb85e4bd971c48'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:49.309887 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-499de262-5880-43c2-bc29-e0745c78201f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06f37616825f46ab81bb85e4bd971c48'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:49.315717 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1281/2565] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:44:49 2021] DELETE /identity/v3/users/06f37616825f46ab81bb85e4bd971c48 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:49.320160 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd3399-2725-4d98-bc1d-ba42bba77333 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:49.320456 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd3399-2725-4d98-bc1d-ba42bba77333 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:49.320739 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd3399-2725-4d98-bc1d-ba42bba77333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:49.342838 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-a4fd3399-2725-4d98-bc1d-ba42bba77333 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:49.343923 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-a4fd3399-2725-4d98-bc1d-ba42bba77333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:49.416209 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1285/2566] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:49.426550 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499de262-5880-43c2-bc29-e0745c78201f admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:49.427994 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-499de262-5880-43c2-bc29-e0745c78201f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:49.495134 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499de262-5880-43c2-bc29-e0745c78201f admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:49.498686 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22603a98-c3a7-42a8-b47f-3c55868934c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:49.499268 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22603a98-c3a7-42a8-b47f-3c55868934c0 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:49.499561 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22603a98-c3a7-42a8-b47f-3c55868934c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:49.499838 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22603a98-c3a7-42a8-b47f-3c55868934c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:49.510253 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22603a98-c3a7-42a8-b47f-3c55868934c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:49.511777 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22603a98-c3a7-42a8-b47f-3c55868934c0 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:49.523061 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1282/2567] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:49 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:49.953777 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd3399-2725-4d98-bc1d-ba42bba77333 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:49.962354 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-a4fd3399-2725-4d98-bc1d-ba42bba77333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:49.976007 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd3399-2725-4d98-bc1d-ba42bba77333 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:49.980727 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f877ef9-2beb-41b6-9b6a-2ccc7f4ba6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:49.981795 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f877ef9-2beb-41b6-9b6a-2ccc7f4ba6d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:49.981918 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f877ef9-2beb-41b6-9b6a-2ccc7f4ba6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:49.982152 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f877ef9-2beb-41b6-9b6a-2ccc7f4ba6d0 admin admin] PATH_INFO: `/v3/projects/a4d3eef1335d4c9eb1c9f8e2700d18bf` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:49.983272 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f877ef9-2beb-41b6-9b6a-2ccc7f4ba6d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4d3eef1335d4c9eb1c9f8e2700d18bf)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:49.985209 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f877ef9-2beb-41b6-9b6a-2ccc7f4ba6d0 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:50.047652 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-3f877ef9-2beb-41b6-9b6a-2ccc7f4ba6d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4d3eef1335d4c9eb1c9f8e2700d18bf', 'request_id': 'req-3f877ef9-2beb-41b6-9b6a-2ccc7f4ba6d0'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:50.052639 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-3f877ef9-2beb-41b6-9b6a-2ccc7f4ba6d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4d3eef1335d4c9eb1c9f8e2700d18bf', 'request_id': 'req-3f877ef9-2beb-41b6-9b6a-2ccc7f4ba6d0'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:50.061542 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-3f877ef9-2beb-41b6-9b6a-2ccc7f4ba6d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4d3eef1335d4c9eb1c9f8e2700d18bf', 'request_id': 'req-3f877ef9-2beb-41b6-9b6a-2ccc7f4ba6d0'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:50.097465 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-3f877ef9-2beb-41b6-9b6a-2ccc7f4ba6d0 admin admin] The token cache is being invalidate because project a4d3eef1335d4c9eb1c9f8e2700d18bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:44:50.098428 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-3f877ef9-2beb-41b6-9b6a-2ccc7f4ba6d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:50.099728 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-3f877ef9-2beb-41b6-9b6a-2ccc7f4ba6d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:50.103577 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1286/2568] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:44:49 2021] DELETE /identity/v3/projects/a4d3eef1335d4c9eb1c9f8e2700d18bf => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:50.107583 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22603a98-c3a7-42a8-b47f-3c55868934c0 service neutron] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:50.121388 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22603a98-c3a7-42a8-b47f-3c55868934c0 service neutron] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:50.215056 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e0aae-a2ad-4404-8f15-7ce6b78d4d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:50.215731 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e0aae-a2ad-4404-8f15-7ce6b78d4d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:50.216027 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e0aae-a2ad-4404-8f15-7ce6b78d4d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:50.216640 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e0aae-a2ad-4404-8f15-7ce6b78d4d61 admin admin] PATH_INFO: `/v3/users/87e62de2290748b893dd3cba141223b4` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:50.221919 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e0aae-a2ad-4404-8f15-7ce6b78d4d61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e62de2290748b893dd3cba141223b4)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:50.223881 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e0aae-a2ad-4404-8f15-7ce6b78d4d61 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:50.304719 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-4a9e0aae-a2ad-4404-8f15-7ce6b78d4d61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e62de2290748b893dd3cba141223b4'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:50.306114 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-4a9e0aae-a2ad-4404-8f15-7ce6b78d4d61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e62de2290748b893dd3cba141223b4'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:50.318539 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-4a9e0aae-a2ad-4404-8f15-7ce6b78d4d61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e62de2290748b893dd3cba141223b4'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:50.327767 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-4a9e0aae-a2ad-4404-8f15-7ce6b78d4d61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e62de2290748b893dd3cba141223b4'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:50.335906 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-4a9e0aae-a2ad-4404-8f15-7ce6b78d4d61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e62de2290748b893dd3cba141223b4'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:50.341861 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1283/2569] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:44:50 2021] DELETE /identity/v3/users/87e62de2290748b893dd3cba141223b4 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:50.721449 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f877ef9-2beb-41b6-9b6a-2ccc7f4ba6d0 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:50.722950 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-3f877ef9-2beb-41b6-9b6a-2ccc7f4ba6d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:50.740750 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f877ef9-2beb-41b6-9b6a-2ccc7f4ba6d0 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:50.811451 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd76b8-328e-4ba4-a93c-c66bd1621a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:50.812255 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd76b8-328e-4ba4-a93c-c66bd1621a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:50.812548 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd76b8-328e-4ba4-a93c-c66bd1621a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:50.812865 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd76b8-328e-4ba4-a93c-c66bd1621a85 admin admin] PATH_INFO: `/v3/projects/9df1a58c25b54bf48fc9e7f163a6abea` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:50.814011 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd76b8-328e-4ba4-a93c-c66bd1621a85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9df1a58c25b54bf48fc9e7f163a6abea)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:50.815935 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd76b8-328e-4ba4-a93c-c66bd1621a85 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:50.869301 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-b7bd76b8-328e-4ba4-a93c-c66bd1621a85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9df1a58c25b54bf48fc9e7f163a6abea', 'request_id': 'req-b7bd76b8-328e-4ba4-a93c-c66bd1621a85'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:50.874517 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-b7bd76b8-328e-4ba4-a93c-c66bd1621a85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9df1a58c25b54bf48fc9e7f163a6abea', 'request_id': 'req-b7bd76b8-328e-4ba4-a93c-c66bd1621a85'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:50.900413 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-b7bd76b8-328e-4ba4-a93c-c66bd1621a85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9df1a58c25b54bf48fc9e7f163a6abea', 'request_id': 'req-b7bd76b8-328e-4ba4-a93c-c66bd1621a85'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:50.918292 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-b7bd76b8-328e-4ba4-a93c-c66bd1621a85 admin admin] The token cache is being invalidate because project 9df1a58c25b54bf48fc9e7f163a6abea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:44:50.918583 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-b7bd76b8-328e-4ba4-a93c-c66bd1621a85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:50.919234 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-b7bd76b8-328e-4ba4-a93c-c66bd1621a85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:50.920742 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1287/2570] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:44:50 2021] DELETE /identity/v3/projects/9df1a58c25b54bf48fc9e7f163a6abea => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:50.926514 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6a241-5e58-4c95-bf9a-650e4ee245cd None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:50.926846 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6a241-5e58-4c95-bf9a-650e4ee245cd None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:50.927605 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6a241-5e58-4c95-bf9a-650e4ee245cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:50.949467 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-aba6a241-5e58-4c95-bf9a-650e4ee245cd None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:50.950630 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-aba6a241-5e58-4c95-bf9a-650e4ee245cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:51.024043 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1284/2571] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:51.032529 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322a7b4-a4e9-4669-a346-65e7851c32d0 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:51.033215 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322a7b4-a4e9-4669-a346-65e7851c32d0 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:51.033407 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322a7b4-a4e9-4669-a346-65e7851c32d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:51.074311 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-3322a7b4-a4e9-4669-a346-65e7851c32d0 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:51.075609 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-3322a7b4-a4e9-4669-a346-65e7851c32d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:51.083298 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1288/2572] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:44:51.088341 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6a241-5e58-4c95-bf9a-650e4ee245cd None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:51.098356 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6a241-5e58-4c95-bf9a-650e4ee245cd None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:51.103653 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35adcd-6ad6-48a8-a74c-0eb654d49a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:51.104263 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35adcd-6ad6-48a8-a74c-0eb654d49a5c admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:51.104558 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35adcd-6ad6-48a8-a74c-0eb654d49a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:51.104880 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35adcd-6ad6-48a8-a74c-0eb654d49a5c admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:51.105591 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35adcd-6ad6-48a8-a74c-0eb654d49a5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:44:51.105894 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35adcd-6ad6-48a8-a74c-0eb654d49a5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:51.107497 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35adcd-6ad6-48a8-a74c-0eb654d49a5c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:51.120877 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1285/2573] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:44:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:44:51.125242 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322a7b4-a4e9-4669-a346-65e7851c32d0 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:51.135628 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322a7b4-a4e9-4669-a346-65e7851c32d0 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:51.140631 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70645ccb-34ed-40a7-bc37-5fa76978e502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:51.141277 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70645ccb-34ed-40a7-bc37-5fa76978e502 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:51.141571 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70645ccb-34ed-40a7-bc37-5fa76978e502 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:51.141888 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70645ccb-34ed-40a7-bc37-5fa76978e502 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:51.142541 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70645ccb-34ed-40a7-bc37-5fa76978e502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:51.144488 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70645ccb-34ed-40a7-bc37-5fa76978e502 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:51.183248 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1289/2574] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:44:51 2021] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:44:51.187291 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35adcd-6ad6-48a8-a74c-0eb654d49a5c admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:51.198015 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35adcd-6ad6-48a8-a74c-0eb654d49a5c admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:51.268959 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bce1d1-8a09-4b31-972e-7979979191e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:51.269937 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bce1d1-8a09-4b31-972e-7979979191e7 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:51.270332 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bce1d1-8a09-4b31-972e-7979979191e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:51.270714 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bce1d1-8a09-4b31-972e-7979979191e7 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:51.272044 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bce1d1-8a09-4b31-972e-7979979191e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:51.275550 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bce1d1-8a09-4b31-972e-7979979191e7 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:51.299234 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1286/2575] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:44:51 2021] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:44:51.304606 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70645ccb-34ed-40a7-bc37-5fa76978e502 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:51.325248 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70645ccb-34ed-40a7-bc37-5fa76978e502 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:51.330410 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649ebc7-7e21-4c03-b6fb-f0a11ab6df81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:51.331104 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649ebc7-7e21-4c03-b6fb-f0a11ab6df81 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:51.331465 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649ebc7-7e21-4c03-b6fb-f0a11ab6df81 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:51.331814 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649ebc7-7e21-4c03-b6fb-f0a11ab6df81 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:51.332597 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1649ebc7-7e21-4c03-b6fb-f0a11ab6df81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:51.334476 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1649ebc7-7e21-4c03-b6fb-f0a11ab6df81 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:51.346503 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1290/2576] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:51 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:44:51.350648 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bce1d1-8a09-4b31-972e-7979979191e7 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:51.360580 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bce1d1-8a09-4b31-972e-7979979191e7 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:51.365887 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79641be2-1ff0-4ccf-b801-627379ede409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:51.366543 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79641be2-1ff0-4ccf-b801-627379ede409 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:51.366834 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79641be2-1ff0-4ccf-b801-627379ede409 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:51.367112 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79641be2-1ff0-4ccf-b801-627379ede409 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:51.368038 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79641be2-1ff0-4ccf-b801-627379ede409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:51.377345 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79641be2-1ff0-4ccf-b801-627379ede409 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:51.382128 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1287/2577] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:51 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:44:51.388674 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649ebc7-7e21-4c03-b6fb-f0a11ab6df81 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:51.407980 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649ebc7-7e21-4c03-b6fb-f0a11ab6df81 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:51.415302 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e10a0-f101-4325-9517-7ca629b183a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:51.416136 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e10a0-f101-4325-9517-7ca629b183a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:51.416424 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e10a0-f101-4325-9517-7ca629b183a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:51.416709 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e10a0-f101-4325-9517-7ca629b183a4 admin admin] PATH_INFO: `/v3/projects/db9a2c667930406f91b8a95e4520a83b/users/7dadae4d8c48446c9f4a7a97d251119c/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:51.437843 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e10a0-f101-4325-9517-7ca629b183a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db9a2c667930406f91b8a95e4520a83b, user_id=7dadae4d8c48446c9f4a7a97d251119c, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:51.440922 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e10a0-f101-4325-9517-7ca629b183a4 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:51.462941 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1291/2578] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:44:51 2021] PUT /identity/v3/projects/db9a2c667930406f91b8a95e4520a83b/users/7dadae4d8c48446c9f4a7a97d251119c/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:51.478606 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085cf11-52cd-4b6e-ab36-eb0797d54e48 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:51.478606 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085cf11-52cd-4b6e-ab36-eb0797d54e48 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:51.478606 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085cf11-52cd-4b6e-ab36-eb0797d54e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:51.519070 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-4085cf11-52cd-4b6e-ab36-eb0797d54e48 None None] MFA Rules not processed for user `7dadae4d8c48446c9f4a7a97d251119c`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:51.520269 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-4085cf11-52cd-4b6e-ab36-eb0797d54e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:51.610884 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1288/2579] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:44:51 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:51.622595 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e10a0-f101-4325-9517-7ca629b183a4 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:51.624417 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-774e10a0-f101-4325-9517-7ca629b183a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:51.698244 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e10a0-f101-4325-9517-7ca629b183a4 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:51.702271 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616d565-a630-42dd-af6e-a3ed1415a9e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ccebf28ac494f608c33437fc34139be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:51.702934 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616d565-a630-42dd-af6e-a3ed1415a9e0 service glance] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:51.703228 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616d565-a630-42dd-af6e-a3ed1415a9e0 service glance] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:51.703562 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616d565-a630-42dd-af6e-a3ed1415a9e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:51.716176 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b616d565-a630-42dd-af6e-a3ed1415a9e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:51.717739 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b616d565-a630-42dd-af6e-a3ed1415a9e0 service glance] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:51.735966 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1292/2580] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:51 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:57.442892 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085cf11-52cd-4b6e-ab36-eb0797d54e48 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:57.444570 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-4085cf11-52cd-4b6e-ab36-eb0797d54e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:57.525859 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085cf11-52cd-4b6e-ab36-eb0797d54e48 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:57.529837 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85be43-2a65-4be7-93ed-a9daa58dfb54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:57.530429 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85be43-2a65-4be7-93ed-a9daa58dfb54 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:57.530713 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85be43-2a65-4be7-93ed-a9daa58dfb54 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:57.530991 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85be43-2a65-4be7-93ed-a9daa58dfb54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:57.532835 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-2a85be43-2a65-4be7-93ed-a9daa58dfb54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:57.543142 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85be43-2a65-4be7-93ed-a9daa58dfb54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:57.544566 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85be43-2a65-4be7-93ed-a9daa58dfb54 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:57.553509 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1289/2581] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:57 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:58.623191 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616d565-a630-42dd-af6e-a3ed1415a9e0 service glance] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:58.624720 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-b616d565-a630-42dd-af6e-a3ed1415a9e0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:58.835693 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616d565-a630-42dd-af6e-a3ed1415a9e0 service glance] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:58.851382 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc76ba-673e-4b17-a581-a9be34f9b7d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:58.852690 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc76ba-673e-4b17-a581-a9be34f9b7d3 service nova] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:58.853607 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc76ba-673e-4b17-a581-a9be34f9b7d3 service nova] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:58.854100 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc76ba-673e-4b17-a581-a9be34f9b7d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:58.856219 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-c0cc76ba-673e-4b17-a581-a9be34f9b7d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:58.872991 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc76ba-673e-4b17-a581-a9be34f9b7d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:58.875532 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc76ba-673e-4b17-a581-a9be34f9b7d3 service nova] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:44:58.901598 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1293/2582] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:58 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:45:01.253327 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85be43-2a65-4be7-93ed-a9daa58dfb54 service neutron] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:01.255688 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-2a85be43-2a65-4be7-93ed-a9daa58dfb54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:01.279684 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85be43-2a65-4be7-93ed-a9daa58dfb54 service neutron] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:01.287613 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54845615-93c7-4258-b5ae-da7a12036507 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:01.288953 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54845615-93c7-4258-b5ae-da7a12036507 service nova] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:01.289416 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54845615-93c7-4258-b5ae-da7a12036507 service nova] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:01.289907 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54845615-93c7-4258-b5ae-da7a12036507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:01.292322 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-54845615-93c7-4258-b5ae-da7a12036507 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:01.310003 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54845615-93c7-4258-b5ae-da7a12036507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:01.311605 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54845615-93c7-4258-b5ae-da7a12036507 service nova] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:01.323960 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1290/2583] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:45:01 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:45:03.970039 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc76ba-673e-4b17-a581-a9be34f9b7d3 service nova] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:03.985625 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc76ba-673e-4b17-a581-a9be34f9b7d3 service nova] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:03.991616 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d16e2-330e-4cd9-93cd-8d241b775322 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:03.992832 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d16e2-330e-4cd9-93cd-8d241b775322 service nova] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:03.993142 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d16e2-330e-4cd9-93cd-8d241b775322 service nova] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:03.993426 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d16e2-330e-4cd9-93cd-8d241b775322 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:03.995197 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-014d16e2-330e-4cd9-93cd-8d241b775322 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:04.010636 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d16e2-330e-4cd9-93cd-8d241b775322 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:04.012253 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d16e2-330e-4cd9-93cd-8d241b775322 service nova] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:04.023697 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1294/2584] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:45:03 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:45:10.825555 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54845615-93c7-4258-b5ae-da7a12036507 service nova] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:10.908072 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54845615-93c7-4258-b5ae-da7a12036507 service nova] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:10.912659 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594f34b-d6c8-407c-b6d5-db2667a0d114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:10.913516 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594f34b-d6c8-407c-b6d5-db2667a0d114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:10.913805 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594f34b-d6c8-407c-b6d5-db2667a0d114 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:10.914087 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594f34b-d6c8-407c-b6d5-db2667a0d114 admin admin] PATH_INFO: `/v3/users/7dadae4d8c48446c9f4a7a97d251119c` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:10.915757 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594f34b-d6c8-407c-b6d5-db2667a0d114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dadae4d8c48446c9f4a7a97d251119c)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:10.917736 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594f34b-d6c8-407c-b6d5-db2667a0d114 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:10.968794 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-f594f34b-d6c8-407c-b6d5-db2667a0d114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dadae4d8c48446c9f4a7a97d251119c'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:10.969483 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-f594f34b-d6c8-407c-b6d5-db2667a0d114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dadae4d8c48446c9f4a7a97d251119c'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:10.983228 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-f594f34b-d6c8-407c-b6d5-db2667a0d114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dadae4d8c48446c9f4a7a97d251119c'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:10.998104 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-f594f34b-d6c8-407c-b6d5-db2667a0d114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dadae4d8c48446c9f4a7a97d251119c'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:11.007130 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-f594f34b-d6c8-407c-b6d5-db2667a0d114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dadae4d8c48446c9f4a7a97d251119c'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:11.013594 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1291/2585] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:45:10 2021] DELETE /identity/v3/users/7dadae4d8c48446c9f4a7a97d251119c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:45:11.018212 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be3ead-1529-4655-8705-52a250e414ec None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:11.018772 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be3ead-1529-4655-8705-52a250e414ec None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:11.018891 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be3ead-1529-4655-8705-52a250e414ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:11.045469 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-89be3ead-1529-4655-8705-52a250e414ec None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:45:11.045469 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-89be3ead-1529-4655-8705-52a250e414ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:11.116559 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1295/2586] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:45:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:45:11.127144 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594f34b-d6c8-407c-b6d5-db2667a0d114 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:11.128518 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-f594f34b-d6c8-407c-b6d5-db2667a0d114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:11.235536 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594f34b-d6c8-407c-b6d5-db2667a0d114 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:11.240149 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14243428-806e-432b-851c-f341ec5382a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:11.240764 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14243428-806e-432b-851c-f341ec5382a1 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:11.241247 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14243428-806e-432b-851c-f341ec5382a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:11.241538 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14243428-806e-432b-851c-f341ec5382a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:11.252229 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14243428-806e-432b-851c-f341ec5382a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:11.253803 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14243428-806e-432b-851c-f341ec5382a1 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:11.266240 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1292/2587] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:45:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:45:11.722091 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be3ead-1529-4655-8705-52a250e414ec None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:11.723464 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-89be3ead-1529-4655-8705-52a250e414ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:11.734814 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be3ead-1529-4655-8705-52a250e414ec None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:11.739767 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a572e-6ec0-44d0-9433-c033a7d00e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:11.740558 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a572e-6ec0-44d0-9433-c033a7d00e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:11.740885 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a572e-6ec0-44d0-9433-c033a7d00e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:11.741171 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a572e-6ec0-44d0-9433-c033a7d00e13 admin admin] PATH_INFO: `/v3/projects/db9a2c667930406f91b8a95e4520a83b` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:11.742278 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a572e-6ec0-44d0-9433-c033a7d00e13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db9a2c667930406f91b8a95e4520a83b)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:11.744244 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a572e-6ec0-44d0-9433-c033a7d00e13 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:11.798087 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-333a572e-6ec0-44d0-9433-c033a7d00e13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db9a2c667930406f91b8a95e4520a83b', 'request_id': 'req-333a572e-6ec0-44d0-9433-c033a7d00e13'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:11.803377 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-333a572e-6ec0-44d0-9433-c033a7d00e13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db9a2c667930406f91b8a95e4520a83b', 'request_id': 'req-333a572e-6ec0-44d0-9433-c033a7d00e13'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:11.812582 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-333a572e-6ec0-44d0-9433-c033a7d00e13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db9a2c667930406f91b8a95e4520a83b', 'request_id': 'req-333a572e-6ec0-44d0-9433-c033a7d00e13'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:11.830229 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-333a572e-6ec0-44d0-9433-c033a7d00e13 admin admin] The token cache is being invalidate because project db9a2c667930406f91b8a95e4520a83b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:45:11.830520 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-333a572e-6ec0-44d0-9433-c033a7d00e13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:11.831188 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-333a572e-6ec0-44d0-9433-c033a7d00e13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:11.833135 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1296/2588] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:45:11 2021] DELETE /identity/v3/projects/db9a2c667930406f91b8a95e4520a83b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:45:11.838614 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afbea2-1f81-45c5-a99b-6d86a7e7f573 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:11.839133 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afbea2-1f81-45c5-a99b-6d86a7e7f573 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:11.839249 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afbea2-1f81-45c5-a99b-6d86a7e7f573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:11.863746 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-50afbea2-1f81-45c5-a99b-6d86a7e7f573 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:45:11.865395 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-50afbea2-1f81-45c5-a99b-6d86a7e7f573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:11.934621 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1293/2589] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:45:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:45:11.942739 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a598e-3376-4fc2-aaa0-a760ff5675a7 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:11.943069 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a598e-3376-4fc2-aaa0-a760ff5675a7 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:11.943361 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a598e-3376-4fc2-aaa0-a760ff5675a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:11.975331 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-1a9a598e-3376-4fc2-aaa0-a760ff5675a7 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:45:11.977405 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-1a9a598e-3376-4fc2-aaa0-a760ff5675a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:11.996831 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1297/2590] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:45:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:45:11.998388 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afbea2-1f81-45c5-a99b-6d86a7e7f573 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:12.007992 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afbea2-1f81-45c5-a99b-6d86a7e7f573 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:12.013725 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40164a34-a221-4f9b-b498-5a5d685cfd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:12.014348 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40164a34-a221-4f9b-b498-5a5d685cfd18 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:12.014734 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40164a34-a221-4f9b-b498-5a5d685cfd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:12.015094 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40164a34-a221-4f9b-b498-5a5d685cfd18 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:12.015804 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40164a34-a221-4f9b-b498-5a5d685cfd18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:45:12.016111 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40164a34-a221-4f9b-b498-5a5d685cfd18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:12.017811 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40164a34-a221-4f9b-b498-5a5d685cfd18 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:12.035935 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1294/2591] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:45:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:45:12.038034 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a598e-3376-4fc2-aaa0-a760ff5675a7 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:12.048830 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a598e-3376-4fc2-aaa0-a760ff5675a7 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:12.053776 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac47a90-4dfb-48cd-a0f2-fc367539aae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:12.054383 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac47a90-4dfb-48cd-a0f2-fc367539aae3 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:12.054824 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac47a90-4dfb-48cd-a0f2-fc367539aae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:12.055124 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac47a90-4dfb-48cd-a0f2-fc367539aae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:12.056304 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac47a90-4dfb-48cd-a0f2-fc367539aae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:12.058281 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac47a90-4dfb-48cd-a0f2-fc367539aae3 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:12.088169 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1298/2592] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:45:12 2021] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:45:12.093077 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40164a34-a221-4f9b-b498-5a5d685cfd18 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:12.104115 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40164a34-a221-4f9b-b498-5a5d685cfd18 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:12.177549 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65df73-27ca-4516-bc64-7eff6139318e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:12.178156 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65df73-27ca-4516-bc64-7eff6139318e admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:12.178450 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65df73-27ca-4516-bc64-7eff6139318e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:12.178741 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65df73-27ca-4516-bc64-7eff6139318e admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:12.179371 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65df73-27ca-4516-bc64-7eff6139318e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:12.181956 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65df73-27ca-4516-bc64-7eff6139318e admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:12.204209 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1295/2593] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:45:12 2021] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:45:12.208559 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac47a90-4dfb-48cd-a0f2-fc367539aae3 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:12.220801 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac47a90-4dfb-48cd-a0f2-fc367539aae3 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:12.227817 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ef879-c6e6-4b70-bba1-2ed522b93c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:12.228613 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ef879-c6e6-4b70-bba1-2ed522b93c17 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:12.229053 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ef879-c6e6-4b70-bba1-2ed522b93c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:12.229404 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ef879-c6e6-4b70-bba1-2ed522b93c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:12.230210 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ef879-c6e6-4b70-bba1-2ed522b93c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:12.231932 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ef879-c6e6-4b70-bba1-2ed522b93c17 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:12.243928 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1299/2594] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:45:12 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:45:12.248022 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65df73-27ca-4516-bc64-7eff6139318e admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:12.258239 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65df73-27ca-4516-bc64-7eff6139318e admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:12.263176 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81456742-05f0-4e94-83ad-a975c79bd8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:12.264129 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81456742-05f0-4e94-83ad-a975c79bd8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:12.264418 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81456742-05f0-4e94-83ad-a975c79bd8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:12.264735 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81456742-05f0-4e94-83ad-a975c79bd8e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:12.265474 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81456742-05f0-4e94-83ad-a975c79bd8e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:12.267067 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81456742-05f0-4e94-83ad-a975c79bd8e2 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:12.278033 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1296/2595] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:45:12 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:45:12.282269 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ef879-c6e6-4b70-bba1-2ed522b93c17 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:12.292625 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ef879-c6e6-4b70-bba1-2ed522b93c17 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:12.297124 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5114b3a-81c6-46a9-8dc2-9c5e20569278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:12.297963 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5114b3a-81c6-46a9-8dc2-9c5e20569278 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:12.298247 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5114b3a-81c6-46a9-8dc2-9c5e20569278 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:12.298529 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5114b3a-81c6-46a9-8dc2-9c5e20569278 admin admin] PATH_INFO: `/v3/projects/b36acc57a4974b32a7ae84131c47332e/users/8caa5c97d8ac4e9c9d23be0bf6e8eeff/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:12.324768 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5114b3a-81c6-46a9-8dc2-9c5e20569278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b36acc57a4974b32a7ae84131c47332e, user_id=8caa5c97d8ac4e9c9d23be0bf6e8eeff, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:12.327479 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5114b3a-81c6-46a9-8dc2-9c5e20569278 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:12.341818 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1300/2596] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:45:12 2021] PUT /identity/v3/projects/b36acc57a4974b32a7ae84131c47332e/users/8caa5c97d8ac4e9c9d23be0bf6e8eeff/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:45:12.351976 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cfb8c-69a7-4c5c-bf64-ad9c1f904a4c None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:12.352890 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cfb8c-69a7-4c5c-bf64-ad9c1f904a4c None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:12.353168 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cfb8c-69a7-4c5c-bf64-ad9c1f904a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:12.395466 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-078cfb8c-69a7-4c5c-bf64-ad9c1f904a4c None None] MFA Rules not processed for user `8caa5c97d8ac4e9c9d23be0bf6e8eeff`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:45:12.397094 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-078cfb8c-69a7-4c5c-bf64-ad9c1f904a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:12.481171 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1297/2597] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:45:12 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:45:12.485332 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5114b3a-81c6-46a9-8dc2-9c5e20569278 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:12.559881 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5114b3a-81c6-46a9-8dc2-9c5e20569278 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:12.564437 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f31ee-dce4-437d-b7b4-180298a6ff52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:12.565083 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f31ee-dce4-437d-b7b4-180298a6ff52 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:12.565371 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f31ee-dce4-437d-b7b4-180298a6ff52 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:12.565653 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f31ee-dce4-437d-b7b4-180298a6ff52 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:12.566304 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f31ee-dce4-437d-b7b4-180298a6ff52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:12.568205 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f31ee-dce4-437d-b7b4-180298a6ff52 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:12.598586 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1301/2598] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:45:12 2021] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:45:12.599821 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078cfb8c-69a7-4c5c-bf64-ad9c1f904a4c None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:12.610789 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078cfb8c-69a7-4c5c-bf64-ad9c1f904a4c None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:12.676706 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d93331-6c9a-4250-8ec6-d31b208c4df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:12.677382 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d93331-6c9a-4250-8ec6-d31b208c4df5 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:12.677678 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d93331-6c9a-4250-8ec6-d31b208c4df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:12.677965 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d93331-6c9a-4250-8ec6-d31b208c4df5 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:12.678732 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d93331-6c9a-4250-8ec6-d31b208c4df5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:12.680717 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d93331-6c9a-4250-8ec6-d31b208c4df5 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:12.708915 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1298/2599] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:45:12 2021] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:45:12.710145 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f31ee-dce4-437d-b7b4-180298a6ff52 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:12.720764 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f31ee-dce4-437d-b7b4-180298a6ff52 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:12.725441 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf8107-2388-4592-baa8-c62bbb663f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:12.726050 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf8107-2388-4592-baa8-c62bbb663f15 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:12.726338 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf8107-2388-4592-baa8-c62bbb663f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:12.726620 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf8107-2388-4592-baa8-c62bbb663f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:12.727381 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf8107-2388-4592-baa8-c62bbb663f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:12.729518 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf8107-2388-4592-baa8-c62bbb663f15 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:12.740753 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1302/2600] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:45:12 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:45:12.744904 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d93331-6c9a-4250-8ec6-d31b208c4df5 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:12.754673 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d93331-6c9a-4250-8ec6-d31b208c4df5 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:12.759503 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1016c7-a101-4147-84c7-a08d41e6178c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:12.760625 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1016c7-a101-4147-84c7-a08d41e6178c admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:12.760625 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1016c7-a101-4147-84c7-a08d41e6178c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:12.760976 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1016c7-a101-4147-84c7-a08d41e6178c admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:12.761971 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1016c7-a101-4147-84c7-a08d41e6178c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:12.763734 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1016c7-a101-4147-84c7-a08d41e6178c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:12.775377 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1299/2601] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:45:12 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:45:12.779646 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf8107-2388-4592-baa8-c62bbb663f15 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:12.789371 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf8107-2388-4592-baa8-c62bbb663f15 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:12.794389 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88a60b-9a44-499f-bd42-91e1aa6ca2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:12.795219 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88a60b-9a44-499f-bd42-91e1aa6ca2d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:12.795538 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88a60b-9a44-499f-bd42-91e1aa6ca2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:12.795795 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88a60b-9a44-499f-bd42-91e1aa6ca2d3 admin admin] PATH_INFO: `/v3/projects/626bca1d08ca419e856d40d803a1dd77/users/b46d1c95a3bb462689f5c11d89c72c03/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:12.816201 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88a60b-9a44-499f-bd42-91e1aa6ca2d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=626bca1d08ca419e856d40d803a1dd77, user_id=b46d1c95a3bb462689f5c11d89c72c03, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:12.819154 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88a60b-9a44-499f-bd42-91e1aa6ca2d3 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:12.834635 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1303/2602] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:45:12 2021] PUT /identity/v3/projects/626bca1d08ca419e856d40d803a1dd77/users/b46d1c95a3bb462689f5c11d89c72c03/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:45:12.848367 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77268a8d-57fe-4de6-803b-fb9031eab3e9 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:12.849357 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77268a8d-57fe-4de6-803b-fb9031eab3e9 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:12.849357 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77268a8d-57fe-4de6-803b-fb9031eab3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:12.895981 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-77268a8d-57fe-4de6-803b-fb9031eab3e9 None None] MFA Rules not processed for user `b46d1c95a3bb462689f5c11d89c72c03`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:45:12.897259 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-77268a8d-57fe-4de6-803b-fb9031eab3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:12.978935 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1300/2603] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:45:12 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:45:12.984856 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88a60b-9a44-499f-bd42-91e1aa6ca2d3 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:13.055717 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88a60b-9a44-499f-bd42-91e1aa6ca2d3 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:13.061819 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a401eaf-16cb-467c-8818-6b6bbb83db49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:13.062886 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a401eaf-16cb-467c-8818-6b6bbb83db49 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:13.063417 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a401eaf-16cb-467c-8818-6b6bbb83db49 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:13.063966 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a401eaf-16cb-467c-8818-6b6bbb83db49 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:13.065123 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a401eaf-16cb-467c-8818-6b6bbb83db49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:13.067682 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a401eaf-16cb-467c-8818-6b6bbb83db49 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:13.096828 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1304/2604] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:45:12 2021] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:45:13.100961 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77268a8d-57fe-4de6-803b-fb9031eab3e9 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:13.111775 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77268a8d-57fe-4de6-803b-fb9031eab3e9 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:13.177276 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cadce7-6f2f-410b-8361-12274dbd0fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:13.177875 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cadce7-6f2f-410b-8361-12274dbd0fde admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:13.178168 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cadce7-6f2f-410b-8361-12274dbd0fde admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:13.178453 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cadce7-6f2f-410b-8361-12274dbd0fde admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:13.179106 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cadce7-6f2f-410b-8361-12274dbd0fde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:13.181061 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cadce7-6f2f-410b-8361-12274dbd0fde admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:13.202567 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1301/2605] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:45:13 2021] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:45:13.206932 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a401eaf-16cb-467c-8818-6b6bbb83db49 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:13.217645 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a401eaf-16cb-467c-8818-6b6bbb83db49 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:13.222006 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5daac0f-b34e-4d22-8062-2e9028bc47e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:13.222600 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5daac0f-b34e-4d22-8062-2e9028bc47e5 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:13.222893 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5daac0f-b34e-4d22-8062-2e9028bc47e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:13.223174 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5daac0f-b34e-4d22-8062-2e9028bc47e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:13.223875 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5daac0f-b34e-4d22-8062-2e9028bc47e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:13.225524 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5daac0f-b34e-4d22-8062-2e9028bc47e5 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:13.238237 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1305/2606] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:45:13 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:45:13.243149 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cadce7-6f2f-410b-8361-12274dbd0fde admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:13.252832 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cadce7-6f2f-410b-8361-12274dbd0fde admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:13.258015 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd801770-a6c3-4749-8b0c-57b2ec421f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:13.259623 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd801770-a6c3-4749-8b0c-57b2ec421f71 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:13.259623 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd801770-a6c3-4749-8b0c-57b2ec421f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:13.259858 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd801770-a6c3-4749-8b0c-57b2ec421f71 admin admin] PATH_INFO: `/v3/projects/b98dee78d8b049b8a3745799ad901194/users/61ecc5a603a24be3af266fe2af37ea5f/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:13.280866 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd801770-a6c3-4749-8b0c-57b2ec421f71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b98dee78d8b049b8a3745799ad901194, user_id=61ecc5a603a24be3af266fe2af37ea5f, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:13.283510 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd801770-a6c3-4749-8b0c-57b2ec421f71 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:13.297647 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1302/2607] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:45:13 2021] PUT /identity/v3/projects/b98dee78d8b049b8a3745799ad901194/users/61ecc5a603a24be3af266fe2af37ea5f/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:45:13.301650 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5daac0f-b34e-4d22-8062-2e9028bc47e5 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:13.312204 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5daac0f-b34e-4d22-8062-2e9028bc47e5 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:13.379352 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd2006-627e-442a-be4a-1d09f1172cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:13.379964 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd2006-627e-442a-be4a-1d09f1172cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:13.380247 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd2006-627e-442a-be4a-1d09f1172cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:13.380530 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd2006-627e-442a-be4a-1d09f1172cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:13.381268 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd2006-627e-442a-be4a-1d09f1172cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:13.382906 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd2006-627e-442a-be4a-1d09f1172cf8 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:13.394919 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1306/2608] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:45:13 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:45:13.399330 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd801770-a6c3-4749-8b0c-57b2ec421f71 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:13.410225 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd801770-a6c3-4749-8b0c-57b2ec421f71 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:13.415293 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55630a-81a4-416a-95ad-e431ca40133a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:13.416128 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55630a-81a4-416a-95ad-e431ca40133a admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:13.416418 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55630a-81a4-416a-95ad-e431ca40133a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:13.416700 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55630a-81a4-416a-95ad-e431ca40133a admin admin] PATH_INFO: `/v3/projects/b98dee78d8b049b8a3745799ad901194/users/61ecc5a603a24be3af266fe2af37ea5f/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:13.418663 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55630a-81a4-416a-95ad-e431ca40133a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b98dee78d8b049b8a3745799ad901194, user_id=61ecc5a603a24be3af266fe2af37ea5f, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:13.421404 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55630a-81a4-416a-95ad-e431ca40133a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:13.433584 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1303/2609] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:45:13 2021] PUT /identity/v3/projects/b98dee78d8b049b8a3745799ad901194/users/61ecc5a603a24be3af266fe2af37ea5f/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:45:13.444166 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5212521-e12b-403e-81fa-fd10b4483f7a None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:13.444463 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5212521-e12b-403e-81fa-fd10b4483f7a None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:13.444752 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5212521-e12b-403e-81fa-fd10b4483f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:13.486061 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-f5212521-e12b-403e-81fa-fd10b4483f7a None None] MFA Rules not processed for user `61ecc5a603a24be3af266fe2af37ea5f`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:45:13.487274 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-f5212521-e12b-403e-81fa-fd10b4483f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:13.577747 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1307/2610] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:45:13 2021] POST /identity/v3/auth/tokens => generated 3757 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:45:13.589286 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55630a-81a4-416a-95ad-e431ca40133a admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:13.591144 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-aa55630a-81a4-416a-95ad-e431ca40133a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:13.677019 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55630a-81a4-416a-95ad-e431ca40133a admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:13.683904 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056a038-994d-40cf-b22b-cb46b1f7980d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:13.685088 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056a038-994d-40cf-b22b-cb46b1f7980d service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:13.685586 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056a038-994d-40cf-b22b-cb46b1f7980d service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:13.686063 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056a038-994d-40cf-b22b-cb46b1f7980d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:13.778986 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056a038-994d-40cf-b22b-cb46b1f7980d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:13.780523 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056a038-994d-40cf-b22b-cb46b1f7980d service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:13.789980 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1304/2611] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:45:13 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:45:14.299147 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5212521-e12b-403e-81fa-fd10b4483f7a None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:14.300498 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-f5212521-e12b-403e-81fa-fd10b4483f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:14.368244 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5212521-e12b-403e-81fa-fd10b4483f7a None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:14.371594 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e245f9-efeb-4af3-904a-9b63488aec98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:14.372180 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e245f9-efeb-4af3-904a-9b63488aec98 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:14.372476 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e245f9-efeb-4af3-904a-9b63488aec98 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:14.372756 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e245f9-efeb-4af3-904a-9b63488aec98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:14.374489 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-a4e245f9-efeb-4af3-904a-9b63488aec98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:14.444813 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e245f9-efeb-4af3-904a-9b63488aec98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:14.446274 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e245f9-efeb-4af3-904a-9b63488aec98 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:14.456382 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1308/2612] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:45:14 2021] GET /identity/v3/auth/tokens => generated 3747 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:45:15.558683 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056a038-994d-40cf-b22b-cb46b1f7980d service cinder] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:15.567597 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056a038-994d-40cf-b22b-cb46b1f7980d service cinder] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:15.571194 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4faef4-732c-4b67-bf62-303a8d654f6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:15.571799 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4faef4-732c-4b67-bf62-303a8d654f6f service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:15.572065 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4faef4-732c-4b67-bf62-303a8d654f6f service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:15.572348 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4faef4-732c-4b67-bf62-303a8d654f6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:15.652604 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4faef4-732c-4b67-bf62-303a8d654f6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:15.654282 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4faef4-732c-4b67-bf62-303a8d654f6f service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:15.663733 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1305/2613] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:45:15 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:45:16.539108 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e245f9-efeb-4af3-904a-9b63488aec98 service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:16.548464 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e245f9-efeb-4af3-904a-9b63488aec98 service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:16.552054 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b57ce2-47a8-4eae-91da-d9284d95f7d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:16.552636 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b57ce2-47a8-4eae-91da-d9284d95f7d8 service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:16.552969 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b57ce2-47a8-4eae-91da-d9284d95f7d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:16.553265 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b57ce2-47a8-4eae-91da-d9284d95f7d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:16.564406 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b57ce2-47a8-4eae-91da-d9284d95f7d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:16.565988 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b57ce2-47a8-4eae-91da-d9284d95f7d8 service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:16.576468 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1309/2614] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:45:16 2021] GET /identity/v3/auth/tokens => generated 3757 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:45:19.091884 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4faef4-732c-4b67-bf62-303a8d654f6f service cinder] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:19.094078 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-2c4faef4-732c-4b67-bf62-303a8d654f6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:19.107207 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4faef4-732c-4b67-bf62-303a8d654f6f service cinder] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:19.110764 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876d106-660d-4614-814a-9803f7b611e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:19.111443 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876d106-660d-4614-814a-9803f7b611e3 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:19.111794 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876d106-660d-4614-814a-9803f7b611e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:19.112142 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876d106-660d-4614-814a-9803f7b611e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:19.114057 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-7876d106-660d-4614-814a-9803f7b611e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:19.189135 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876d106-660d-4614-814a-9803f7b611e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:19.190570 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876d106-660d-4614-814a-9803f7b611e3 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:19.199771 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1306/2615] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:45:19 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:45:21.308563 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b57ce2-47a8-4eae-91da-d9284d95f7d8 service cinder] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:21.380426 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b57ce2-47a8-4eae-91da-d9284d95f7d8 service cinder] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:21.384598 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7b143-6985-4a1a-aff5-3d531a501d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:21.385417 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7b143-6985-4a1a-aff5-3d531a501d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:21.386226 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7b143-6985-4a1a-aff5-3d531a501d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:21.386513 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7b143-6985-4a1a-aff5-3d531a501d04 admin admin] PATH_INFO: `/v3/users/8caa5c97d8ac4e9c9d23be0bf6e8eeff` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:21.387876 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7b143-6985-4a1a-aff5-3d531a501d04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8caa5c97d8ac4e9c9d23be0bf6e8eeff)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:21.389843 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7b143-6985-4a1a-aff5-3d531a501d04 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:21.443539 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-8ee7b143-6985-4a1a-aff5-3d531a501d04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8caa5c97d8ac4e9c9d23be0bf6e8eeff'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:21.444223 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-8ee7b143-6985-4a1a-aff5-3d531a501d04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8caa5c97d8ac4e9c9d23be0bf6e8eeff'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:21.457095 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-8ee7b143-6985-4a1a-aff5-3d531a501d04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8caa5c97d8ac4e9c9d23be0bf6e8eeff'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:21.466704 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-8ee7b143-6985-4a1a-aff5-3d531a501d04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8caa5c97d8ac4e9c9d23be0bf6e8eeff'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:21.473931 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-8ee7b143-6985-4a1a-aff5-3d531a501d04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8caa5c97d8ac4e9c9d23be0bf6e8eeff'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:21.479910 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1310/2616] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:45:21 2021] DELETE /identity/v3/users/8caa5c97d8ac4e9c9d23be0bf6e8eeff => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:45:21.484352 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbd627-d1cf-40bf-b316-9bd965660329 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:21.484860 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbd627-d1cf-40bf-b316-9bd965660329 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:21.484996 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbd627-d1cf-40bf-b316-9bd965660329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:21.507026 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-63fbd627-d1cf-40bf-b316-9bd965660329 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:45:21.508288 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-63fbd627-d1cf-40bf-b316-9bd965660329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:21.576193 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1307/2617] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:45:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:45:21.586570 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7b143-6985-4a1a-aff5-3d531a501d04 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:21.587904 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-8ee7b143-6985-4a1a-aff5-3d531a501d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:21.655687 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7b143-6985-4a1a-aff5-3d531a501d04 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:21.659785 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb025c2-e1f2-4116-93ba-dea82380cd4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:21.660459 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb025c2-e1f2-4116-93ba-dea82380cd4b service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:21.660854 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb025c2-e1f2-4116-93ba-dea82380cd4b service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:21.661227 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb025c2-e1f2-4116-93ba-dea82380cd4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:21.671351 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb025c2-e1f2-4116-93ba-dea82380cd4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:21.672912 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb025c2-e1f2-4116-93ba-dea82380cd4b service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:21.690857 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1311/2618] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:45:21 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:45:22.727804 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbd627-d1cf-40bf-b316-9bd965660329 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:22.734468 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-63fbd627-d1cf-40bf-b316-9bd965660329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:22.747959 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbd627-d1cf-40bf-b316-9bd965660329 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:22.754383 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ce980-8b9a-4d44-9251-daa385938c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:22.755191 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ce980-8b9a-4d44-9251-daa385938c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:22.755729 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ce980-8b9a-4d44-9251-daa385938c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:22.756202 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ce980-8b9a-4d44-9251-daa385938c18 admin admin] PATH_INFO: `/v3/projects/b36acc57a4974b32a7ae84131c47332e` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:22.768504 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ce980-8b9a-4d44-9251-daa385938c18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b36acc57a4974b32a7ae84131c47332e)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:22.770558 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ce980-8b9a-4d44-9251-daa385938c18 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:22.846591 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b34ce980-8b9a-4d44-9251-daa385938c18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b36acc57a4974b32a7ae84131c47332e', 'request_id': 'req-b34ce980-8b9a-4d44-9251-daa385938c18'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:22.860865 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b34ce980-8b9a-4d44-9251-daa385938c18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b36acc57a4974b32a7ae84131c47332e', 'request_id': 'req-b34ce980-8b9a-4d44-9251-daa385938c18'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:22.867034 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b34ce980-8b9a-4d44-9251-daa385938c18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b36acc57a4974b32a7ae84131c47332e', 'request_id': 'req-b34ce980-8b9a-4d44-9251-daa385938c18'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:22.881944 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b34ce980-8b9a-4d44-9251-daa385938c18 admin admin] The token cache is being invalidate because project b36acc57a4974b32a7ae84131c47332e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:45:22.882374 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b34ce980-8b9a-4d44-9251-daa385938c18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:22.883034 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-b34ce980-8b9a-4d44-9251-daa385938c18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:22.888465 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1308/2619] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:45:22 2021] DELETE /identity/v3/projects/b36acc57a4974b32a7ae84131c47332e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:45:22.889672 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb025c2-e1f2-4116-93ba-dea82380cd4b service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:22.899699 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb025c2-e1f2-4116-93ba-dea82380cd4b service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:22.974816 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97306d26-4fc6-4ffe-ab74-22ec7341f813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:22.975653 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97306d26-4fc6-4ffe-ab74-22ec7341f813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:22.975948 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97306d26-4fc6-4ffe-ab74-22ec7341f813 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:22.976229 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97306d26-4fc6-4ffe-ab74-22ec7341f813 admin admin] PATH_INFO: `/v3/users/b46d1c95a3bb462689f5c11d89c72c03` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:22.977834 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97306d26-4fc6-4ffe-ab74-22ec7341f813 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b46d1c95a3bb462689f5c11d89c72c03)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:22.980242 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97306d26-4fc6-4ffe-ab74-22ec7341f813 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:23.042647 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-97306d26-4fc6-4ffe-ab74-22ec7341f813 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b46d1c95a3bb462689f5c11d89c72c03'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:23.043960 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-97306d26-4fc6-4ffe-ab74-22ec7341f813 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b46d1c95a3bb462689f5c11d89c72c03'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:23.060034 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-97306d26-4fc6-4ffe-ab74-22ec7341f813 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b46d1c95a3bb462689f5c11d89c72c03'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:23.076139 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-97306d26-4fc6-4ffe-ab74-22ec7341f813 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b46d1c95a3bb462689f5c11d89c72c03'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:23.086188 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-97306d26-4fc6-4ffe-ab74-22ec7341f813 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b46d1c95a3bb462689f5c11d89c72c03'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:23.097940 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1312/2620] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:45:22 2021] DELETE /identity/v3/users/b46d1c95a3bb462689f5c11d89c72c03 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:45:23.896223 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ce980-8b9a-4d44-9251-daa385938c18 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:23.897666 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-b34ce980-8b9a-4d44-9251-daa385938c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:23.911172 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ce980-8b9a-4d44-9251-daa385938c18 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:23.986722 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63048e-7e45-41ea-b53a-a4da28183579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:23.987745 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63048e-7e45-41ea-b53a-a4da28183579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:23.988101 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63048e-7e45-41ea-b53a-a4da28183579 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:23.988451 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63048e-7e45-41ea-b53a-a4da28183579 admin admin] PATH_INFO: `/v3/projects/626bca1d08ca419e856d40d803a1dd77` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:23.994556 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63048e-7e45-41ea-b53a-a4da28183579 admin admin] RBAC: Authorizing `identity:delete_project(project_id=626bca1d08ca419e856d40d803a1dd77)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:23.996525 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63048e-7e45-41ea-b53a-a4da28183579 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:24.059374 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ef63048e-7e45-41ea-b53a-a4da28183579 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '626bca1d08ca419e856d40d803a1dd77', 'request_id': 'req-ef63048e-7e45-41ea-b53a-a4da28183579'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:24.070989 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ef63048e-7e45-41ea-b53a-a4da28183579 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '626bca1d08ca419e856d40d803a1dd77', 'request_id': 'req-ef63048e-7e45-41ea-b53a-a4da28183579'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:24.076264 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ef63048e-7e45-41ea-b53a-a4da28183579 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '626bca1d08ca419e856d40d803a1dd77', 'request_id': 'req-ef63048e-7e45-41ea-b53a-a4da28183579'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:24.090038 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ef63048e-7e45-41ea-b53a-a4da28183579 admin admin] The token cache is being invalidate because project 626bca1d08ca419e856d40d803a1dd77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:45:24.090419 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ef63048e-7e45-41ea-b53a-a4da28183579 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:24.090983 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ef63048e-7e45-41ea-b53a-a4da28183579 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:24.092446 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1309/2621] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:45:23 2021] DELETE /identity/v3/projects/626bca1d08ca419e856d40d803a1dd77 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:45:24.097711 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97306d26-4fc6-4ffe-ab74-22ec7341f813 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:24.099146 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-97306d26-4fc6-4ffe-ab74-22ec7341f813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:24.113161 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97306d26-4fc6-4ffe-ab74-22ec7341f813 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:24.204165 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5f28d-1e72-475d-96aa-1bb7edc10a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:24.205024 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5f28d-1e72-475d-96aa-1bb7edc10a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:24.205318 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5f28d-1e72-475d-96aa-1bb7edc10a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:24.205608 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5f28d-1e72-475d-96aa-1bb7edc10a39 admin admin] PATH_INFO: `/v3/users/61ecc5a603a24be3af266fe2af37ea5f` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:24.206797 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5f28d-1e72-475d-96aa-1bb7edc10a39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61ecc5a603a24be3af266fe2af37ea5f)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:24.208719 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5f28d-1e72-475d-96aa-1bb7edc10a39 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:24.267657 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-e5f5f28d-1e72-475d-96aa-1bb7edc10a39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61ecc5a603a24be3af266fe2af37ea5f'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:24.268280 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-e5f5f28d-1e72-475d-96aa-1bb7edc10a39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61ecc5a603a24be3af266fe2af37ea5f'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:24.280797 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-e5f5f28d-1e72-475d-96aa-1bb7edc10a39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61ecc5a603a24be3af266fe2af37ea5f'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:24.288970 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-e5f5f28d-1e72-475d-96aa-1bb7edc10a39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61ecc5a603a24be3af266fe2af37ea5f'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:24.297295 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-e5f5f28d-1e72-475d-96aa-1bb7edc10a39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61ecc5a603a24be3af266fe2af37ea5f'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:24.303768 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1313/2622] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:45:24 2021] DELETE /identity/v3/users/61ecc5a603a24be3af266fe2af37ea5f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:45:24.930297 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63048e-7e45-41ea-b53a-a4da28183579 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:24.942373 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-ef63048e-7e45-41ea-b53a-a4da28183579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:24.957684 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63048e-7e45-41ea-b53a-a4da28183579 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:25.023895 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41df621-f280-408d-b81c-ccaea0cfca8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:25.024897 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41df621-f280-408d-b81c-ccaea0cfca8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:25.025193 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41df621-f280-408d-b81c-ccaea0cfca8c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:25.025477 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41df621-f280-408d-b81c-ccaea0cfca8c admin admin] PATH_INFO: `/v3/projects/b98dee78d8b049b8a3745799ad901194` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:25.026665 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41df621-f280-408d-b81c-ccaea0cfca8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b98dee78d8b049b8a3745799ad901194)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:25.028775 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41df621-f280-408d-b81c-ccaea0cfca8c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:25.083185 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-e41df621-f280-408d-b81c-ccaea0cfca8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b98dee78d8b049b8a3745799ad901194', 'request_id': 'req-e41df621-f280-408d-b81c-ccaea0cfca8c'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:25.095486 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-e41df621-f280-408d-b81c-ccaea0cfca8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b98dee78d8b049b8a3745799ad901194', 'request_id': 'req-e41df621-f280-408d-b81c-ccaea0cfca8c'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:25.101739 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-e41df621-f280-408d-b81c-ccaea0cfca8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b98dee78d8b049b8a3745799ad901194', 'request_id': 'req-e41df621-f280-408d-b81c-ccaea0cfca8c'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:25.117335 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-e41df621-f280-408d-b81c-ccaea0cfca8c admin admin] The token cache is being invalidate because project b98dee78d8b049b8a3745799ad901194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:45:25.117617 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-e41df621-f280-408d-b81c-ccaea0cfca8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:25.118323 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-e41df621-f280-408d-b81c-ccaea0cfca8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:25.119954 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1310/2623] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:45:24 2021] DELETE /identity/v3/projects/b98dee78d8b049b8a3745799ad901194 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:45:25.126825 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97afcf7-11d4-4c00-8020-75d136f47972 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:25.127318 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97afcf7-11d4-4c00-8020-75d136f47972 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:25.127402 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97afcf7-11d4-4c00-8020-75d136f47972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:25.150974 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-e97afcf7-11d4-4c00-8020-75d136f47972 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:45:25.152221 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e97afcf7-11d4-4c00-8020-75d136f47972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:25.232849 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1314/2624] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:45:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:45:25.239475 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bb0b1-040c-4576-aa62-e931085ac577 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:25.239960 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bb0b1-040c-4576-aa62-e931085ac577 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:25.240622 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bb0b1-040c-4576-aa62-e931085ac577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:25.291905 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-a82bb0b1-040c-4576-aa62-e931085ac577 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:45:25.294376 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-a82bb0b1-040c-4576-aa62-e931085ac577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:25.307522 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1311/2625] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:45:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:45:25.311944 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97afcf7-11d4-4c00-8020-75d136f47972 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:25.323874 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97afcf7-11d4-4c00-8020-75d136f47972 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:25.329023 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47c5a7-ce45-4ba6-ba11-ac890a13984a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:25.330742 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47c5a7-ce45-4ba6-ba11-ac890a13984a admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:25.331147 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47c5a7-ce45-4ba6-ba11-ac890a13984a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:25.331626 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47c5a7-ce45-4ba6-ba11-ac890a13984a admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:25.332748 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47c5a7-ce45-4ba6-ba11-ac890a13984a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:45:25.333184 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47c5a7-ce45-4ba6-ba11-ac890a13984a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:25.334994 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47c5a7-ce45-4ba6-ba11-ac890a13984a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:25.353062 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1315/2626] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:45:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:45:25.354819 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bb0b1-040c-4576-aa62-e931085ac577 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:25.365578 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bb0b1-040c-4576-aa62-e931085ac577 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:25.370965 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd958c-5a56-4455-a5c3-a6a3d818de45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:25.371965 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd958c-5a56-4455-a5c3-a6a3d818de45 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:25.372629 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd958c-5a56-4455-a5c3-a6a3d818de45 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:25.373168 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd958c-5a56-4455-a5c3-a6a3d818de45 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:25.374099 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd958c-5a56-4455-a5c3-a6a3d818de45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:25.377100 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd958c-5a56-4455-a5c3-a6a3d818de45 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:25.410855 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1312/2627] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:45:25 2021] POST /identity/v3/projects => generated 391 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:45:25.415435 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47c5a7-ce45-4ba6-ba11-ac890a13984a admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:25.429836 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47c5a7-ce45-4ba6-ba11-ac890a13984a admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:25.553416 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2e472-5fb2-4b53-b934-73228d0d56cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:25.554202 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2e472-5fb2-4b53-b934-73228d0d56cd admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:25.554512 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2e472-5fb2-4b53-b934-73228d0d56cd admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:25.556186 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2e472-5fb2-4b53-b934-73228d0d56cd admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:25.556867 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2e472-5fb2-4b53-b934-73228d0d56cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:25.558985 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2e472-5fb2-4b53-b934-73228d0d56cd admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:25.591108 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1316/2628] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:45:25 2021] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:45:25.592423 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd958c-5a56-4455-a5c3-a6a3d818de45 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:25.602943 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd958c-5a56-4455-a5c3-a6a3d818de45 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:25.608486 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912013c-4653-4ee4-abf4-3a31203fd285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:25.609437 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912013c-4653-4ee4-abf4-3a31203fd285 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:25.609894 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912013c-4653-4ee4-abf4-3a31203fd285 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:25.610751 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912013c-4653-4ee4-abf4-3a31203fd285 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:25.611415 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912013c-4653-4ee4-abf4-3a31203fd285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:25.613940 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912013c-4653-4ee4-abf4-3a31203fd285 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:25.630837 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1313/2629] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:45:25 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:45:25.631753 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2e472-5fb2-4b53-b934-73228d0d56cd admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:25.646222 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2e472-5fb2-4b53-b934-73228d0d56cd admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:25.651285 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979b1e9-0bd9-491d-987b-1222e0f9eb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:25.652598 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979b1e9-0bd9-491d-987b-1222e0f9eb64 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:25.653012 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979b1e9-0bd9-491d-987b-1222e0f9eb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:25.653403 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979b1e9-0bd9-491d-987b-1222e0f9eb64 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:25.655629 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979b1e9-0bd9-491d-987b-1222e0f9eb64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:25.657411 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979b1e9-0bd9-491d-987b-1222e0f9eb64 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:25.671303 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1317/2630] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:45:25 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:45:25.675513 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912013c-4653-4ee4-abf4-3a31203fd285 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:25.686532 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912013c-4653-4ee4-abf4-3a31203fd285 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:25.692715 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e23b2c-f923-4905-8b01-7ecc43c55282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:25.694165 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e23b2c-f923-4905-8b01-7ecc43c55282 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:25.694751 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e23b2c-f923-4905-8b01-7ecc43c55282 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:25.695451 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e23b2c-f923-4905-8b01-7ecc43c55282 admin admin] PATH_INFO: `/v3/projects/258a530e1e514e51b7e23dbf24abd2e7/users/14e4a927cb484d39a6990026dada168f/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:25.728646 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e23b2c-f923-4905-8b01-7ecc43c55282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=258a530e1e514e51b7e23dbf24abd2e7, user_id=14e4a927cb484d39a6990026dada168f, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:25.734112 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e23b2c-f923-4905-8b01-7ecc43c55282 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:25.758192 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1314/2631] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:45:25 2021] PUT /identity/v3/projects/258a530e1e514e51b7e23dbf24abd2e7/users/14e4a927cb484d39a6990026dada168f/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:45:25.778397 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ee3af-e959-4549-9c20-7e10032f39f7 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:25.778693 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ee3af-e959-4549-9c20-7e10032f39f7 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:25.781226 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ee3af-e959-4549-9c20-7e10032f39f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:25.843143 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-5a0ee3af-e959-4549-9c20-7e10032f39f7 None None] MFA Rules not processed for user `14e4a927cb484d39a6990026dada168f`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:45:25.844970 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-5a0ee3af-e959-4549-9c20-7e10032f39f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:25.948900 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1318/2632] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:45:25 2021] POST /identity/v3/auth/tokens => generated 3698 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:45:25.960679 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e23b2c-f923-4905-8b01-7ecc43c55282 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:25.962868 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-f5e23b2c-f923-4905-8b01-7ecc43c55282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:26.064536 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e23b2c-f923-4905-8b01-7ecc43c55282 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:26.068917 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c67a4-6343-4c86-8075-fe8219748156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:26.069712 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c67a4-6343-4c86-8075-fe8219748156 service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:26.070127 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c67a4-6343-4c86-8075-fe8219748156 service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:26.070674 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c67a4-6343-4c86-8075-fe8219748156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:26.081644 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c67a4-6343-4c86-8075-fe8219748156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:26.083242 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c67a4-6343-4c86-8075-fe8219748156 service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:26.094181 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1315/2633] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:45:25 2021] GET /identity/v3/auth/tokens => generated 3698 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:45:46.311512 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ee3af-e959-4549-9c20-7e10032f39f7 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:46.381773 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ee3af-e959-4549-9c20-7e10032f39f7 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:46.386376 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66e6fb-9325-4b72-a266-92e82045cb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:46.387184 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66e6fb-9325-4b72-a266-92e82045cb13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:46.387481 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66e6fb-9325-4b72-a266-92e82045cb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:46.387769 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66e6fb-9325-4b72-a266-92e82045cb13 admin admin] PATH_INFO: `/v3/users/14e4a927cb484d39a6990026dada168f` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:46.388931 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66e6fb-9325-4b72-a266-92e82045cb13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14e4a927cb484d39a6990026dada168f)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:46.390850 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66e6fb-9325-4b72-a266-92e82045cb13 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:46.439863 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-6a66e6fb-9325-4b72-a266-92e82045cb13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14e4a927cb484d39a6990026dada168f'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:46.440978 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-6a66e6fb-9325-4b72-a266-92e82045cb13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14e4a927cb484d39a6990026dada168f'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:46.453516 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-6a66e6fb-9325-4b72-a266-92e82045cb13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14e4a927cb484d39a6990026dada168f'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:46.462258 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-6a66e6fb-9325-4b72-a266-92e82045cb13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14e4a927cb484d39a6990026dada168f'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:46.471678 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-6a66e6fb-9325-4b72-a266-92e82045cb13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14e4a927cb484d39a6990026dada168f'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:46.478341 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1319/2634] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:45:46 2021] DELETE /identity/v3/users/14e4a927cb484d39a6990026dada168f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:45:46.482850 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b6be2-6b4e-4c7e-84d8-4895ea1fa4bc None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:46.483382 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b6be2-6b4e-4c7e-84d8-4895ea1fa4bc None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:46.483494 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b6be2-6b4e-4c7e-84d8-4895ea1fa4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:46.506081 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-d76b6be2-6b4e-4c7e-84d8-4895ea1fa4bc None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:45:46.507228 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-d76b6be2-6b4e-4c7e-84d8-4895ea1fa4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:46.573875 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1316/2635] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:45:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:45:46.584405 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66e6fb-9325-4b72-a266-92e82045cb13 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:46.585763 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-6a66e6fb-9325-4b72-a266-92e82045cb13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:46.655184 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66e6fb-9325-4b72-a266-92e82045cb13 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:46.659158 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09992732-15af-4376-ac1d-b8909e2a6725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:46.659734 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09992732-15af-4376-ac1d-b8909e2a6725 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:46.660020 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09992732-15af-4376-ac1d-b8909e2a6725 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:46.660302 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09992732-15af-4376-ac1d-b8909e2a6725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:46.669044 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09992732-15af-4376-ac1d-b8909e2a6725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:46.670458 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09992732-15af-4376-ac1d-b8909e2a6725 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:46.681602 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1320/2636] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:45:46 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:45:47.042492 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b6be2-6b4e-4c7e-84d8-4895ea1fa4bc None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:47.043835 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-d76b6be2-6b4e-4c7e-84d8-4895ea1fa4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:47.055946 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b6be2-6b4e-4c7e-84d8-4895ea1fa4bc None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:47.060375 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719705d7-75bc-411b-a340-61fbc01551c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:47.061137 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719705d7-75bc-411b-a340-61fbc01551c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:47.061427 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719705d7-75bc-411b-a340-61fbc01551c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:47.061711 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719705d7-75bc-411b-a340-61fbc01551c5 admin admin] PATH_INFO: `/v3/projects/258a530e1e514e51b7e23dbf24abd2e7` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:47.063326 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719705d7-75bc-411b-a340-61fbc01551c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=258a530e1e514e51b7e23dbf24abd2e7)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:47.065227 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719705d7-75bc-411b-a340-61fbc01551c5 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:47.113418 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-719705d7-75bc-411b-a340-61fbc01551c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '258a530e1e514e51b7e23dbf24abd2e7', 'request_id': 'req-719705d7-75bc-411b-a340-61fbc01551c5'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:47.124059 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-719705d7-75bc-411b-a340-61fbc01551c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '258a530e1e514e51b7e23dbf24abd2e7', 'request_id': 'req-719705d7-75bc-411b-a340-61fbc01551c5'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:47.129728 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-719705d7-75bc-411b-a340-61fbc01551c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '258a530e1e514e51b7e23dbf24abd2e7', 'request_id': 'req-719705d7-75bc-411b-a340-61fbc01551c5'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:47.142506 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-719705d7-75bc-411b-a340-61fbc01551c5 admin admin] The token cache is being invalidate because project 258a530e1e514e51b7e23dbf24abd2e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:45:47.143064 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-719705d7-75bc-411b-a340-61fbc01551c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:47.143686 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-719705d7-75bc-411b-a340-61fbc01551c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:45:47.145193 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1317/2637] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:45:47 2021] DELETE /identity/v3/projects/258a530e1e514e51b7e23dbf24abd2e7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:45:49.214803 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33b7c4-4755-42b4-b6d4-12e1bf9c5106 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:49.215330 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33b7c4-4755-42b4-b6d4-12e1bf9c5106 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:49.215437 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33b7c4-4755-42b4-b6d4-12e1bf9c5106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:49.237656 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-6f33b7c4-4755-42b4-b6d4-12e1bf9c5106 None None] MFA Rules not processed for user `fa7dedfceea346ca997eedec181935c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:45:49.238862 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-6f33b7c4-4755-42b4-b6d4-12e1bf9c5106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:49.301851 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1321/2638] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Dec 16 14:45:49 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:45:49.341345 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719705d7-75bc-411b-a340-61fbc01551c5 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:49.342666 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-719705d7-75bc-411b-a340-61fbc01551c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:49.415718 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719705d7-75bc-411b-a340-61fbc01551c5 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:49.420376 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a3d2e-93f5-4d41-88da-1ddee7bb1b04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de4c90e44b96488aa47fbbc302e4f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:49.420975 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a3d2e-93f5-4d41-88da-1ddee7bb1b04 service swift] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:49.421264 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a3d2e-93f5-4d41-88da-1ddee7bb1b04 service swift] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:49.421543 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a3d2e-93f5-4d41-88da-1ddee7bb1b04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:49.430062 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a3d2e-93f5-4d41-88da-1ddee7bb1b04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:49.431621 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a3d2e-93f5-4d41-88da-1ddee7bb1b04 service swift] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:45:49.439369 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1318/2639] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Dec 16 14:45:49 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 16 14:46:03.484189 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917b111-22fe-4a7e-a74b-cb976cf7dd77 None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:46:03.484813 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917b111-22fe-4a7e-a74b-cb976cf7dd77 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:46:03.484813 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917b111-22fe-4a7e-a74b-cb976cf7dd77 None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:46:03.486612 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1322/2640] 10.222.0.64 () {54 vars in 921 bytes} [Thu Dec 16 14:46:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:46:03.492962 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15eabc8-5820-4fdc-ab1d-1985116987da None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:46:03.502496 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15eabc8-5820-4fdc-ab1d-1985116987da None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:46:03.503100 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15eabc8-5820-4fdc-ab1d-1985116987da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:46:03.526260 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-c15eabc8-5820-4fdc-ab1d-1985116987da None None] MFA Rules not processed for user `8e416527de444ef1b744da062ee1e7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:46:03.527411 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-c15eabc8-5820-4fdc-ab1d-1985116987da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:46:03.601134 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1319/2641] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Dec 16 14:46:03 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:46:03.613844 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917b111-22fe-4a7e-a74b-cb976cf7dd77 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:46:03.615683 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-8917b111-22fe-4a7e-a74b-cb976cf7dd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:46:03.683839 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917b111-22fe-4a7e-a74b-cb976cf7dd77 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:46:03.688237 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66552c3b-7c05-4619-9e09-3efb60e69972 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ccebf28ac494f608c33437fc34139be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:46:03.688880 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66552c3b-7c05-4619-9e09-3efb60e69972 service glance] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:46:03.689193 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66552c3b-7c05-4619-9e09-3efb60e69972 service glance] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:46:03.689871 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66552c3b-7c05-4619-9e09-3efb60e69972 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:46:03.700250 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66552c3b-7c05-4619-9e09-3efb60e69972 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:46:03.701798 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66552c3b-7c05-4619-9e09-3efb60e69972 service glance] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:46:03.712480 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1323/2642] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:46:03 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:46:03.792095 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22508cd6-db4f-4334-a8bd-04f210928993 None None] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:46:03.792396 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22508cd6-db4f-4334-a8bd-04f210928993 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:46:03.792687 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22508cd6-db4f-4334-a8bd-04f210928993 None None] PATH_INFO: `/` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:46:03.794472 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1320/2643] 10.222.0.64 () {54 vars in 921 bytes} [Thu Dec 16 14:46:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:46:03.799895 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7622f3-2a23-4377-b5ca-ba36b58ef8c5 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:46:03.800200 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7622f3-2a23-4377-b5ca-ba36b58ef8c5 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:46:03.800493 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7622f3-2a23-4377-b5ca-ba36b58ef8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:46:03.824466 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-3c7622f3-2a23-4377-b5ca-ba36b58ef8c5 None None] MFA Rules not processed for user `34e25627f3384826b35caf92a804c6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:46:03.825779 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-3c7622f3-2a23-4377-b5ca-ba36b58ef8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:46:03.889202 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1324/2644] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Dec 16 14:46:03 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:46:03.902587 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22508cd6-db4f-4334-a8bd-04f210928993 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:46:03.904276 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-22508cd6-db4f-4334-a8bd-04f210928993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:46:03.918376 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22508cd6-db4f-4334-a8bd-04f210928993 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:46:03.922030 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e0429-b619-404f-a880-646db6dfb8ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:46:03.922800 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e0429-b619-404f-a880-646db6dfb8ca service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:46:03.923190 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e0429-b619-404f-a880-646db6dfb8ca service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:46:03.923566 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e0429-b619-404f-a880-646db6dfb8ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:46:03.931398 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e0429-b619-404f-a880-646db6dfb8ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:46:03.932805 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e0429-b619-404f-a880-646db6dfb8ca service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:46:03.940604 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1321/2645] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:46:03 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:46:06.079648 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84b2a2-4aa3-4d05-9453-1e94c6256efd None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:46:06.080148 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84b2a2-4aa3-4d05-9453-1e94c6256efd None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:46:06.080386 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84b2a2-4aa3-4d05-9453-1e94c6256efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:46:06.103862 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-cb84b2a2-4aa3-4d05-9453-1e94c6256efd None None] MFA Rules not processed for user `fa7dedfceea346ca997eedec181935c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:46:06.105219 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-cb84b2a2-4aa3-4d05-9453-1e94c6256efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:46:06.111839 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1325/2646] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Dec 16 14:46:06 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:46:06.124291 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e0429-b619-404f-a880-646db6dfb8ca service neutron] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:46:06.137248 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e0429-b619-404f-a880-646db6dfb8ca service neutron] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:46:06.142159 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407797d-ec00-45a7-bdbc-110f4eacb323 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de4c90e44b96488aa47fbbc302e4f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:46:06.142832 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407797d-ec00-45a7-bdbc-110f4eacb323 service swift] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:46:06.143196 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407797d-ec00-45a7-bdbc-110f4eacb323 service swift] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:46:06.143549 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407797d-ec00-45a7-bdbc-110f4eacb323 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:46:06.153033 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407797d-ec00-45a7-bdbc-110f4eacb323 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:46:06.154648 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407797d-ec00-45a7-bdbc-110f4eacb323 service swift] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:46:06.163185 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1322/2647] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Dec 16 14:46:06 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 16 14:46:21.809360 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4bb76-9c0a-4710-b3d8-5c0a8e561332 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:46:21.810215 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4bb76-9c0a-4710-b3d8-5c0a8e561332 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:46:21.810506 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4bb76-9c0a-4710-b3d8-5c0a8e561332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:46:21.833001 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-8ba4bb76-9c0a-4710-b3d8-5c0a8e561332 None None] MFA Rules not processed for user `fa7dedfceea346ca997eedec181935c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:46:21.834152 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-8ba4bb76-9c0a-4710-b3d8-5c0a8e561332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:46:21.841433 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1326/2648] 10.222.0.64 () {58 vars in 967 bytes} [Thu Dec 16 14:46:21 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:46:21.853591 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407797d-ec00-45a7-bdbc-110f4eacb323 service swift] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:46:21.863518 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407797d-ec00-45a7-bdbc-110f4eacb323 service swift] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:46:21.869764 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfdf03-f176-4fa8-b16d-20f8be263b44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de4c90e44b96488aa47fbbc302e4f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:46:21.870346 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfdf03-f176-4fa8-b16d-20f8be263b44 service swift] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:46:21.870639 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfdf03-f176-4fa8-b16d-20f8be263b44 service swift] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:46:21.870923 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfdf03-f176-4fa8-b16d-20f8be263b44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:46:21.879463 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccfdf03-f176-4fa8-b16d-20f8be263b44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:46:21.881057 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccfdf03-f176-4fa8-b16d-20f8be263b44 service swift] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:46:21.889435 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1323/2649] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Dec 16 14:46:21 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:46:47.469210 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f026f-046d-459d-a308-ec197dc7f123 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:46:47.469707 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f026f-046d-459d-a308-ec197dc7f123 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:46:47.469812 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f026f-046d-459d-a308-ec197dc7f123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:46:47.491597 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-969f026f-046d-459d-a308-ec197dc7f123 None None] MFA Rules not processed for user `fa7dedfceea346ca997eedec181935c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:46:47.492736 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-969f026f-046d-459d-a308-ec197dc7f123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:46:47.499771 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1327/2650] 10.222.0.64 () {58 vars in 967 bytes} [Thu Dec 16 14:46:47 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:46:47.512191 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfdf03-f176-4fa8-b16d-20f8be263b44 service swift] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:46:47.522303 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfdf03-f176-4fa8-b16d-20f8be263b44 service swift] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:46:47.527096 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e98710-9246-4028-a711-7ce018984c7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de4c90e44b96488aa47fbbc302e4f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:46:47.527708 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e98710-9246-4028-a711-7ce018984c7a service swift] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:46:47.528002 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e98710-9246-4028-a711-7ce018984c7a service swift] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:46:47.528535 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e98710-9246-4028-a711-7ce018984c7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:46:47.537017 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e98710-9246-4028-a711-7ce018984c7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:46:47.538611 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e98710-9246-4028-a711-7ce018984c7a service swift] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:46:47.546424 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1324/2651] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Dec 16 14:46:47 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:46:58.708306 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f026f-046d-459d-a308-ec197dc7f123 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:46:58.709791 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-969f026f-046d-459d-a308-ec197dc7f123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:46:58.826645 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f026f-046d-459d-a308-ec197dc7f123 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:46:58.831901 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c082a-42c0-4346-a01a-fe3c2a26081b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:46:58.832835 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c082a-42c0-4346-a01a-fe3c2a26081b admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:46:58.833233 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c082a-42c0-4346-a01a-fe3c2a26081b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:46:58.833523 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c082a-42c0-4346-a01a-fe3c2a26081b admin admin] PATH_INFO: `/v3/users/c993a63eecd0427bb688f1fd6d435168` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:46:58.834711 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c082a-42c0-4346-a01a-fe3c2a26081b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c993a63eecd0427bb688f1fd6d435168)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:46:58.837299 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c082a-42c0-4346-a01a-fe3c2a26081b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:46:58.895780 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-f68c082a-42c0-4346-a01a-fe3c2a26081b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c993a63eecd0427bb688f1fd6d435168'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:46:58.901486 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-f68c082a-42c0-4346-a01a-fe3c2a26081b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c993a63eecd0427bb688f1fd6d435168'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:46:58.915136 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-f68c082a-42c0-4346-a01a-fe3c2a26081b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c993a63eecd0427bb688f1fd6d435168'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:46:58.923345 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-f68c082a-42c0-4346-a01a-fe3c2a26081b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c993a63eecd0427bb688f1fd6d435168'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:46:58.931391 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-f68c082a-42c0-4346-a01a-fe3c2a26081b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c993a63eecd0427bb688f1fd6d435168'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:46:58.937872 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1328/2652] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:46:58 2021] DELETE /identity/v3/users/c993a63eecd0427bb688f1fd6d435168 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:46:59.194290 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e98710-9246-4028-a711-7ce018984c7a service swift] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:46:59.205749 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e98710-9246-4028-a711-7ce018984c7a service swift] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:46:59.274816 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5114d8a-3a23-47dd-85f4-41ca2d681bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:46:59.275641 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5114d8a-3a23-47dd-85f4-41ca2d681bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:46:59.275930 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5114d8a-3a23-47dd-85f4-41ca2d681bde admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:46:59.276213 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5114d8a-3a23-47dd-85f4-41ca2d681bde admin admin] PATH_INFO: `/v3/projects/90b1e0c2f8144613a8e65e6b0e208a87` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:46:59.277366 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5114d8a-3a23-47dd-85f4-41ca2d681bde admin admin] RBAC: Authorizing `identity:delete_project(project_id=90b1e0c2f8144613a8e65e6b0e208a87)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:46:59.279940 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5114d8a-3a23-47dd-85f4-41ca2d681bde admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:46:59.331158 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-d5114d8a-3a23-47dd-85f4-41ca2d681bde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90b1e0c2f8144613a8e65e6b0e208a87', 'request_id': 'req-d5114d8a-3a23-47dd-85f4-41ca2d681bde'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:46:59.343272 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-d5114d8a-3a23-47dd-85f4-41ca2d681bde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90b1e0c2f8144613a8e65e6b0e208a87', 'request_id': 'req-d5114d8a-3a23-47dd-85f4-41ca2d681bde'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:46:59.348332 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-d5114d8a-3a23-47dd-85f4-41ca2d681bde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90b1e0c2f8144613a8e65e6b0e208a87', 'request_id': 'req-d5114d8a-3a23-47dd-85f4-41ca2d681bde'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:46:59.360968 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-d5114d8a-3a23-47dd-85f4-41ca2d681bde admin admin] The token cache is being invalidate because project 90b1e0c2f8144613a8e65e6b0e208a87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:46:59.361180 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-d5114d8a-3a23-47dd-85f4-41ca2d681bde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:46:59.361806 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-d5114d8a-3a23-47dd-85f4-41ca2d681bde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:46:59.364007 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1325/2653] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:46:59 2021] DELETE /identity/v3/projects/90b1e0c2f8144613a8e65e6b0e208a87 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:46:59.368374 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c082a-42c0-4346-a01a-fe3c2a26081b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:46:59.370207 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-f68c082a-42c0-4346-a01a-fe3c2a26081b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:46:59.382822 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c082a-42c0-4346-a01a-fe3c2a26081b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:46:59.446852 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1eba8-7f63-4eb0-b184-bc0a3e188ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:46:59.447677 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1eba8-7f63-4eb0-b184-bc0a3e188ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:46:59.447964 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1eba8-7f63-4eb0-b184-bc0a3e188ead admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:46:59.448251 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1eba8-7f63-4eb0-b184-bc0a3e188ead admin admin] PATH_INFO: `/v3/users/099b9345883a443cb28eda6c85005683` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:46:59.449414 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1eba8-7f63-4eb0-b184-bc0a3e188ead admin admin] RBAC: Authorizing `identity:delete_user(user_id=099b9345883a443cb28eda6c85005683)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:46:59.451979 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1eba8-7f63-4eb0-b184-bc0a3e188ead admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:46:59.499926 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-45a1eba8-7f63-4eb0-b184-bc0a3e188ead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '099b9345883a443cb28eda6c85005683'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:46:59.500566 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-45a1eba8-7f63-4eb0-b184-bc0a3e188ead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '099b9345883a443cb28eda6c85005683'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:46:59.512194 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-45a1eba8-7f63-4eb0-b184-bc0a3e188ead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '099b9345883a443cb28eda6c85005683'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:46:59.520652 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-45a1eba8-7f63-4eb0-b184-bc0a3e188ead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '099b9345883a443cb28eda6c85005683'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:46:59.528090 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-45a1eba8-7f63-4eb0-b184-bc0a3e188ead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '099b9345883a443cb28eda6c85005683'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:46:59.534802 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1329/2654] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:46:59 2021] DELETE /identity/v3/users/099b9345883a443cb28eda6c85005683 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:46:59.934430 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5114d8a-3a23-47dd-85f4-41ca2d681bde admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:46:59.936823 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-d5114d8a-3a23-47dd-85f4-41ca2d681bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:46:59.950782 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5114d8a-3a23-47dd-85f4-41ca2d681bde admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:47:00.020754 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed544556-5d35-4038-9569-b999dfeff33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:47:00.021876 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed544556-5d35-4038-9569-b999dfeff33b admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:47:00.022178 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed544556-5d35-4038-9569-b999dfeff33b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:47:00.022520 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed544556-5d35-4038-9569-b999dfeff33b admin admin] PATH_INFO: `/v3/projects/b7c077a4a4cb41c88ca8e94033742898` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:47:00.024132 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed544556-5d35-4038-9569-b999dfeff33b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7c077a4a4cb41c88ca8e94033742898)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:47:00.026517 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed544556-5d35-4038-9569-b999dfeff33b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:47:00.085603 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ed544556-5d35-4038-9569-b999dfeff33b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7c077a4a4cb41c88ca8e94033742898', 'request_id': 'req-ed544556-5d35-4038-9569-b999dfeff33b'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:47:00.098439 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ed544556-5d35-4038-9569-b999dfeff33b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7c077a4a4cb41c88ca8e94033742898', 'request_id': 'req-ed544556-5d35-4038-9569-b999dfeff33b'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:47:00.104234 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ed544556-5d35-4038-9569-b999dfeff33b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7c077a4a4cb41c88ca8e94033742898', 'request_id': 'req-ed544556-5d35-4038-9569-b999dfeff33b'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:47:00.119807 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ed544556-5d35-4038-9569-b999dfeff33b admin admin] The token cache is being invalidate because project b7c077a4a4cb41c88ca8e94033742898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:47:00.120035 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ed544556-5d35-4038-9569-b999dfeff33b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:47:00.120609 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ed544556-5d35-4038-9569-b999dfeff33b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:47:00.122088 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1326/2655] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:46:59 2021] DELETE /identity/v3/projects/b7c077a4a4cb41c88ca8e94033742898 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:47:04.505348 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1eba8-7f63-4eb0-b184-bc0a3e188ead admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:47:04.506700 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-45a1eba8-7f63-4eb0-b184-bc0a3e188ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:47:04.572317 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1eba8-7f63-4eb0-b184-bc0a3e188ead admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:47:04.626212 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff441c-aef8-47ce-a177-b69f4b70fff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:47:04.626793 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff441c-aef8-47ce-a177-b69f4b70fff9 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:47:04.627081 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff441c-aef8-47ce-a177-b69f4b70fff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:47:04.627362 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff441c-aef8-47ce-a177-b69f4b70fff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:47:04.629075 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-7eff441c-aef8-47ce-a177-b69f4b70fff9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:47:04.697983 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff441c-aef8-47ce-a177-b69f4b70fff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:47:04.699419 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff441c-aef8-47ce-a177-b69f4b70fff9 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:47:04.708644 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1330/2656] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:47:04 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:47:09.692261 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed544556-5d35-4038-9569-b999dfeff33b admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:47:09.693839 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-ed544556-5d35-4038-9569-b999dfeff33b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:47:09.707089 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed544556-5d35-4038-9569-b999dfeff33b admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:47:09.711550 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231d820-ba0b-4ba9-b378-ffad67dc25a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:47:09.712373 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231d820-ba0b-4ba9-b378-ffad67dc25a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:47:09.712668 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231d820-ba0b-4ba9-b378-ffad67dc25a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:47:09.712998 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231d820-ba0b-4ba9-b378-ffad67dc25a3 admin admin] PATH_INFO: `/v3/users/18d85bcc0aeb413aa2ade769fd10e431` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:47:09.714185 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231d820-ba0b-4ba9-b378-ffad67dc25a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18d85bcc0aeb413aa2ade769fd10e431)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:47:09.716644 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231d820-ba0b-4ba9-b378-ffad67dc25a3 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:47:09.772423 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-6231d820-ba0b-4ba9-b378-ffad67dc25a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18d85bcc0aeb413aa2ade769fd10e431'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:47:09.773094 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-6231d820-ba0b-4ba9-b378-ffad67dc25a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18d85bcc0aeb413aa2ade769fd10e431'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:47:09.787083 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-6231d820-ba0b-4ba9-b378-ffad67dc25a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18d85bcc0aeb413aa2ade769fd10e431'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:47:09.794957 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-6231d820-ba0b-4ba9-b378-ffad67dc25a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18d85bcc0aeb413aa2ade769fd10e431'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:47:09.803822 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-6231d820-ba0b-4ba9-b378-ffad67dc25a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18d85bcc0aeb413aa2ade769fd10e431'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:47:09.810043 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1327/2657] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:47:09 2021] DELETE /identity/v3/users/18d85bcc0aeb413aa2ade769fd10e431 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:47:10.135732 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff441c-aef8-47ce-a177-b69f4b70fff9 service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:47:10.145998 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff441c-aef8-47ce-a177-b69f4b70fff9 service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:47:10.209986 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404986eb-78f4-48fd-8150-5bff7cab0ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:47:10.210771 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404986eb-78f4-48fd-8150-5bff7cab0ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:47:10.211056 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404986eb-78f4-48fd-8150-5bff7cab0ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:47:10.211345 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404986eb-78f4-48fd-8150-5bff7cab0ffc admin admin] PATH_INFO: `/v3/projects/431320546381414684830eb2bc36deef` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:47:10.212444 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404986eb-78f4-48fd-8150-5bff7cab0ffc admin admin] RBAC: Authorizing `identity:delete_project(project_id=431320546381414684830eb2bc36deef)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:47:10.214366 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404986eb-78f4-48fd-8150-5bff7cab0ffc admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:47:10.262638 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-404986eb-78f4-48fd-8150-5bff7cab0ffc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '431320546381414684830eb2bc36deef', 'request_id': 'req-404986eb-78f4-48fd-8150-5bff7cab0ffc'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:47:10.269172 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-404986eb-78f4-48fd-8150-5bff7cab0ffc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '431320546381414684830eb2bc36deef', 'request_id': 'req-404986eb-78f4-48fd-8150-5bff7cab0ffc'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:47:10.276270 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-404986eb-78f4-48fd-8150-5bff7cab0ffc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '431320546381414684830eb2bc36deef', 'request_id': 'req-404986eb-78f4-48fd-8150-5bff7cab0ffc'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:47:10.292293 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-404986eb-78f4-48fd-8150-5bff7cab0ffc admin admin] The token cache is being invalidate because project 431320546381414684830eb2bc36deef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:47:10.292513 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-404986eb-78f4-48fd-8150-5bff7cab0ffc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:47:10.293192 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-404986eb-78f4-48fd-8150-5bff7cab0ffc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:47:10.294666 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1331/2658] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:47:10 2021] DELETE /identity/v3/projects/431320546381414684830eb2bc36deef => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:47:10.301045 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014d903-acae-4977-9169-02f9b51a6c83 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:47:10.301336 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014d903-acae-4977-9169-02f9b51a6c83 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:47:10.301617 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014d903-acae-4977-9169-02f9b51a6c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:47:10.323833 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-8014d903-acae-4977-9169-02f9b51a6c83 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:47:10.325002 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-8014d903-acae-4977-9169-02f9b51a6c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:47:10.389088 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1328/2659] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:47:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:47:10.397093 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93971ff-bda1-4f8d-a9d8-3d8884d40b6f None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:47:10.397506 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93971ff-bda1-4f8d-a9d8-3d8884d40b6f None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:47:10.397679 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93971ff-bda1-4f8d-a9d8-3d8884d40b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:47:10.419832 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-f93971ff-bda1-4f8d-a9d8-3d8884d40b6f None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:47:10.421504 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-f93971ff-bda1-4f8d-a9d8-3d8884d40b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:47:10.428750 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1332/2660] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:47:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:47:10.433190 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014d903-acae-4977-9169-02f9b51a6c83 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:47:10.443244 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014d903-acae-4977-9169-02f9b51a6c83 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:47:10.447529 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebde93-bbf6-4932-8707-a967825192ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:47:10.448104 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebde93-bbf6-4932-8707-a967825192ea admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:47:10.448392 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebde93-bbf6-4932-8707-a967825192ea admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:47:10.448672 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebde93-bbf6-4932-8707-a967825192ea admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:47:10.449378 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebde93-bbf6-4932-8707-a967825192ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:47:10.449676 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebde93-bbf6-4932-8707-a967825192ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:47:10.451228 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebde93-bbf6-4932-8707-a967825192ea admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:47:10.464879 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1329/2661] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:47:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:47:10.469448 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93971ff-bda1-4f8d-a9d8-3d8884d40b6f None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:47:10.478472 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93971ff-bda1-4f8d-a9d8-3d8884d40b6f None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:47:10.483427 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff26d0d-1fd1-461c-8788-edef4cd45f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:47:10.484009 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff26d0d-1fd1-461c-8788-edef4cd45f8e admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:47:10.484298 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff26d0d-1fd1-461c-8788-edef4cd45f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:47:10.484580 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff26d0d-1fd1-461c-8788-edef4cd45f8e admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:47:10.485254 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff26d0d-1fd1-461c-8788-edef4cd45f8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:47:10.487138 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff26d0d-1fd1-461c-8788-edef4cd45f8e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:47:10.524191 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1333/2662] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:47:10 2021] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:47:10.529075 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebde93-bbf6-4932-8707-a967825192ea admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:47:10.538826 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebde93-bbf6-4932-8707-a967825192ea admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:47:10.600374 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de768150-3454-472e-99bd-77d0e4bd34bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:47:10.600918 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de768150-3454-472e-99bd-77d0e4bd34bd admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:47:10.601204 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de768150-3454-472e-99bd-77d0e4bd34bd admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:47:10.601489 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de768150-3454-472e-99bd-77d0e4bd34bd admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:47:10.602129 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de768150-3454-472e-99bd-77d0e4bd34bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:47:10.604009 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de768150-3454-472e-99bd-77d0e4bd34bd admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:47:10.624559 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1330/2663] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:47:10 2021] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:47:10.628809 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff26d0d-1fd1-461c-8788-edef4cd45f8e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:47:10.638709 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff26d0d-1fd1-461c-8788-edef4cd45f8e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:47:10.643029 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ee570-0ac7-4d0c-8bc2-92992dab452b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:47:10.643618 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ee570-0ac7-4d0c-8bc2-92992dab452b admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:47:10.643904 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ee570-0ac7-4d0c-8bc2-92992dab452b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:47:10.644186 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ee570-0ac7-4d0c-8bc2-92992dab452b admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:47:10.645022 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ee570-0ac7-4d0c-8bc2-92992dab452b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:47:10.646596 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ee570-0ac7-4d0c-8bc2-92992dab452b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:47:10.657798 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1334/2664] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:47:10 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:47:10.661823 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de768150-3454-472e-99bd-77d0e4bd34bd admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:47:10.672078 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de768150-3454-472e-99bd-77d0e4bd34bd admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:47:10.676446 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9cef9-d61b-43ce-b53d-b8faf061940e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:47:10.677072 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9cef9-d61b-43ce-b53d-b8faf061940e admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:47:10.677362 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9cef9-d61b-43ce-b53d-b8faf061940e admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:47:10.677643 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9cef9-d61b-43ce-b53d-b8faf061940e admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:47:10.678327 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9cef9-d61b-43ce-b53d-b8faf061940e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:47:10.679887 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9cef9-d61b-43ce-b53d-b8faf061940e admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:47:10.689981 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1331/2665] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:47:10 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:47:10.694054 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ee570-0ac7-4d0c-8bc2-92992dab452b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:47:10.703690 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ee570-0ac7-4d0c-8bc2-92992dab452b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:47:10.708111 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8e2db-693d-4e7c-b820-0d8109452882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:47:10.708959 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8e2db-693d-4e7c-b820-0d8109452882 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:47:10.709249 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8e2db-693d-4e7c-b820-0d8109452882 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:47:10.709532 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8e2db-693d-4e7c-b820-0d8109452882 admin admin] PATH_INFO: `/v3/projects/bb0a577a94a04b3eaaaf2d2347f21e44/users/48319d5dcda64acebea9bb3daad1889b/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:47:10.729273 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8e2db-693d-4e7c-b820-0d8109452882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb0a577a94a04b3eaaaf2d2347f21e44, user_id=48319d5dcda64acebea9bb3daad1889b, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:47:10.731918 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8e2db-693d-4e7c-b820-0d8109452882 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:47:10.744757 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1335/2666] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:47:10 2021] PUT /identity/v3/projects/bb0a577a94a04b3eaaaf2d2347f21e44/users/48319d5dcda64acebea9bb3daad1889b/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:47:10.749867 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33fe1b-2eb8-403f-ae2d-af939641fcf8 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:47:10.750327 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33fe1b-2eb8-403f-ae2d-af939641fcf8 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:47:10.750465 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33fe1b-2eb8-403f-ae2d-af939641fcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:47:10.771940 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-8e33fe1b-2eb8-403f-ae2d-af939641fcf8 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:47:10.773122 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-8e33fe1b-2eb8-403f-ae2d-af939641fcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:47:10.838014 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1332/2667] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:47:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:47:10.848841 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8e2db-693d-4e7c-b820-0d8109452882 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:47:10.850558 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-82e8e2db-693d-4e7c-b820-0d8109452882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:47:10.915099 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8e2db-693d-4e7c-b820-0d8109452882 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:47:10.918681 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8ff89-e885-480e-898e-af7fcdec9933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:47:10.919413 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8ff89-e885-480e-898e-af7fcdec9933 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:47:10.919555 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8ff89-e885-480e-898e-af7fcdec9933 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:47:10.919841 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8ff89-e885-480e-898e-af7fcdec9933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:47:10.930196 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e8ff89-e885-480e-898e-af7fcdec9933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:47:10.931682 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e8ff89-e885-480e-898e-af7fcdec9933 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:47:10.940739 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1336/2668] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:47:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:47:16.704728 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a169df7-5ec5-47c1-a77e-a69ddb4fd681 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:47:16.705234 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a169df7-5ec5-47c1-a77e-a69ddb4fd681 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:47:16.705352 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a169df7-5ec5-47c1-a77e-a69ddb4fd681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:47:16.741172 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-4a169df7-5ec5-47c1-a77e-a69ddb4fd681 None None] MFA Rules not processed for user `48319d5dcda64acebea9bb3daad1889b`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:47:16.742342 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-4a169df7-5ec5-47c1-a77e-a69ddb4fd681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:47:16.816204 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1333/2669] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:47:16 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:47:16.827713 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8ff89-e885-480e-898e-af7fcdec9933 service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:47:16.829280 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-32e8ff89-e885-480e-898e-af7fcdec9933 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:47:16.924287 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8ff89-e885-480e-898e-af7fcdec9933 service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:47:16.929477 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cec0b-6475-417d-b8e6-7e7753d6cb02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:47:16.930058 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cec0b-6475-417d-b8e6-7e7753d6cb02 service nova] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:47:16.930348 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cec0b-6475-417d-b8e6-7e7753d6cb02 service nova] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:47:16.930633 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cec0b-6475-417d-b8e6-7e7753d6cb02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:47:16.938384 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1cec0b-6475-417d-b8e6-7e7753d6cb02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:47:16.939947 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1cec0b-6475-417d-b8e6-7e7753d6cb02 service nova] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:47:16.948849 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1337/2670] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:47:16 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:47:19.044539 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d40da-d9dd-469a-969f-535e42479135 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:47:19.045444 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d40da-d9dd-469a-969f-535e42479135 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:47:19.045979 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d40da-d9dd-469a-969f-535e42479135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:47:19.071524 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-9b4d40da-d9dd-469a-969f-535e42479135 None None] MFA Rules not processed for user `48319d5dcda64acebea9bb3daad1889b`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:47:19.072701 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-9b4d40da-d9dd-469a-969f-535e42479135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:47:19.080656 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1334/2671] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:47:19 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:47:19.646820 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cec0b-6475-417d-b8e6-7e7753d6cb02 service nova] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:47:19.649218 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-1d1cec0b-6475-417d-b8e6-7e7753d6cb02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:47:19.686831 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cec0b-6475-417d-b8e6-7e7753d6cb02 service nova] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:47:19.690665 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a9dc8-c360-428c-9fba-b818514c3cbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:47:19.691354 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a9dc8-c360-428c-9fba-b818514c3cbe service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:47:19.691863 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a9dc8-c360-428c-9fba-b818514c3cbe service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:47:19.692214 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a9dc8-c360-428c-9fba-b818514c3cbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:47:19.694824 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-799a9dc8-c360-428c-9fba-b818514c3cbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:47:19.718539 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a9dc8-c360-428c-9fba-b818514c3cbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:47:19.720946 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a9dc8-c360-428c-9fba-b818514c3cbe service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:47:19.741204 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1338/2672] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:47:19 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:47:36.480924 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d40da-d9dd-469a-969f-535e42479135 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:47:36.482235 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-9b4d40da-d9dd-469a-969f-535e42479135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:47:36.558528 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d40da-d9dd-469a-969f-535e42479135 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:47:36.563220 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec05e7-8eec-4739-a3af-63730a2962d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9a2114d29c4edeb20f394140d390bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:47:36.563798 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec05e7-8eec-4739-a3af-63730a2962d5 service placement] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:47:36.564606 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec05e7-8eec-4739-a3af-63730a2962d5 service placement] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:47:36.564922 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec05e7-8eec-4739-a3af-63730a2962d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:47:36.566553 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-deec05e7-8eec-4739-a3af-63730a2962d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:47:36.577167 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec05e7-8eec-4739-a3af-63730a2962d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:47:36.578716 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec05e7-8eec-4739-a3af-63730a2962d5 service placement] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:47:36.588422 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1335/2673] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:47:36 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:49:11.444512 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a9dc8-c360-428c-9fba-b818514c3cbe service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:11.453115 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a9dc8-c360-428c-9fba-b818514c3cbe service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:11.457265 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb341c-7279-46a7-9b1d-3bc6fbd1411e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:11.457835 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb341c-7279-46a7-9b1d-3bc6fbd1411e service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:11.458129 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb341c-7279-46a7-9b1d-3bc6fbd1411e service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:11.458420 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb341c-7279-46a7-9b1d-3bc6fbd1411e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:11.460085 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-82eb341c-7279-46a7-9b1d-3bc6fbd1411e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:11.471122 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb341c-7279-46a7-9b1d-3bc6fbd1411e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:11.472542 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb341c-7279-46a7-9b1d-3bc6fbd1411e service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:49:11.481871 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1339/2674] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:49:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:49:22.044139 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec05e7-8eec-4739-a3af-63730a2962d5 service placement] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:22.045587 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-deec05e7-8eec-4739-a3af-63730a2962d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:22.058769 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec05e7-8eec-4739-a3af-63730a2962d5 service placement] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:22.063205 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63885315-4054-4082-a649-5f1a6479be37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:22.064010 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63885315-4054-4082-a649-5f1a6479be37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:22.064298 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63885315-4054-4082-a649-5f1a6479be37 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:22.064616 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63885315-4054-4082-a649-5f1a6479be37 admin admin] PATH_INFO: `/v3/users/c00d30670c444605a25d63560d82fcbf` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:22.065844 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63885315-4054-4082-a649-5f1a6479be37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c00d30670c444605a25d63560d82fcbf)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:22.067809 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63885315-4054-4082-a649-5f1a6479be37 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:49:22.115752 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-63885315-4054-4082-a649-5f1a6479be37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c00d30670c444605a25d63560d82fcbf'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:22.116411 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-63885315-4054-4082-a649-5f1a6479be37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c00d30670c444605a25d63560d82fcbf'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:22.127799 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-63885315-4054-4082-a649-5f1a6479be37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c00d30670c444605a25d63560d82fcbf'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:22.134763 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-63885315-4054-4082-a649-5f1a6479be37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c00d30670c444605a25d63560d82fcbf'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:22.142734 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-63885315-4054-4082-a649-5f1a6479be37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c00d30670c444605a25d63560d82fcbf'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:22.148983 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1336/2675] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:49:22 2021] DELETE /identity/v3/users/c00d30670c444605a25d63560d82fcbf => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:49:22.370134 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb341c-7279-46a7-9b1d-3bc6fbd1411e service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:22.379605 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb341c-7279-46a7-9b1d-3bc6fbd1411e service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:22.446692 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f911e1-5d7f-43af-89ea-2865c005f0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:22.447490 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f911e1-5d7f-43af-89ea-2865c005f0d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:22.447776 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f911e1-5d7f-43af-89ea-2865c005f0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:22.448070 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f911e1-5d7f-43af-89ea-2865c005f0d2 admin admin] PATH_INFO: `/v3/projects/46480af5f9db43618ad0897695518251` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:22.449224 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f911e1-5d7f-43af-89ea-2865c005f0d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46480af5f9db43618ad0897695518251)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:22.451152 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f911e1-5d7f-43af-89ea-2865c005f0d2 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:49:22.502544 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-04f911e1-5d7f-43af-89ea-2865c005f0d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46480af5f9db43618ad0897695518251', 'request_id': 'req-04f911e1-5d7f-43af-89ea-2865c005f0d2'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:22.507995 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-04f911e1-5d7f-43af-89ea-2865c005f0d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46480af5f9db43618ad0897695518251', 'request_id': 'req-04f911e1-5d7f-43af-89ea-2865c005f0d2'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:22.516088 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-04f911e1-5d7f-43af-89ea-2865c005f0d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46480af5f9db43618ad0897695518251', 'request_id': 'req-04f911e1-5d7f-43af-89ea-2865c005f0d2'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:22.534730 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-04f911e1-5d7f-43af-89ea-2865c005f0d2 admin admin] The token cache is being invalidate because project 46480af5f9db43618ad0897695518251 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:49:22.535020 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-04f911e1-5d7f-43af-89ea-2865c005f0d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:22.535701 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-04f911e1-5d7f-43af-89ea-2865c005f0d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:22.537414 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1340/2676] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:49:22 2021] DELETE /identity/v3/projects/46480af5f9db43618ad0897695518251 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:49:22.541357 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63885315-4054-4082-a649-5f1a6479be37 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:22.542690 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-63885315-4054-4082-a649-5f1a6479be37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:22.555508 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63885315-4054-4082-a649-5f1a6479be37 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:22.623716 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5cc5d-18d7-47c4-b1a3-b9fdc6f198bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:22.624530 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5cc5d-18d7-47c4-b1a3-b9fdc6f198bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:22.624851 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5cc5d-18d7-47c4-b1a3-b9fdc6f198bd admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:22.625135 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5cc5d-18d7-47c4-b1a3-b9fdc6f198bd admin admin] PATH_INFO: `/v3/users/6e5e9e91777c4aa2ae9c3fb2471df9ff` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:22.626265 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5cc5d-18d7-47c4-b1a3-b9fdc6f198bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e5e9e91777c4aa2ae9c3fb2471df9ff)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:22.628740 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5cc5d-18d7-47c4-b1a3-b9fdc6f198bd admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:49:22.682595 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-dcd5cc5d-18d7-47c4-b1a3-b9fdc6f198bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e5e9e91777c4aa2ae9c3fb2471df9ff'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:22.683251 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-dcd5cc5d-18d7-47c4-b1a3-b9fdc6f198bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e5e9e91777c4aa2ae9c3fb2471df9ff'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:22.695735 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-dcd5cc5d-18d7-47c4-b1a3-b9fdc6f198bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e5e9e91777c4aa2ae9c3fb2471df9ff'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:22.706464 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-dcd5cc5d-18d7-47c4-b1a3-b9fdc6f198bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e5e9e91777c4aa2ae9c3fb2471df9ff'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:22.715401 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-dcd5cc5d-18d7-47c4-b1a3-b9fdc6f198bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e5e9e91777c4aa2ae9c3fb2471df9ff'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:22.721486 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1337/2677] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:49:22 2021] DELETE /identity/v3/users/6e5e9e91777c4aa2ae9c3fb2471df9ff => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:49:23.160234 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f911e1-5d7f-43af-89ea-2865c005f0d2 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:23.162304 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-04f911e1-5d7f-43af-89ea-2865c005f0d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:23.176493 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f911e1-5d7f-43af-89ea-2865c005f0d2 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:23.243401 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c7755-53fc-4305-8522-cbcb6a682463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:23.243855 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c7755-53fc-4305-8522-cbcb6a682463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:23.244172 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c7755-53fc-4305-8522-cbcb6a682463 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:23.244472 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c7755-53fc-4305-8522-cbcb6a682463 admin admin] PATH_INFO: `/v3/projects/480d2c7547e541e190f2af602bbff8e5` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:23.245619 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c7755-53fc-4305-8522-cbcb6a682463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=480d2c7547e541e190f2af602bbff8e5)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:23.247528 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c7755-53fc-4305-8522-cbcb6a682463 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:49:23.302722 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-b37c7755-53fc-4305-8522-cbcb6a682463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '480d2c7547e541e190f2af602bbff8e5', 'request_id': 'req-b37c7755-53fc-4305-8522-cbcb6a682463'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:23.308535 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-b37c7755-53fc-4305-8522-cbcb6a682463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '480d2c7547e541e190f2af602bbff8e5', 'request_id': 'req-b37c7755-53fc-4305-8522-cbcb6a682463'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:23.317172 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-b37c7755-53fc-4305-8522-cbcb6a682463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '480d2c7547e541e190f2af602bbff8e5', 'request_id': 'req-b37c7755-53fc-4305-8522-cbcb6a682463'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:23.335882 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-b37c7755-53fc-4305-8522-cbcb6a682463 admin admin] The token cache is being invalidate because project 480d2c7547e541e190f2af602bbff8e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:49:23.336168 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-b37c7755-53fc-4305-8522-cbcb6a682463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:23.336829 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-b37c7755-53fc-4305-8522-cbcb6a682463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:23.338297 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1341/2678] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:49:23 2021] DELETE /identity/v3/projects/480d2c7547e541e190f2af602bbff8e5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:49:23.344139 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea9f02-e5ed-4d20-a1c5-34c1dcc56dcf None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:23.344637 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea9f02-e5ed-4d20-a1c5-34c1dcc56dcf None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:23.344757 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea9f02-e5ed-4d20-a1c5-34c1dcc56dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:23.368274 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-ebea9f02-e5ed-4d20-a1c5-34c1dcc56dcf None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:49:23.369486 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-ebea9f02-e5ed-4d20-a1c5-34c1dcc56dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:23.436923 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1338/2679] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:49:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:49:23.444699 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b686a34-fbe8-4e40-83ab-695e809609a8 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:23.445216 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b686a34-fbe8-4e40-83ab-695e809609a8 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:23.445433 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b686a34-fbe8-4e40-83ab-695e809609a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:23.467499 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-1b686a34-fbe8-4e40-83ab-695e809609a8 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:49:23.468700 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-1b686a34-fbe8-4e40-83ab-695e809609a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:23.476476 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1342/2680] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:49:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:49:23.480866 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea9f02-e5ed-4d20-a1c5-34c1dcc56dcf None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:23.490837 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea9f02-e5ed-4d20-a1c5-34c1dcc56dcf None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:23.495181 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f3b26-87e1-4eeb-bb0e-015668623408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:23.495768 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f3b26-87e1-4eeb-bb0e-015668623408 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:23.496060 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f3b26-87e1-4eeb-bb0e-015668623408 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:23.496345 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f3b26-87e1-4eeb-bb0e-015668623408 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:23.497065 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f3b26-87e1-4eeb-bb0e-015668623408 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:49:23.497372 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f3b26-87e1-4eeb-bb0e-015668623408 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:23.498941 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f3b26-87e1-4eeb-bb0e-015668623408 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:49:23.511505 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1339/2681] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:49:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:49:23.515753 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b686a34-fbe8-4e40-83ab-695e809609a8 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:23.524630 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b686a34-fbe8-4e40-83ab-695e809609a8 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:23.529139 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e72665-34a6-43cb-9ca3-dd8ce22fe1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:23.529734 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e72665-34a6-43cb-9ca3-dd8ce22fe1b4 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:23.530027 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e72665-34a6-43cb-9ca3-dd8ce22fe1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:23.530312 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e72665-34a6-43cb-9ca3-dd8ce22fe1b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:23.530962 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e72665-34a6-43cb-9ca3-dd8ce22fe1b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:23.532949 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e72665-34a6-43cb-9ca3-dd8ce22fe1b4 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:49:23.560677 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1343/2682] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:49:23 2021] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:49:23.564878 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f3b26-87e1-4eeb-bb0e-015668623408 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:23.574300 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f3b26-87e1-4eeb-bb0e-015668623408 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:23.637611 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512e879-cb1e-4997-ab12-204450651737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:23.638215 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512e879-cb1e-4997-ab12-204450651737 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:23.638508 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512e879-cb1e-4997-ab12-204450651737 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:23.638793 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512e879-cb1e-4997-ab12-204450651737 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:23.639441 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512e879-cb1e-4997-ab12-204450651737 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:23.642872 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512e879-cb1e-4997-ab12-204450651737 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:49:23.667152 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1340/2683] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:49:23 2021] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:49:23.671597 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e72665-34a6-43cb-9ca3-dd8ce22fe1b4 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:23.682159 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e72665-34a6-43cb-9ca3-dd8ce22fe1b4 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:23.686549 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c4f2d-3a24-4023-832a-0ae688ca258b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:23.687138 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c4f2d-3a24-4023-832a-0ae688ca258b admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:23.687428 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c4f2d-3a24-4023-832a-0ae688ca258b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:23.687713 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c4f2d-3a24-4023-832a-0ae688ca258b admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:23.688407 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c4f2d-3a24-4023-832a-0ae688ca258b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:23.690053 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c4f2d-3a24-4023-832a-0ae688ca258b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:49:23.699972 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1344/2684] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:49:23 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:49:23.703968 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512e879-cb1e-4997-ab12-204450651737 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:23.714910 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512e879-cb1e-4997-ab12-204450651737 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:23.719336 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663bd0a-bd60-49a7-9fbe-14a9f31c1e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:23.719899 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663bd0a-bd60-49a7-9fbe-14a9f31c1e55 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:23.720186 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663bd0a-bd60-49a7-9fbe-14a9f31c1e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:23.720464 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663bd0a-bd60-49a7-9fbe-14a9f31c1e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:23.721742 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663bd0a-bd60-49a7-9fbe-14a9f31c1e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:23.723300 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663bd0a-bd60-49a7-9fbe-14a9f31c1e55 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:49:23.733363 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1341/2685] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:49:23 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:49:23.737610 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c4f2d-3a24-4023-832a-0ae688ca258b admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:23.747156 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c4f2d-3a24-4023-832a-0ae688ca258b admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:23.751567 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188d500-c401-4eee-b299-a38181a007e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:23.752386 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188d500-c401-4eee-b299-a38181a007e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:23.752679 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188d500-c401-4eee-b299-a38181a007e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:23.752978 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188d500-c401-4eee-b299-a38181a007e9 admin admin] PATH_INFO: `/v3/projects/d963a0aa72964047885ee0212d5055dc/users/ee703ae6a79f48cdb9438f504085e206/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:23.772656 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188d500-c401-4eee-b299-a38181a007e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d963a0aa72964047885ee0212d5055dc, user_id=ee703ae6a79f48cdb9438f504085e206, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:23.775337 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188d500-c401-4eee-b299-a38181a007e9 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:49:23.788773 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1345/2686] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:49:23 2021] PUT /identity/v3/projects/d963a0aa72964047885ee0212d5055dc/users/ee703ae6a79f48cdb9438f504085e206/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:49:23.793901 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8e61b-42b7-4e17-a98f-1776cf6a7a9c None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:23.794208 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8e61b-42b7-4e17-a98f-1776cf6a7a9c None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:23.794496 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8e61b-42b7-4e17-a98f-1776cf6a7a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:23.817179 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-42c8e61b-42b7-4e17-a98f-1776cf6a7a9c None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:49:23.818272 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-42c8e61b-42b7-4e17-a98f-1776cf6a7a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:23.885492 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1342/2687] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:49:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:49:23.896722 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188d500-c401-4eee-b299-a38181a007e9 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:23.898764 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-5188d500-c401-4eee-b299-a38181a007e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:23.964754 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188d500-c401-4eee-b299-a38181a007e9 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:23.968342 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeee532-5e78-4cfc-b012-d2c099c1826c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:23.968966 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeee532-5e78-4cfc-b012-d2c099c1826c service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:23.969262 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeee532-5e78-4cfc-b012-d2c099c1826c service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:23.969550 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeee532-5e78-4cfc-b012-d2c099c1826c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:23.979345 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeee532-5e78-4cfc-b012-d2c099c1826c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:23.980810 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeee532-5e78-4cfc-b012-d2c099c1826c service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:49:23.989922 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1346/2688] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:49:23 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:49:30.686477 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5660d-1235-4527-94d3-a9ecb10a0b10 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:30.687016 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5660d-1235-4527-94d3-a9ecb10a0b10 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:30.687016 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5660d-1235-4527-94d3-a9ecb10a0b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:30.724415 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-46c5660d-1235-4527-94d3-a9ecb10a0b10 None None] MFA Rules not processed for user `ee703ae6a79f48cdb9438f504085e206`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:49:30.725606 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-46c5660d-1235-4527-94d3-a9ecb10a0b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:30.799958 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1343/2689] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:49:30 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:49:30.804500 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeee532-5e78-4cfc-b012-d2c099c1826c service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:30.816378 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeee532-5e78-4cfc-b012-d2c099c1826c service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:30.821376 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b337ea1-f35a-4eb3-a5b8-ae9b2763076a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:30.822221 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b337ea1-f35a-4eb3-a5b8-ae9b2763076a admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:30.822817 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b337ea1-f35a-4eb3-a5b8-ae9b2763076a admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:30.823267 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b337ea1-f35a-4eb3-a5b8-ae9b2763076a admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:30.824332 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b337ea1-f35a-4eb3-a5b8-ae9b2763076a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:30.827405 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b337ea1-f35a-4eb3-a5b8-ae9b2763076a admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:49:30.871656 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1347/2690] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:49:30 2021] POST /identity/v3/projects => generated 379 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:49:30.872623 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5660d-1235-4527-94d3-a9ecb10a0b10 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:30.885437 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5660d-1235-4527-94d3-a9ecb10a0b10 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:30.973489 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b2fe4-bcc9-4805-aa6e-16d43f1ed855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:30.974094 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b2fe4-bcc9-4805-aa6e-16d43f1ed855 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:30.974391 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b2fe4-bcc9-4805-aa6e-16d43f1ed855 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:30.974677 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b2fe4-bcc9-4805-aa6e-16d43f1ed855 admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:30.975314 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b2fe4-bcc9-4805-aa6e-16d43f1ed855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:30.977243 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b2fe4-bcc9-4805-aa6e-16d43f1ed855 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:49:30.997569 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1344/2691] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:49:30 2021] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:49:31.001324 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b337ea1-f35a-4eb3-a5b8-ae9b2763076a admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:31.012171 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b337ea1-f35a-4eb3-a5b8-ae9b2763076a admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:31.016919 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b723dee-da90-43c7-98ac-886e00fe2071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:31.017544 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b723dee-da90-43c7-98ac-886e00fe2071 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:31.018470 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b723dee-da90-43c7-98ac-886e00fe2071 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:31.018762 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b723dee-da90-43c7-98ac-886e00fe2071 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:31.019469 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b723dee-da90-43c7-98ac-886e00fe2071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:31.021103 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b723dee-da90-43c7-98ac-886e00fe2071 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:49:31.031559 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1348/2692] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:49:31 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:49:31.035829 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b2fe4-bcc9-4805-aa6e-16d43f1ed855 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:31.045376 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b2fe4-bcc9-4805-aa6e-16d43f1ed855 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:31.050006 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072fbbe-32f6-480b-8175-58ff46848a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:31.050818 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072fbbe-32f6-480b-8175-58ff46848a90 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:31.051109 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072fbbe-32f6-480b-8175-58ff46848a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:31.051396 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072fbbe-32f6-480b-8175-58ff46848a90 admin admin] PATH_INFO: `/v3/projects/e8b7a54394d34c20af37142d9c96b4b1/users/2d1a0fe9eeac491196c8263705935773/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:31.070782 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072fbbe-32f6-480b-8175-58ff46848a90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8b7a54394d34c20af37142d9c96b4b1, user_id=2d1a0fe9eeac491196c8263705935773, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:31.073633 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072fbbe-32f6-480b-8175-58ff46848a90 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:49:31.087507 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1345/2693] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:49:31 2021] PUT /identity/v3/projects/e8b7a54394d34c20af37142d9c96b4b1/users/2d1a0fe9eeac491196c8263705935773/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:49:31.091435 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b723dee-da90-43c7-98ac-886e00fe2071 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:31.101821 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b723dee-da90-43c7-98ac-886e00fe2071 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:31.166321 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab91211-494b-41e0-9a63-9a91a0c9daa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:31.166917 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab91211-494b-41e0-9a63-9a91a0c9daa7 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:31.167203 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab91211-494b-41e0-9a63-9a91a0c9daa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:31.167484 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab91211-494b-41e0-9a63-9a91a0c9daa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:31.168171 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab91211-494b-41e0-9a63-9a91a0c9daa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:31.169782 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab91211-494b-41e0-9a63-9a91a0c9daa7 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:49:31.180083 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1349/2694] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:49:31 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:49:31.184458 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072fbbe-32f6-480b-8175-58ff46848a90 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:31.195078 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072fbbe-32f6-480b-8175-58ff46848a90 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:31.199527 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a6368-5ac5-4682-a46a-7d0dd4c35302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:31.200344 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a6368-5ac5-4682-a46a-7d0dd4c35302 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:31.200727 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a6368-5ac5-4682-a46a-7d0dd4c35302 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:31.201048 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a6368-5ac5-4682-a46a-7d0dd4c35302 admin admin] PATH_INFO: `/v3/projects/e8b7a54394d34c20af37142d9c96b4b1/users/2d1a0fe9eeac491196c8263705935773/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:31.202817 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a6368-5ac5-4682-a46a-7d0dd4c35302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8b7a54394d34c20af37142d9c96b4b1, user_id=2d1a0fe9eeac491196c8263705935773, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:31.206036 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a6368-5ac5-4682-a46a-7d0dd4c35302 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:49:31.215951 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1346/2695] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:49:31 2021] PUT /identity/v3/projects/e8b7a54394d34c20af37142d9c96b4b1/users/2d1a0fe9eeac491196c8263705935773/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:49:37.469831 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7d22a-0b17-4702-8c06-6a4e0ce4a460 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:37.470280 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7d22a-0b17-4702-8c06-6a4e0ce4a460 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:37.470401 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7d22a-0b17-4702-8c06-6a4e0ce4a460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:37.505287 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-09c7d22a-0b17-4702-8c06-6a4e0ce4a460 None None] MFA Rules not processed for user `2d1a0fe9eeac491196c8263705935773`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:49:37.506434 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-09c7d22a-0b17-4702-8c06-6a4e0ce4a460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:37.581796 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1350/2696] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:49:37 2021] POST /identity/v3/auth/tokens => generated 3753 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:49:37.593034 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a6368-5ac5-4682-a46a-7d0dd4c35302 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:37.595269 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-f38a6368-5ac5-4682-a46a-7d0dd4c35302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:37.674252 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a6368-5ac5-4682-a46a-7d0dd4c35302 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:37.679514 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8086921-d3c0-4e38-80ab-c62493c092d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:37.680063 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8086921-d3c0-4e38-80ab-c62493c092d8 service nova] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:37.680376 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8086921-d3c0-4e38-80ab-c62493c092d8 service nova] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:37.680643 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8086921-d3c0-4e38-80ab-c62493c092d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:37.744342 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8086921-d3c0-4e38-80ab-c62493c092d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:37.745938 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8086921-d3c0-4e38-80ab-c62493c092d8 service nova] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:49:37.754902 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1347/2697] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:49:37 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:49:56.246694 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b828ce-023b-460a-aa84-2be22a882d53 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:56.247318 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b828ce-023b-460a-aa84-2be22a882d53 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:56.247318 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b828ce-023b-460a-aa84-2be22a882d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:56.269425 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-74b828ce-023b-460a-aa84-2be22a882d53 None None] MFA Rules not processed for user `ee703ae6a79f48cdb9438f504085e206`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:49:56.270653 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-74b828ce-023b-460a-aa84-2be22a882d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:56.277153 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1351/2698] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:49:56 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:49:56.325010 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8086921-d3c0-4e38-80ab-c62493c092d8 service nova] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:56.326287 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-a8086921-d3c0-4e38-80ab-c62493c092d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:56.391188 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8086921-d3c0-4e38-80ab-c62493c092d8 service nova] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:56.394715 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149fb0f-aabc-4696-93af-d3bad89e4db3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:56.395306 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149fb0f-aabc-4696-93af-d3bad89e4db3 service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:56.395592 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149fb0f-aabc-4696-93af-d3bad89e4db3 service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:56.395876 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149fb0f-aabc-4696-93af-d3bad89e4db3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:56.397672 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-2149fb0f-aabc-4696-93af-d3bad89e4db3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:56.410841 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149fb0f-aabc-4696-93af-d3bad89e4db3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:56.412831 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149fb0f-aabc-4696-93af-d3bad89e4db3 service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:49:56.423640 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1348/2699] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:49:56 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:49:58.526618 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b828ce-023b-460a-aa84-2be22a882d53 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:58.527974 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-74b828ce-023b-460a-aa84-2be22a882d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:58.533647 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149fb0f-aabc-4696-93af-d3bad89e4db3 service cinder] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:58.595117 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149fb0f-aabc-4696-93af-d3bad89e4db3 service cinder] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:58.598940 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de1645-4a53-408e-810e-376c9c2d73eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:58.600013 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de1645-4a53-408e-810e-376c9c2d73eb service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:58.600306 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de1645-4a53-408e-810e-376c9c2d73eb service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:58.600589 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de1645-4a53-408e-810e-376c9c2d73eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:58.602311 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-28de1645-4a53-408e-810e-376c9c2d73eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:58.605683 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b828ce-023b-460a-aa84-2be22a882d53 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:58.610373 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a9cd5-05f5-49e1-9050-189cb8c301c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9a2114d29c4edeb20f394140d390bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:58.610952 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a9cd5-05f5-49e1-9050-189cb8c301c9 service placement] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:58.611247 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a9cd5-05f5-49e1-9050-189cb8c301c9 service placement] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:58.611537 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a9cd5-05f5-49e1-9050-189cb8c301c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:58.613338 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-289a9cd5-05f5-49e1-9050-189cb8c301c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:58.616683 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de1645-4a53-408e-810e-376c9c2d73eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:58.618143 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de1645-4a53-408e-810e-376c9c2d73eb service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:49:58.625406 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a9cd5-05f5-49e1-9050-189cb8c301c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:58.627039 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a9cd5-05f5-49e1-9050-189cb8c301c9 service placement] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:49:58.628943 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1349/2700] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:49:58 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:49:58.636862 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1352/2701] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:49:58 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:49:58.739810 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de1645-4a53-408e-810e-376c9c2d73eb service neutron] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:58.741818 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-28de1645-4a53-408e-810e-376c9c2d73eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:58.755038 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de1645-4a53-408e-810e-376c9c2d73eb service neutron] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:58.759757 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720eb3a-1784-4a5d-a2e4-a9444709ff1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9a2114d29c4edeb20f394140d390bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:58.760333 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720eb3a-1784-4a5d-a2e4-a9444709ff1c service placement] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:58.760619 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720eb3a-1784-4a5d-a2e4-a9444709ff1c service placement] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:58.760940 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720eb3a-1784-4a5d-a2e4-a9444709ff1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:58.762590 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-1720eb3a-1784-4a5d-a2e4-a9444709ff1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:58.773478 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720eb3a-1784-4a5d-a2e4-a9444709ff1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:58.775031 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720eb3a-1784-4a5d-a2e4-a9444709ff1c service placement] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:49:58.784249 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1350/2702] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:49:58 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:50:00.847723 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a9cd5-05f5-49e1-9050-189cb8c301c9 service placement] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:00.853752 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-289a9cd5-05f5-49e1-9050-189cb8c301c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:00.881571 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a9cd5-05f5-49e1-9050-189cb8c301c9 service placement] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:00.886368 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984e5ad-f245-4856-9be3-7f814e200571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:00.887297 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984e5ad-f245-4856-9be3-7f814e200571 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:00.887784 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984e5ad-f245-4856-9be3-7f814e200571 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:00.888554 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984e5ad-f245-4856-9be3-7f814e200571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:00.891540 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e984e5ad-f245-4856-9be3-7f814e200571 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:00.907092 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984e5ad-f245-4856-9be3-7f814e200571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:00.908746 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984e5ad-f245-4856-9be3-7f814e200571 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:50:00.919802 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1353/2703] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:50:00 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:50:01.967647 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720eb3a-1784-4a5d-a2e4-a9444709ff1c service placement] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:01.969365 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-1720eb3a-1784-4a5d-a2e4-a9444709ff1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:01.992543 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720eb3a-1784-4a5d-a2e4-a9444709ff1c service placement] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:01.997950 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908af70f-a04f-43c3-a130-2049e9a84dfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:01.998620 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908af70f-a04f-43c3-a130-2049e9a84dfc service nova] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:01.998984 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908af70f-a04f-43c3-a130-2049e9a84dfc service nova] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:01.999338 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908af70f-a04f-43c3-a130-2049e9a84dfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:02.001309 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-908af70f-a04f-43c3-a130-2049e9a84dfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:02.014537 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908af70f-a04f-43c3-a130-2049e9a84dfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:02.016194 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908af70f-a04f-43c3-a130-2049e9a84dfc service nova] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:50:02.027645 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1351/2704] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:50:01 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:50:13.362292 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984e5ad-f245-4856-9be3-7f814e200571 service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:13.377685 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984e5ad-f245-4856-9be3-7f814e200571 service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:13.383135 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8540e-7fe6-45f9-af1f-6eea521d6231 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:13.383884 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8540e-7fe6-45f9-af1f-6eea521d6231 service nova] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:13.384275 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8540e-7fe6-45f9-af1f-6eea521d6231 service nova] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:13.384658 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8540e-7fe6-45f9-af1f-6eea521d6231 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:13.386532 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-cab8540e-7fe6-45f9-af1f-6eea521d6231 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:13.399317 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8540e-7fe6-45f9-af1f-6eea521d6231 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:13.401078 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8540e-7fe6-45f9-af1f-6eea521d6231 service nova] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:50:13.411969 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1354/2705] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:50:13 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:50:16.592994 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908af70f-a04f-43c3-a130-2049e9a84dfc service nova] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:16.602984 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908af70f-a04f-43c3-a130-2049e9a84dfc service nova] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:16.606613 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a294d8-53b0-45dc-af60-a8a260e0e031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:16.607187 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a294d8-53b0-45dc-af60-a8a260e0e031 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:16.607476 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a294d8-53b0-45dc-af60-a8a260e0e031 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:16.607763 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a294d8-53b0-45dc-af60-a8a260e0e031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:16.617408 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a294d8-53b0-45dc-af60-a8a260e0e031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:16.618823 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a294d8-53b0-45dc-af60-a8a260e0e031 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:50:16.628032 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1352/2706] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:50:16 2021] GET /identity/v3/auth/tokens => generated 3753 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:50:19.176242 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8540e-7fe6-45f9-af1f-6eea521d6231 service nova] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:19.187395 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8540e-7fe6-45f9-af1f-6eea521d6231 service nova] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:19.193495 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36003b4-9197-489e-b5f8-d46cb3df9eab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:19.194888 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36003b4-9197-489e-b5f8-d46cb3df9eab service nova] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:19.195357 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36003b4-9197-489e-b5f8-d46cb3df9eab service nova] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:19.195822 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36003b4-9197-489e-b5f8-d46cb3df9eab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:19.197686 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-d36003b4-9197-489e-b5f8-d46cb3df9eab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:19.209910 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36003b4-9197-489e-b5f8-d46cb3df9eab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:19.211733 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36003b4-9197-489e-b5f8-d46cb3df9eab service nova] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:50:19.223778 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1355/2707] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:50:19 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:50:19.970047 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101baff-6a81-4881-be8f-7ea97ef720e5 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:19.970661 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101baff-6a81-4881-be8f-7ea97ef720e5 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:19.970661 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101baff-6a81-4881-be8f-7ea97ef720e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:19.993207 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-9101baff-6a81-4881-be8f-7ea97ef720e5 None None] MFA Rules not processed for user `48319d5dcda64acebea9bb3daad1889b`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:50:19.994513 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-9101baff-6a81-4881-be8f-7ea97ef720e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:20.064359 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1353/2708] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:50:19 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:51:51.729673 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36003b4-9197-489e-b5f8-d46cb3df9eab service nova] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:51.731621 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-d36003b4-9197-489e-b5f8-d46cb3df9eab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:51.845073 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36003b4-9197-489e-b5f8-d46cb3df9eab service nova] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:51.850089 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead3eab-8fd1-4f61-8d24-d068013c917b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:51.851126 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead3eab-8fd1-4f61-8d24-d068013c917b admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:51.851570 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead3eab-8fd1-4f61-8d24-d068013c917b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:51.851894 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead3eab-8fd1-4f61-8d24-d068013c917b admin admin] PATH_INFO: `/v3/users/48319d5dcda64acebea9bb3daad1889b` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:51.853121 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead3eab-8fd1-4f61-8d24-d068013c917b admin admin] RBAC: Authorizing `identity:delete_user(user_id=48319d5dcda64acebea9bb3daad1889b)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:51.855132 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead3eab-8fd1-4f61-8d24-d068013c917b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:51.908148 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-aead3eab-8fd1-4f61-8d24-d068013c917b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48319d5dcda64acebea9bb3daad1889b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:51.908901 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-aead3eab-8fd1-4f61-8d24-d068013c917b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48319d5dcda64acebea9bb3daad1889b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:51.920997 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-aead3eab-8fd1-4f61-8d24-d068013c917b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48319d5dcda64acebea9bb3daad1889b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:51.928453 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-aead3eab-8fd1-4f61-8d24-d068013c917b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48319d5dcda64acebea9bb3daad1889b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:51.937024 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-aead3eab-8fd1-4f61-8d24-d068013c917b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48319d5dcda64acebea9bb3daad1889b'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:51.942876 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1356/2709] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:51:51 2021] DELETE /identity/v3/users/48319d5dcda64acebea9bb3daad1889b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:52.177348 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101baff-6a81-4881-be8f-7ea97ef720e5 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:52.207155 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101baff-6a81-4881-be8f-7ea97ef720e5 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:52.269865 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60d2ff-8152-4624-9cdf-cc0b0b4e44d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:52.270661 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60d2ff-8152-4624-9cdf-cc0b0b4e44d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:52.270955 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60d2ff-8152-4624-9cdf-cc0b0b4e44d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:52.271241 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60d2ff-8152-4624-9cdf-cc0b0b4e44d1 admin admin] PATH_INFO: `/v3/projects/bb0a577a94a04b3eaaaf2d2347f21e44` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:52.272348 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60d2ff-8152-4624-9cdf-cc0b0b4e44d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb0a577a94a04b3eaaaf2d2347f21e44)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:52.274281 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60d2ff-8152-4624-9cdf-cc0b0b4e44d1 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:52.322051 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-8f60d2ff-8152-4624-9cdf-cc0b0b4e44d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'request_id': 'req-8f60d2ff-8152-4624-9cdf-cc0b0b4e44d1'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:52.336039 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-8f60d2ff-8152-4624-9cdf-cc0b0b4e44d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'request_id': 'req-8f60d2ff-8152-4624-9cdf-cc0b0b4e44d1'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:52.341091 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-8f60d2ff-8152-4624-9cdf-cc0b0b4e44d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'request_id': 'req-8f60d2ff-8152-4624-9cdf-cc0b0b4e44d1'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:52.353259 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-8f60d2ff-8152-4624-9cdf-cc0b0b4e44d1 admin admin] The token cache is being invalidate because project bb0a577a94a04b3eaaaf2d2347f21e44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:51:52.353545 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-8f60d2ff-8152-4624-9cdf-cc0b0b4e44d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:52.354159 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-8f60d2ff-8152-4624-9cdf-cc0b0b4e44d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:52.355627 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1354/2710] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:51:52 2021] DELETE /identity/v3/projects/bb0a577a94a04b3eaaaf2d2347f21e44 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:51:52.362533 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6330c-cc5d-48fe-b513-613f227cf8d0 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:52.362826 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6330c-cc5d-48fe-b513-613f227cf8d0 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:52.363115 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6330c-cc5d-48fe-b513-613f227cf8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:52.385561 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-95b6330c-cc5d-48fe-b513-613f227cf8d0 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:52.387316 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-95b6330c-cc5d-48fe-b513-613f227cf8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:52.450959 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1357/2711] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:51:52 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:52.458283 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a17c1-a9d9-4631-b249-2979692b3a8a None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:52.458584 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a17c1-a9d9-4631-b249-2979692b3a8a None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:52.458870 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a17c1-a9d9-4631-b249-2979692b3a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:52.481262 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-073a17c1-a9d9-4631-b249-2979692b3a8a None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:52.482409 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-073a17c1-a9d9-4631-b249-2979692b3a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:52.489992 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1355/2712] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:51:52 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:52.494069 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6330c-cc5d-48fe-b513-613f227cf8d0 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:52.504308 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6330c-cc5d-48fe-b513-613f227cf8d0 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:52.508584 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e131290-910b-45ca-9672-f1b5e63c9eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:52.509216 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e131290-910b-45ca-9672-f1b5e63c9eaf admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:52.509507 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e131290-910b-45ca-9672-f1b5e63c9eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:52.509790 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e131290-910b-45ca-9672-f1b5e63c9eaf admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:52.510552 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e131290-910b-45ca-9672-f1b5e63c9eaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:51:52.510785 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e131290-910b-45ca-9672-f1b5e63c9eaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:52.512374 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e131290-910b-45ca-9672-f1b5e63c9eaf admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:52.524680 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1358/2713] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:51:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:51:52.528770 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a17c1-a9d9-4631-b249-2979692b3a8a None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:52.537999 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a17c1-a9d9-4631-b249-2979692b3a8a None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:52.542882 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cbd5e-d73b-4298-ba1a-c1565e28cc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:52.543968 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cbd5e-d73b-4298-ba1a-c1565e28cc36 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:52.544256 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cbd5e-d73b-4298-ba1a-c1565e28cc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:52.544538 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cbd5e-d73b-4298-ba1a-c1565e28cc36 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:52.545227 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cbd5e-d73b-4298-ba1a-c1565e28cc36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:52.547131 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cbd5e-d73b-4298-ba1a-c1565e28cc36 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:52.573830 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1356/2714] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:51:52 2021] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:51:52.578200 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e131290-910b-45ca-9672-f1b5e63c9eaf admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:52.587790 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e131290-910b-45ca-9672-f1b5e63c9eaf admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:52.650969 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc71a00-bc30-423f-9e79-64f859f6a917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:52.651570 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc71a00-bc30-423f-9e79-64f859f6a917 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:52.651857 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc71a00-bc30-423f-9e79-64f859f6a917 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:52.652138 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc71a00-bc30-423f-9e79-64f859f6a917 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:52.652814 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc71a00-bc30-423f-9e79-64f859f6a917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:52.654714 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc71a00-bc30-423f-9e79-64f859f6a917 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:52.674613 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1359/2715] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:51:52 2021] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:51:52.680570 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cbd5e-d73b-4298-ba1a-c1565e28cc36 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:52.691537 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cbd5e-d73b-4298-ba1a-c1565e28cc36 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:52.695972 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb386fc-40fc-4467-8ba1-d267604aba77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:52.696568 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb386fc-40fc-4467-8ba1-d267604aba77 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:52.696894 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb386fc-40fc-4467-8ba1-d267604aba77 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:52.697179 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb386fc-40fc-4467-8ba1-d267604aba77 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:52.697865 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb386fc-40fc-4467-8ba1-d267604aba77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:52.699432 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb386fc-40fc-4467-8ba1-d267604aba77 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:52.709578 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1357/2716] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:52 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:51:52.713870 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc71a00-bc30-423f-9e79-64f859f6a917 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:52.723618 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc71a00-bc30-423f-9e79-64f859f6a917 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:52.728314 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e79238-4b14-4f15-95e8-ef44cfe98d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:52.728948 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e79238-4b14-4f15-95e8-ef44cfe98d5d admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:52.729244 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e79238-4b14-4f15-95e8-ef44cfe98d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:52.729531 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e79238-4b14-4f15-95e8-ef44cfe98d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:52.730263 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e79238-4b14-4f15-95e8-ef44cfe98d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:52.732398 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e79238-4b14-4f15-95e8-ef44cfe98d5d admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:52.742684 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1360/2717] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:52 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:51:52.747540 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb386fc-40fc-4467-8ba1-d267604aba77 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:52.757236 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb386fc-40fc-4467-8ba1-d267604aba77 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:52.761694 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e37a5d-04ff-4804-b6f9-542ee4de244c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:52.762588 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e37a5d-04ff-4804-b6f9-542ee4de244c admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:52.762871 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e37a5d-04ff-4804-b6f9-542ee4de244c admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:52.763151 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e37a5d-04ff-4804-b6f9-542ee4de244c admin admin] PATH_INFO: `/v3/projects/e20c7436c2d24589a5aba80f0aa0e854/users/b05f985e79a443fd84bde33e24d72eae/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:52.782312 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e37a5d-04ff-4804-b6f9-542ee4de244c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20c7436c2d24589a5aba80f0aa0e854, user_id=b05f985e79a443fd84bde33e24d72eae, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:52.784982 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e37a5d-04ff-4804-b6f9-542ee4de244c admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:52.798345 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1358/2718] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:51:52 2021] PUT /identity/v3/projects/e20c7436c2d24589a5aba80f0aa0e854/users/b05f985e79a443fd84bde33e24d72eae/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:52.809382 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75499cf7-eb5c-4d75-8202-d4f3451eb5ff None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:52.809683 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75499cf7-eb5c-4d75-8202-d4f3451eb5ff None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:52.809968 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75499cf7-eb5c-4d75-8202-d4f3451eb5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:52.845942 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-75499cf7-eb5c-4d75-8202-d4f3451eb5ff None None] MFA Rules not processed for user `b05f985e79a443fd84bde33e24d72eae`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:52.847012 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-75499cf7-eb5c-4d75-8202-d4f3451eb5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:52.919698 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1361/2719] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:51:52 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:51:52.931270 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e37a5d-04ff-4804-b6f9-542ee4de244c admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:52.932888 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-45e37a5d-04ff-4804-b6f9-542ee4de244c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:53.026256 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e37a5d-04ff-4804-b6f9-542ee4de244c admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:53.031943 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20218c-3510-4823-9a81-7c6c70e58a48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:53.032521 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20218c-3510-4823-9a81-7c6c70e58a48 service nova] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:53.032845 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20218c-3510-4823-9a81-7c6c70e58a48 service nova] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:53.033139 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20218c-3510-4823-9a81-7c6c70e58a48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:53.041025 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20218c-3510-4823-9a81-7c6c70e58a48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:53.042625 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20218c-3510-4823-9a81-7c6c70e58a48 service nova] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:53.051998 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1359/2720] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:51:52 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:51:53.323139 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75499cf7-eb5c-4d75-8202-d4f3451eb5ff None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:53.396561 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75499cf7-eb5c-4d75-8202-d4f3451eb5ff None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:53.400666 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a728b59-7b98-4c2f-adde-2e40169ad131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:53.401483 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a728b59-7b98-4c2f-adde-2e40169ad131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:53.401769 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a728b59-7b98-4c2f-adde-2e40169ad131 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:53.402047 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a728b59-7b98-4c2f-adde-2e40169ad131 admin admin] PATH_INFO: `/v3/users/b05f985e79a443fd84bde33e24d72eae` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:53.403814 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a728b59-7b98-4c2f-adde-2e40169ad131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b05f985e79a443fd84bde33e24d72eae)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:53.405758 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a728b59-7b98-4c2f-adde-2e40169ad131 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:53.451851 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-0a728b59-7b98-4c2f-adde-2e40169ad131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b05f985e79a443fd84bde33e24d72eae'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:53.452488 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-0a728b59-7b98-4c2f-adde-2e40169ad131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b05f985e79a443fd84bde33e24d72eae'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:53.463858 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-0a728b59-7b98-4c2f-adde-2e40169ad131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b05f985e79a443fd84bde33e24d72eae'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:53.472160 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-0a728b59-7b98-4c2f-adde-2e40169ad131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b05f985e79a443fd84bde33e24d72eae'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:53.478916 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-0a728b59-7b98-4c2f-adde-2e40169ad131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b05f985e79a443fd84bde33e24d72eae'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:53.485105 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1362/2721] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:51:53 2021] DELETE /identity/v3/users/b05f985e79a443fd84bde33e24d72eae => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:53.489589 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a60515-92aa-4543-9dbf-e3006678591e None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:53.490073 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a60515-92aa-4543-9dbf-e3006678591e None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:53.490197 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a60515-92aa-4543-9dbf-e3006678591e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:53.511576 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-28a60515-92aa-4543-9dbf-e3006678591e None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:53.513245 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-28a60515-92aa-4543-9dbf-e3006678591e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:53.577499 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1360/2722] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:51:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:53.587805 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a728b59-7b98-4c2f-adde-2e40169ad131 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:53.589184 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-0a728b59-7b98-4c2f-adde-2e40169ad131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:53.653693 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a728b59-7b98-4c2f-adde-2e40169ad131 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:53.657077 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cd797-bf63-4e20-9df6-f6ce5d27b059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:53.657662 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cd797-bf63-4e20-9df6-f6ce5d27b059 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:53.657949 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cd797-bf63-4e20-9df6-f6ce5d27b059 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:53.658230 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cd797-bf63-4e20-9df6-f6ce5d27b059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:53.667083 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40cd797-bf63-4e20-9df6-f6ce5d27b059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:53.668540 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40cd797-bf63-4e20-9df6-f6ce5d27b059 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:53.677428 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1363/2723] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:51:53 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:51:54.027424 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a60515-92aa-4543-9dbf-e3006678591e None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:54.028827 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-28a60515-92aa-4543-9dbf-e3006678591e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:54.039918 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a60515-92aa-4543-9dbf-e3006678591e None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:54.044640 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b9ee4-8994-4f7f-bb25-0b75717e2722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:54.045504 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b9ee4-8994-4f7f-bb25-0b75717e2722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:54.045793 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b9ee4-8994-4f7f-bb25-0b75717e2722 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:54.046075 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b9ee4-8994-4f7f-bb25-0b75717e2722 admin admin] PATH_INFO: `/v3/projects/e20c7436c2d24589a5aba80f0aa0e854` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:54.047172 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b9ee4-8994-4f7f-bb25-0b75717e2722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e20c7436c2d24589a5aba80f0aa0e854)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:54.049123 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b9ee4-8994-4f7f-bb25-0b75717e2722 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:54.098068 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5e2b9ee4-8994-4f7f-bb25-0b75717e2722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e20c7436c2d24589a5aba80f0aa0e854', 'request_id': 'req-5e2b9ee4-8994-4f7f-bb25-0b75717e2722'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:54.109249 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5e2b9ee4-8994-4f7f-bb25-0b75717e2722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e20c7436c2d24589a5aba80f0aa0e854', 'request_id': 'req-5e2b9ee4-8994-4f7f-bb25-0b75717e2722'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:54.114305 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5e2b9ee4-8994-4f7f-bb25-0b75717e2722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e20c7436c2d24589a5aba80f0aa0e854', 'request_id': 'req-5e2b9ee4-8994-4f7f-bb25-0b75717e2722'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:54.126527 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5e2b9ee4-8994-4f7f-bb25-0b75717e2722 admin admin] The token cache is being invalidate because project e20c7436c2d24589a5aba80f0aa0e854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:51:54.126816 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5e2b9ee4-8994-4f7f-bb25-0b75717e2722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:54.127436 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-5e2b9ee4-8994-4f7f-bb25-0b75717e2722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:54.128902 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1361/2724] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:51:54 2021] DELETE /identity/v3/projects/e20c7436c2d24589a5aba80f0aa0e854 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:54.134489 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512c38d-f51b-4d7d-a651-415f2318fa26 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:54.134956 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512c38d-f51b-4d7d-a651-415f2318fa26 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:54.135064 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512c38d-f51b-4d7d-a651-415f2318fa26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:54.157437 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-a512c38d-f51b-4d7d-a651-415f2318fa26 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:54.158605 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-a512c38d-f51b-4d7d-a651-415f2318fa26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:54.223876 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1364/2725] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:51:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:54.233279 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1df59d-b1da-4d39-8ad6-8dbfac8d79b1 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:54.233572 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1df59d-b1da-4d39-8ad6-8dbfac8d79b1 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:54.233858 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1df59d-b1da-4d39-8ad6-8dbfac8d79b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:54.257344 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-0c1df59d-b1da-4d39-8ad6-8dbfac8d79b1 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:54.258532 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-0c1df59d-b1da-4d39-8ad6-8dbfac8d79b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:54.265923 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1362/2726] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:51:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:54.270208 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512c38d-f51b-4d7d-a651-415f2318fa26 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:54.279807 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512c38d-f51b-4d7d-a651-415f2318fa26 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:54.284234 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc46c8-fedf-4167-bc68-eadecb4f9c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:54.284852 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc46c8-fedf-4167-bc68-eadecb4f9c4d admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:54.285161 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc46c8-fedf-4167-bc68-eadecb4f9c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:54.285445 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc46c8-fedf-4167-bc68-eadecb4f9c4d admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:54.286187 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc46c8-fedf-4167-bc68-eadecb4f9c4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:51:54.286483 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc46c8-fedf-4167-bc68-eadecb4f9c4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:54.288079 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc46c8-fedf-4167-bc68-eadecb4f9c4d admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:54.300813 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1365/2727] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:51:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:51:54.305307 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1df59d-b1da-4d39-8ad6-8dbfac8d79b1 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:54.314633 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1df59d-b1da-4d39-8ad6-8dbfac8d79b1 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:54.319152 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf1563-9da3-40bb-8282-95005c981a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:54.319736 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf1563-9da3-40bb-8282-95005c981a77 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:54.320029 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf1563-9da3-40bb-8282-95005c981a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:54.320315 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf1563-9da3-40bb-8282-95005c981a77 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:54.320981 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf1563-9da3-40bb-8282-95005c981a77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:54.322855 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf1563-9da3-40bb-8282-95005c981a77 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:54.351148 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1363/2728] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:51:54 2021] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:51:54.355329 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc46c8-fedf-4167-bc68-eadecb4f9c4d admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:54.365824 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc46c8-fedf-4167-bc68-eadecb4f9c4d admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:54.427355 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9e353-4126-4a49-b350-853e2b5c9d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:54.427960 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9e353-4126-4a49-b350-853e2b5c9d9e admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:54.428252 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9e353-4126-4a49-b350-853e2b5c9d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:54.428536 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9e353-4126-4a49-b350-853e2b5c9d9e admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:54.429461 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9e353-4126-4a49-b350-853e2b5c9d9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:54.431355 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9e353-4126-4a49-b350-853e2b5c9d9e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:54.450115 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1366/2729] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:51:54 2021] POST /identity/v3/users => generated 302 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:51:54.454259 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf1563-9da3-40bb-8282-95005c981a77 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:54.464064 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf1563-9da3-40bb-8282-95005c981a77 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:54.469056 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7613a58-18f7-4c43-a7b5-086edfd0a0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:54.469644 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7613a58-18f7-4c43-a7b5-086edfd0a0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:54.469935 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7613a58-18f7-4c43-a7b5-086edfd0a0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:54.470220 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7613a58-18f7-4c43-a7b5-086edfd0a0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:54.470916 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7613a58-18f7-4c43-a7b5-086edfd0a0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:54.472478 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7613a58-18f7-4c43-a7b5-086edfd0a0f8 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:54.483570 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1364/2730] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:54 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:51:54.487525 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9e353-4126-4a49-b350-853e2b5c9d9e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:54.497211 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9e353-4126-4a49-b350-853e2b5c9d9e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:54.501522 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c61e1e-53a3-4d06-86ff-d9344afc961c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:54.502104 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c61e1e-53a3-4d06-86ff-d9344afc961c admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:54.502393 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c61e1e-53a3-4d06-86ff-d9344afc961c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:54.502677 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c61e1e-53a3-4d06-86ff-d9344afc961c admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:54.503371 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c61e1e-53a3-4d06-86ff-d9344afc961c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:54.505244 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c61e1e-53a3-4d06-86ff-d9344afc961c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:54.516440 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1367/2731] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:54 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:51:54.520507 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7613a58-18f7-4c43-a7b5-086edfd0a0f8 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:54.530631 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7613a58-18f7-4c43-a7b5-086edfd0a0f8 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:54.535011 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314ccd8-5d06-4ea6-afc1-afbf3e35152d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:54.535818 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314ccd8-5d06-4ea6-afc1-afbf3e35152d admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:54.536091 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314ccd8-5d06-4ea6-afc1-afbf3e35152d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:54.536370 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314ccd8-5d06-4ea6-afc1-afbf3e35152d admin admin] PATH_INFO: `/v3/projects/cc8eb8679b9a44aa8e0dc8fe043ea937/users/d559cff09e644dd9ad06c65add7940a0/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:54.556793 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314ccd8-5d06-4ea6-afc1-afbf3e35152d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc8eb8679b9a44aa8e0dc8fe043ea937, user_id=d559cff09e644dd9ad06c65add7940a0, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:54.559455 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314ccd8-5d06-4ea6-afc1-afbf3e35152d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:54.571717 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1365/2732] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:51:54 2021] PUT /identity/v3/projects/cc8eb8679b9a44aa8e0dc8fe043ea937/users/d559cff09e644dd9ad06c65add7940a0/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:54.576966 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565730d-981e-40e0-b0ed-4482b8f8483f None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:54.577265 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565730d-981e-40e0-b0ed-4482b8f8483f None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:54.577549 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565730d-981e-40e0-b0ed-4482b8f8483f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:54.599347 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-c565730d-981e-40e0-b0ed-4482b8f8483f None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:54.600530 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-c565730d-981e-40e0-b0ed-4482b8f8483f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:54.774377 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1368/2733] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:51:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:54.785541 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314ccd8-5d06-4ea6-afc1-afbf3e35152d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:54.787209 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-1314ccd8-5d06-4ea6-afc1-afbf3e35152d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:54.851452 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314ccd8-5d06-4ea6-afc1-afbf3e35152d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:54.854948 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead93950-f8c0-4e3b-a048-0d5e3756616d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:54.855511 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead93950-f8c0-4e3b-a048-0d5e3756616d service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:54.855808 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead93950-f8c0-4e3b-a048-0d5e3756616d service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:54.856115 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead93950-f8c0-4e3b-a048-0d5e3756616d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:54.864957 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead93950-f8c0-4e3b-a048-0d5e3756616d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:54.866370 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead93950-f8c0-4e3b-a048-0d5e3756616d service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:54.875348 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1366/2734] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:51:54 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:51:55.647159 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac739e-6eac-47a7-9088-fa5928209cf1 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:55.647689 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac739e-6eac-47a7-9088-fa5928209cf1 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:55.647800 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac739e-6eac-47a7-9088-fa5928209cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:55.687910 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-f7ac739e-6eac-47a7-9088-fa5928209cf1 None None] MFA Rules not processed for user `d559cff09e644dd9ad06c65add7940a0`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:55.689142 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-f7ac739e-6eac-47a7-9088-fa5928209cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:55.761437 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1369/2735] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:51:55 2021] POST /identity/v3/auth/tokens => generated 3710 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:55.766592 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead93950-f8c0-4e3b-a048-0d5e3756616d service neutron] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:55.775652 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead93950-f8c0-4e3b-a048-0d5e3756616d service neutron] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:55.781199 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973826a-5dfe-4d15-af42-c3fcf312e176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:55.781802 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973826a-5dfe-4d15-af42-c3fcf312e176 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:55.782088 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973826a-5dfe-4d15-af42-c3fcf312e176 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:55.782370 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973826a-5dfe-4d15-af42-c3fcf312e176 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:55.783025 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973826a-5dfe-4d15-af42-c3fcf312e176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:55.784964 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973826a-5dfe-4d15-af42-c3fcf312e176 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:55.812815 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1367/2736] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:51:55 2021] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:51:55.818040 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac739e-6eac-47a7-9088-fa5928209cf1 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:55.835544 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac739e-6eac-47a7-9088-fa5928209cf1 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:55.902318 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a53ba-8b9a-4148-bdbb-5fa6a88caad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:55.902949 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a53ba-8b9a-4148-bdbb-5fa6a88caad9 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:55.903245 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a53ba-8b9a-4148-bdbb-5fa6a88caad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:55.903533 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a53ba-8b9a-4148-bdbb-5fa6a88caad9 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:55.904170 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a53ba-8b9a-4148-bdbb-5fa6a88caad9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:55.906111 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a53ba-8b9a-4148-bdbb-5fa6a88caad9 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:55.926244 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1370/2737] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:51:55 2021] POST /identity/v3/users => generated 308 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:51:55.930446 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973826a-5dfe-4d15-af42-c3fcf312e176 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:55.940925 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973826a-5dfe-4d15-af42-c3fcf312e176 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:55.945260 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8a170-8fdd-4d8d-9a5a-716c4f4a2803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:55.945850 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8a170-8fdd-4d8d-9a5a-716c4f4a2803 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:55.946140 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8a170-8fdd-4d8d-9a5a-716c4f4a2803 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:55.946761 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8a170-8fdd-4d8d-9a5a-716c4f4a2803 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:55.947110 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8a170-8fdd-4d8d-9a5a-716c4f4a2803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:55.948720 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8a170-8fdd-4d8d-9a5a-716c4f4a2803 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:55.959581 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1368/2738] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:55 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:51:55.963651 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a53ba-8b9a-4148-bdbb-5fa6a88caad9 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:55.973190 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a53ba-8b9a-4148-bdbb-5fa6a88caad9 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:55.978124 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112579e9-a381-4e3d-abea-38a86d24430e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:55.978995 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112579e9-a381-4e3d-abea-38a86d24430e admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:55.979281 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112579e9-a381-4e3d-abea-38a86d24430e admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:55.979563 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112579e9-a381-4e3d-abea-38a86d24430e admin admin] PATH_INFO: `/v3/projects/f6315b5b36bb4df1af449b0ac3958fa1/users/755eee58d7ab44c5932551885dd6673a/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:55.999994 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112579e9-a381-4e3d-abea-38a86d24430e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6315b5b36bb4df1af449b0ac3958fa1, user_id=755eee58d7ab44c5932551885dd6673a, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:56.002686 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112579e9-a381-4e3d-abea-38a86d24430e admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:56.016986 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1371/2739] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:51:55 2021] PUT /identity/v3/projects/f6315b5b36bb4df1af449b0ac3958fa1/users/755eee58d7ab44c5932551885dd6673a/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:56.021126 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8a170-8fdd-4d8d-9a5a-716c4f4a2803 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:56.030785 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8a170-8fdd-4d8d-9a5a-716c4f4a2803 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:56.094265 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ca5a1-eb8b-42b3-9307-815a80ed5f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:56.094784 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ca5a1-eb8b-42b3-9307-815a80ed5f24 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:56.095076 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ca5a1-eb8b-42b3-9307-815a80ed5f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:56.095362 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ca5a1-eb8b-42b3-9307-815a80ed5f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:56.096055 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ca5a1-eb8b-42b3-9307-815a80ed5f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:56.097666 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ca5a1-eb8b-42b3-9307-815a80ed5f24 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:56.107464 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1369/2740] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:56 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:51:56.111818 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112579e9-a381-4e3d-abea-38a86d24430e admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:56.123517 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112579e9-a381-4e3d-abea-38a86d24430e admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:56.127901 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a75fc5-d56e-47c6-80dd-0225e65b61f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:56.128721 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a75fc5-d56e-47c6-80dd-0225e65b61f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:56.129044 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a75fc5-d56e-47c6-80dd-0225e65b61f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:56.129327 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a75fc5-d56e-47c6-80dd-0225e65b61f2 admin admin] PATH_INFO: `/v3/projects/f6315b5b36bb4df1af449b0ac3958fa1/users/755eee58d7ab44c5932551885dd6673a/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:56.131115 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a75fc5-d56e-47c6-80dd-0225e65b61f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6315b5b36bb4df1af449b0ac3958fa1, user_id=755eee58d7ab44c5932551885dd6673a, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:56.133818 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a75fc5-d56e-47c6-80dd-0225e65b61f2 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:56.144497 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1372/2741] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:51:56 2021] PUT /identity/v3/projects/f6315b5b36bb4df1af449b0ac3958fa1/users/755eee58d7ab44c5932551885dd6673a/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:56.913945 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95ccd6-bf4d-40d8-a02c-c76ca473596b None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:56.914483 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95ccd6-bf4d-40d8-a02c-c76ca473596b None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:56.914603 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95ccd6-bf4d-40d8-a02c-c76ca473596b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:56.950604 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-3f95ccd6-bf4d-40d8-a02c-c76ca473596b None None] MFA Rules not processed for user `755eee58d7ab44c5932551885dd6673a`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:56.951757 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-3f95ccd6-bf4d-40d8-a02c-c76ca473596b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:57.026967 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1370/2742] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:51:56 2021] POST /identity/v3/auth/tokens => generated 3777 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:58.564906 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a75fc5-d56e-47c6-80dd-0225e65b61f2 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:58.631482 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a75fc5-d56e-47c6-80dd-0225e65b61f2 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:58.635722 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e736515-a52d-408a-ad3c-16342927cae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:58.636505 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e736515-a52d-408a-ad3c-16342927cae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:58.636805 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e736515-a52d-408a-ad3c-16342927cae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:58.637097 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e736515-a52d-408a-ad3c-16342927cae4 admin admin] PATH_INFO: `/v3/users/d559cff09e644dd9ad06c65add7940a0` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:58.638681 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e736515-a52d-408a-ad3c-16342927cae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d559cff09e644dd9ad06c65add7940a0)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:58.640581 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e736515-a52d-408a-ad3c-16342927cae4 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:58.687009 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-9e736515-a52d-408a-ad3c-16342927cae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd559cff09e644dd9ad06c65add7940a0'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:58.687656 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-9e736515-a52d-408a-ad3c-16342927cae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd559cff09e644dd9ad06c65add7940a0'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:58.698868 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-9e736515-a52d-408a-ad3c-16342927cae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd559cff09e644dd9ad06c65add7940a0'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:58.706706 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-9e736515-a52d-408a-ad3c-16342927cae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd559cff09e644dd9ad06c65add7940a0'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:58.712962 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-9e736515-a52d-408a-ad3c-16342927cae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd559cff09e644dd9ad06c65add7940a0'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:58.719671 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1373/2743] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:51:58 2021] DELETE /identity/v3/users/d559cff09e644dd9ad06c65add7940a0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:58.944622 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95ccd6-bf4d-40d8-a02c-c76ca473596b None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:58.955564 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95ccd6-bf4d-40d8-a02c-c76ca473596b None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:59.019435 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80090291-2383-42b0-b399-8930489a42e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:59.020220 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80090291-2383-42b0-b399-8930489a42e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:59.020513 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80090291-2383-42b0-b399-8930489a42e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:59.020828 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80090291-2383-42b0-b399-8930489a42e0 admin admin] PATH_INFO: `/v3/projects/cc8eb8679b9a44aa8e0dc8fe043ea937` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:59.022045 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80090291-2383-42b0-b399-8930489a42e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc8eb8679b9a44aa8e0dc8fe043ea937)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:59.023934 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80090291-2383-42b0-b399-8930489a42e0 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:59.171987 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-80090291-2383-42b0-b399-8930489a42e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc8eb8679b9a44aa8e0dc8fe043ea937', 'request_id': 'req-80090291-2383-42b0-b399-8930489a42e0'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:59.183430 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-80090291-2383-42b0-b399-8930489a42e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc8eb8679b9a44aa8e0dc8fe043ea937', 'request_id': 'req-80090291-2383-42b0-b399-8930489a42e0'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:59.188828 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-80090291-2383-42b0-b399-8930489a42e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc8eb8679b9a44aa8e0dc8fe043ea937', 'request_id': 'req-80090291-2383-42b0-b399-8930489a42e0'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:59.201088 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-80090291-2383-42b0-b399-8930489a42e0 admin admin] The token cache is being invalidate because project cc8eb8679b9a44aa8e0dc8fe043ea937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:51:59.201373 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-80090291-2383-42b0-b399-8930489a42e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:59.201996 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-80090291-2383-42b0-b399-8930489a42e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:59.203448 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1371/2744] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:51:58 2021] DELETE /identity/v3/projects/cc8eb8679b9a44aa8e0dc8fe043ea937 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:51:59.207619 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e736515-a52d-408a-ad3c-16342927cae4 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:59.208989 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-9e736515-a52d-408a-ad3c-16342927cae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:59.221515 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e736515-a52d-408a-ad3c-16342927cae4 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:59.286417 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e214ebe-e13c-418e-af31-db99c0794c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:59.287230 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e214ebe-e13c-418e-af31-db99c0794c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:59.287520 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e214ebe-e13c-418e-af31-db99c0794c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:59.287805 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e214ebe-e13c-418e-af31-db99c0794c06 admin admin] PATH_INFO: `/v3/users/755eee58d7ab44c5932551885dd6673a` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:59.289012 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e214ebe-e13c-418e-af31-db99c0794c06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=755eee58d7ab44c5932551885dd6673a)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:59.290923 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e214ebe-e13c-418e-af31-db99c0794c06 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:59.339288 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-0e214ebe-e13c-418e-af31-db99c0794c06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '755eee58d7ab44c5932551885dd6673a'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:59.339936 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-0e214ebe-e13c-418e-af31-db99c0794c06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '755eee58d7ab44c5932551885dd6673a'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:59.351397 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-0e214ebe-e13c-418e-af31-db99c0794c06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '755eee58d7ab44c5932551885dd6673a'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:59.359438 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-0e214ebe-e13c-418e-af31-db99c0794c06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '755eee58d7ab44c5932551885dd6673a'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:59.367132 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-0e214ebe-e13c-418e-af31-db99c0794c06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '755eee58d7ab44c5932551885dd6673a'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:59.373745 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1374/2745] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:51:59 2021] DELETE /identity/v3/users/755eee58d7ab44c5932551885dd6673a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:59.589791 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80090291-2383-42b0-b399-8930489a42e0 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:59.591665 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-80090291-2383-42b0-b399-8930489a42e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:59.603969 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80090291-2383-42b0-b399-8930489a42e0 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:59.665204 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec254c7-e2b5-4ac9-ad08-4f47abf3f224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:59.665998 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec254c7-e2b5-4ac9-ad08-4f47abf3f224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:59.666286 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec254c7-e2b5-4ac9-ad08-4f47abf3f224 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:59.666580 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec254c7-e2b5-4ac9-ad08-4f47abf3f224 admin admin] PATH_INFO: `/v3/projects/f6315b5b36bb4df1af449b0ac3958fa1` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:59.667661 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec254c7-e2b5-4ac9-ad08-4f47abf3f224 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6315b5b36bb4df1af449b0ac3958fa1)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:59.670222 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec254c7-e2b5-4ac9-ad08-4f47abf3f224 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:59.717944 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-fec254c7-e2b5-4ac9-ad08-4f47abf3f224 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6315b5b36bb4df1af449b0ac3958fa1', 'request_id': 'req-fec254c7-e2b5-4ac9-ad08-4f47abf3f224'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:59.729903 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-fec254c7-e2b5-4ac9-ad08-4f47abf3f224 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6315b5b36bb4df1af449b0ac3958fa1', 'request_id': 'req-fec254c7-e2b5-4ac9-ad08-4f47abf3f224'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:59.736290 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-fec254c7-e2b5-4ac9-ad08-4f47abf3f224 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6315b5b36bb4df1af449b0ac3958fa1', 'request_id': 'req-fec254c7-e2b5-4ac9-ad08-4f47abf3f224'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:59.748249 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-fec254c7-e2b5-4ac9-ad08-4f47abf3f224 admin admin] The token cache is being invalidate because project f6315b5b36bb4df1af449b0ac3958fa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:51:59.748537 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-fec254c7-e2b5-4ac9-ad08-4f47abf3f224 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:59.749177 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-fec254c7-e2b5-4ac9-ad08-4f47abf3f224 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:59.750638 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1372/2746] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:51:59 2021] DELETE /identity/v3/projects/f6315b5b36bb4df1af449b0ac3958fa1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:59.756470 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e215c49-5135-459b-b0f8-21e669552dbb None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:59.756981 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e215c49-5135-459b-b0f8-21e669552dbb None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:59.757089 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e215c49-5135-459b-b0f8-21e669552dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:59.779581 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-3e215c49-5135-459b-b0f8-21e669552dbb None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:59.780744 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-3e215c49-5135-459b-b0f8-21e669552dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:59.845807 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1375/2747] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:51:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:59.854895 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e86d2-534c-474d-9c36-0bcdd2982475 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:59.855291 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e86d2-534c-474d-9c36-0bcdd2982475 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:59.855651 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e86d2-534c-474d-9c36-0bcdd2982475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:59.878290 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-716e86d2-534c-474d-9c36-0bcdd2982475 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:59.879453 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-716e86d2-534c-474d-9c36-0bcdd2982475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:59.886650 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1373/2748] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:51:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:59.890984 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e215c49-5135-459b-b0f8-21e669552dbb None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:59.900330 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e215c49-5135-459b-b0f8-21e669552dbb None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:59.905245 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8073381-62f5-47be-a830-1e828f9d7012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:59.905869 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8073381-62f5-47be-a830-1e828f9d7012 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:59.906159 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8073381-62f5-47be-a830-1e828f9d7012 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:59.906445 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8073381-62f5-47be-a830-1e828f9d7012 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:59.907136 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8073381-62f5-47be-a830-1e828f9d7012 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:51:59.907441 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8073381-62f5-47be-a830-1e828f9d7012 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:59.909104 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8073381-62f5-47be-a830-1e828f9d7012 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:59.922260 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1376/2749] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:51:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:51:59.926482 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e86d2-534c-474d-9c36-0bcdd2982475 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:59.935648 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e86d2-534c-474d-9c36-0bcdd2982475 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:59.940108 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1ae25-00fb-489a-b8b8-d58e8191e5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:59.940690 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1ae25-00fb-489a-b8b8-d58e8191e5e7 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:59.941015 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1ae25-00fb-489a-b8b8-d58e8191e5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:59.941299 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1ae25-00fb-489a-b8b8-d58e8191e5e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:59.941934 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1ae25-00fb-489a-b8b8-d58e8191e5e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:59.943871 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1ae25-00fb-489a-b8b8-d58e8191e5e7 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:51:59.970736 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1374/2750] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:51:59 2021] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:51:59.974898 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8073381-62f5-47be-a830-1e828f9d7012 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:59.984677 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8073381-62f5-47be-a830-1e828f9d7012 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:00.045837 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a41e8-37f4-4627-b1e2-0fe33b6fdf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:00.046441 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a41e8-37f4-4627-b1e2-0fe33b6fdf92 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:00.046733 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a41e8-37f4-4627-b1e2-0fe33b6fdf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:00.047052 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a41e8-37f4-4627-b1e2-0fe33b6fdf92 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:00.047723 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a41e8-37f4-4627-b1e2-0fe33b6fdf92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:00.049662 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a41e8-37f4-4627-b1e2-0fe33b6fdf92 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:00.068890 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1377/2751] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:51:59 2021] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:52:00.073410 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1ae25-00fb-489a-b8b8-d58e8191e5e7 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:00.083732 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1ae25-00fb-489a-b8b8-d58e8191e5e7 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:00.088077 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97594640-912d-4c5d-87ab-191619643760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:00.088667 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97594640-912d-4c5d-87ab-191619643760 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:00.088998 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97594640-912d-4c5d-87ab-191619643760 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:00.089287 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97594640-912d-4c5d-87ab-191619643760 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:00.089978 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97594640-912d-4c5d-87ab-191619643760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:00.092198 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97594640-912d-4c5d-87ab-191619643760 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:00.102187 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1375/2752] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:52:00 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:52:00.106282 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a41e8-37f4-4627-b1e2-0fe33b6fdf92 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:00.115794 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a41e8-37f4-4627-b1e2-0fe33b6fdf92 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:00.120157 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa43859-9cb4-4dbb-ad68-762f1190b086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:00.120748 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa43859-9cb4-4dbb-ad68-762f1190b086 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:00.121072 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa43859-9cb4-4dbb-ad68-762f1190b086 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:00.121359 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa43859-9cb4-4dbb-ad68-762f1190b086 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:00.122066 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa43859-9cb4-4dbb-ad68-762f1190b086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:00.123807 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa43859-9cb4-4dbb-ad68-762f1190b086 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:00.133808 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1378/2753] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:52:00 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:52:00.138704 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97594640-912d-4c5d-87ab-191619643760 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:00.149397 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97594640-912d-4c5d-87ab-191619643760 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:00.154969 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e3dc9-971e-468f-902c-b7ac2bd39bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:00.155332 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e3dc9-971e-468f-902c-b7ac2bd39bc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:00.155623 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e3dc9-971e-468f-902c-b7ac2bd39bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:00.155907 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e3dc9-971e-468f-902c-b7ac2bd39bc2 admin admin] PATH_INFO: `/v3/projects/9451b1edcdfb47de9d05e79820ffd7bb/users/029e2945a4a140e4980ebcf7ac60853a/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:00.174807 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e3dc9-971e-468f-902c-b7ac2bd39bc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9451b1edcdfb47de9d05e79820ffd7bb, user_id=029e2945a4a140e4980ebcf7ac60853a, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:00.177504 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e3dc9-971e-468f-902c-b7ac2bd39bc2 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:00.190220 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1376/2754] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:52:00 2021] PUT /identity/v3/projects/9451b1edcdfb47de9d05e79820ffd7bb/users/029e2945a4a140e4980ebcf7ac60853a/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:52:00.200835 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd45e6e-17e1-479e-bfda-deae6eb69400 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:00.201133 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd45e6e-17e1-479e-bfda-deae6eb69400 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:00.201415 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd45e6e-17e1-479e-bfda-deae6eb69400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:00.236636 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-9bd45e6e-17e1-479e-bfda-deae6eb69400 None None] MFA Rules not processed for user `029e2945a4a140e4980ebcf7ac60853a`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:52:00.237749 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-9bd45e6e-17e1-479e-bfda-deae6eb69400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:00.309545 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1379/2755] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:52:00 2021] POST /identity/v3/auth/tokens => generated 3676 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:52:00.314014 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e3dc9-971e-468f-902c-b7ac2bd39bc2 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:00.381600 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e3dc9-971e-468f-902c-b7ac2bd39bc2 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:00.386034 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed896c9-899b-40d2-995a-d8fd382a066b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:00.386619 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed896c9-899b-40d2-995a-d8fd382a066b admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:00.386908 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed896c9-899b-40d2-995a-d8fd382a066b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:00.387190 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed896c9-899b-40d2-995a-d8fd382a066b admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:00.388444 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed896c9-899b-40d2-995a-d8fd382a066b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:00.390365 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed896c9-899b-40d2-995a-d8fd382a066b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:00.416470 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1377/2756] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:52:00 2021] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:52:00.420746 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd45e6e-17e1-479e-bfda-deae6eb69400 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:00.431100 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd45e6e-17e1-479e-bfda-deae6eb69400 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:00.492209 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbde0aa-c17c-499d-81df-7bd48bee91a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:00.492729 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbde0aa-c17c-499d-81df-7bd48bee91a1 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:00.493057 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbde0aa-c17c-499d-81df-7bd48bee91a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:00.493338 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbde0aa-c17c-499d-81df-7bd48bee91a1 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:00.493973 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbde0aa-c17c-499d-81df-7bd48bee91a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:00.495892 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbde0aa-c17c-499d-81df-7bd48bee91a1 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:00.515900 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1380/2757] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:52:00 2021] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:52:00.520053 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed896c9-899b-40d2-995a-d8fd382a066b admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:00.529681 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed896c9-899b-40d2-995a-d8fd382a066b admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:00.534061 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24aa23-917d-4d35-946b-a60d8e64a148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:00.534687 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24aa23-917d-4d35-946b-a60d8e64a148 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:00.534973 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24aa23-917d-4d35-946b-a60d8e64a148 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:00.535333 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24aa23-917d-4d35-946b-a60d8e64a148 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:00.536108 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24aa23-917d-4d35-946b-a60d8e64a148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:00.537719 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24aa23-917d-4d35-946b-a60d8e64a148 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:00.549264 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1378/2758] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:52:00 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:52:00.553451 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbde0aa-c17c-499d-81df-7bd48bee91a1 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:00.563838 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbde0aa-c17c-499d-81df-7bd48bee91a1 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:00.568213 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7774d24-e29e-4610-a3c5-bb5e733646bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:00.569041 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7774d24-e29e-4610-a3c5-bb5e733646bd admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:00.569334 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7774d24-e29e-4610-a3c5-bb5e733646bd admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:00.569620 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7774d24-e29e-4610-a3c5-bb5e733646bd admin admin] PATH_INFO: `/v3/projects/d638513247f24b06b531e9090dfb77aa/users/08fde9d0dd3149058e585e842813b17a/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:00.589306 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7774d24-e29e-4610-a3c5-bb5e733646bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d638513247f24b06b531e9090dfb77aa, user_id=08fde9d0dd3149058e585e842813b17a, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:00.591936 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7774d24-e29e-4610-a3c5-bb5e733646bd admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:00.604519 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1381/2759] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:52:00 2021] PUT /identity/v3/projects/d638513247f24b06b531e9090dfb77aa/users/08fde9d0dd3149058e585e842813b17a/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:52:00.608432 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24aa23-917d-4d35-946b-a60d8e64a148 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:00.618194 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24aa23-917d-4d35-946b-a60d8e64a148 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:00.680711 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda933d-1362-4c64-b706-69661ef081b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:00.681342 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda933d-1362-4c64-b706-69661ef081b3 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:00.681630 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda933d-1362-4c64-b706-69661ef081b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:00.681909 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda933d-1362-4c64-b706-69661ef081b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:00.682593 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda933d-1362-4c64-b706-69661ef081b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:00.684767 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda933d-1362-4c64-b706-69661ef081b3 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:00.694702 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1379/2760] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:52:00 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:52:00.698954 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7774d24-e29e-4610-a3c5-bb5e733646bd admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:00.709324 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7774d24-e29e-4610-a3c5-bb5e733646bd admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:00.713631 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdf3ef-352c-43c8-bb3b-095d58e74dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:00.714437 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdf3ef-352c-43c8-bb3b-095d58e74dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:00.714726 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdf3ef-352c-43c8-bb3b-095d58e74dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:00.715013 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdf3ef-352c-43c8-bb3b-095d58e74dcc admin admin] PATH_INFO: `/v3/projects/d638513247f24b06b531e9090dfb77aa/users/08fde9d0dd3149058e585e842813b17a/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:00.716820 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdf3ef-352c-43c8-bb3b-095d58e74dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d638513247f24b06b531e9090dfb77aa, user_id=08fde9d0dd3149058e585e842813b17a, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:00.719425 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdf3ef-352c-43c8-bb3b-095d58e74dcc admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:00.729174 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1382/2761] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:52:00 2021] PUT /identity/v3/projects/d638513247f24b06b531e9090dfb77aa/users/08fde9d0dd3149058e585e842813b17a/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:52:00.739421 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc8d03-3b7c-4c78-a11c-5444877e8720 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:00.739744 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc8d03-3b7c-4c78-a11c-5444877e8720 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:00.740023 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc8d03-3b7c-4c78-a11c-5444877e8720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:00.783316 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-88dc8d03-3b7c-4c78-a11c-5444877e8720 None None] MFA Rules not processed for user `08fde9d0dd3149058e585e842813b17a`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:52:00.784613 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-88dc8d03-3b7c-4c78-a11c-5444877e8720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:00.860934 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1380/2762] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:52:00 2021] POST /identity/v3/auth/tokens => generated 3743 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:52:00.870779 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdf3ef-352c-43c8-bb3b-095d58e74dcc admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:00.873157 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-4ccdf3ef-352c-43c8-bb3b-095d58e74dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:00.937924 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdf3ef-352c-43c8-bb3b-095d58e74dcc admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:00.941533 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef3b93-ab78-487f-8418-945936ca705f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:00.942159 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef3b93-ab78-487f-8418-945936ca705f service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:00.942450 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef3b93-ab78-487f-8418-945936ca705f service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:00.942738 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef3b93-ab78-487f-8418-945936ca705f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:00.951560 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef3b93-ab78-487f-8418-945936ca705f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:00.953008 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef3b93-ab78-487f-8418-945936ca705f service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:00.962151 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1383/2763] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:52:00 2021] GET /identity/v3/auth/tokens => generated 3743 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:52:01.020831 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc8d03-3b7c-4c78-a11c-5444877e8720 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:01.022208 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-88dc8d03-3b7c-4c78-a11c-5444877e8720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:01.033955 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc8d03-3b7c-4c78-a11c-5444877e8720 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:01.037404 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8b9f9-ae95-45bb-9285-dae8c5048f93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:01.037978 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8b9f9-ae95-45bb-9285-dae8c5048f93 service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:01.038265 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8b9f9-ae95-45bb-9285-dae8c5048f93 service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:01.038594 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8b9f9-ae95-45bb-9285-dae8c5048f93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:01.102825 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8b9f9-ae95-45bb-9285-dae8c5048f93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:01.104251 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8b9f9-ae95-45bb-9285-dae8c5048f93 service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:01.113424 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1381/2764] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:52:01 2021] GET /identity/v3/auth/tokens => generated 3676 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:52:04.986082 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef3b93-ab78-487f-8418-945936ca705f service cinder] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:05.074884 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef3b93-ab78-487f-8418-945936ca705f service cinder] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:05.080432 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffa02e-18f5-438a-996e-0c0e98734cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:05.081444 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffa02e-18f5-438a-996e-0c0e98734cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:05.081737 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffa02e-18f5-438a-996e-0c0e98734cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:05.082019 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffa02e-18f5-438a-996e-0c0e98734cbe admin admin] PATH_INFO: `/v3/users/029e2945a4a140e4980ebcf7ac60853a` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:05.083144 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ffa02e-18f5-438a-996e-0c0e98734cbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=029e2945a4a140e4980ebcf7ac60853a)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:05.085634 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ffa02e-18f5-438a-996e-0c0e98734cbe admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:05.132640 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-74ffa02e-18f5-438a-996e-0c0e98734cbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '029e2945a4a140e4980ebcf7ac60853a'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:05.133323 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-74ffa02e-18f5-438a-996e-0c0e98734cbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '029e2945a4a140e4980ebcf7ac60853a'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:05.145360 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-74ffa02e-18f5-438a-996e-0c0e98734cbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '029e2945a4a140e4980ebcf7ac60853a'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:05.152851 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-74ffa02e-18f5-438a-996e-0c0e98734cbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '029e2945a4a140e4980ebcf7ac60853a'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:05.161821 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-74ffa02e-18f5-438a-996e-0c0e98734cbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '029e2945a4a140e4980ebcf7ac60853a'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:05.168045 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1384/2765] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:52:04 2021] DELETE /identity/v3/users/029e2945a4a140e4980ebcf7ac60853a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:52:05.172453 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5e9c1-b1d0-483c-b69a-95010e0add4a None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:05.173011 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5e9c1-b1d0-483c-b69a-95010e0add4a None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:05.173113 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5e9c1-b1d0-483c-b69a-95010e0add4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:05.225947 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-aaa5e9c1-b1d0-483c-b69a-95010e0add4a None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:52:05.227136 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-aaa5e9c1-b1d0-483c-b69a-95010e0add4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:05.292776 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1382/2766] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:52:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:52:05.303538 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffa02e-18f5-438a-996e-0c0e98734cbe admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:05.305163 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-74ffa02e-18f5-438a-996e-0c0e98734cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:05.406293 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffa02e-18f5-438a-996e-0c0e98734cbe admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:05.409792 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944f0f1-955d-4d05-a202-d19b218e1073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:05.410582 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944f0f1-955d-4d05-a202-d19b218e1073 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:05.410904 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944f0f1-955d-4d05-a202-d19b218e1073 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:05.411190 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944f0f1-955d-4d05-a202-d19b218e1073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:05.421390 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944f0f1-955d-4d05-a202-d19b218e1073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:05.422828 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944f0f1-955d-4d05-a202-d19b218e1073 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:05.432331 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1385/2767] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:52:05 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:52:05.784863 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5e9c1-b1d0-483c-b69a-95010e0add4a None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:05.786370 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-aaa5e9c1-b1d0-483c-b69a-95010e0add4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:05.798761 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5e9c1-b1d0-483c-b69a-95010e0add4a None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:05.805933 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69cadd-3bc6-4b56-9a91-9ee22d5711a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:05.806895 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69cadd-3bc6-4b56-9a91-9ee22d5711a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:05.807225 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69cadd-3bc6-4b56-9a91-9ee22d5711a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:05.807547 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69cadd-3bc6-4b56-9a91-9ee22d5711a7 admin admin] PATH_INFO: `/v3/projects/9451b1edcdfb47de9d05e79820ffd7bb` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:05.808765 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69cadd-3bc6-4b56-9a91-9ee22d5711a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9451b1edcdfb47de9d05e79820ffd7bb)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:05.811409 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69cadd-3bc6-4b56-9a91-9ee22d5711a7 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:05.896023 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ba69cadd-3bc6-4b56-9a91-9ee22d5711a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9451b1edcdfb47de9d05e79820ffd7bb', 'request_id': 'req-ba69cadd-3bc6-4b56-9a91-9ee22d5711a7'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:05.921899 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ba69cadd-3bc6-4b56-9a91-9ee22d5711a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9451b1edcdfb47de9d05e79820ffd7bb', 'request_id': 'req-ba69cadd-3bc6-4b56-9a91-9ee22d5711a7'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:05.928097 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ba69cadd-3bc6-4b56-9a91-9ee22d5711a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9451b1edcdfb47de9d05e79820ffd7bb', 'request_id': 'req-ba69cadd-3bc6-4b56-9a91-9ee22d5711a7'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:05.942483 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ba69cadd-3bc6-4b56-9a91-9ee22d5711a7 admin admin] The token cache is being invalidate because project 9451b1edcdfb47de9d05e79820ffd7bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:52:05.942773 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ba69cadd-3bc6-4b56-9a91-9ee22d5711a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:05.943397 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ba69cadd-3bc6-4b56-9a91-9ee22d5711a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:05.944895 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1383/2768] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:52:05 2021] DELETE /identity/v3/projects/9451b1edcdfb47de9d05e79820ffd7bb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:52:05.949145 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944f0f1-955d-4d05-a202-d19b218e1073 service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:05.958966 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944f0f1-955d-4d05-a202-d19b218e1073 service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:06.021636 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e934a-e25c-417f-b602-ad94cfcfebc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:06.022461 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e934a-e25c-417f-b602-ad94cfcfebc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:06.022747 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e934a-e25c-417f-b602-ad94cfcfebc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:06.023033 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e934a-e25c-417f-b602-ad94cfcfebc7 admin admin] PATH_INFO: `/v3/users/08fde9d0dd3149058e585e842813b17a` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:06.024132 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e934a-e25c-417f-b602-ad94cfcfebc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08fde9d0dd3149058e585e842813b17a)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:06.026314 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e934a-e25c-417f-b602-ad94cfcfebc7 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:06.076023 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-916e934a-e25c-417f-b602-ad94cfcfebc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08fde9d0dd3149058e585e842813b17a'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:06.076731 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-916e934a-e25c-417f-b602-ad94cfcfebc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08fde9d0dd3149058e585e842813b17a'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:06.088680 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-916e934a-e25c-417f-b602-ad94cfcfebc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08fde9d0dd3149058e585e842813b17a'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:06.096687 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-916e934a-e25c-417f-b602-ad94cfcfebc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08fde9d0dd3149058e585e842813b17a'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:06.104834 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-916e934a-e25c-417f-b602-ad94cfcfebc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08fde9d0dd3149058e585e842813b17a'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:06.110773 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1386/2769] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:52:05 2021] DELETE /identity/v3/users/08fde9d0dd3149058e585e842813b17a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:52:06.587377 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69cadd-3bc6-4b56-9a91-9ee22d5711a7 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:06.589061 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-ba69cadd-3bc6-4b56-9a91-9ee22d5711a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:06.601990 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69cadd-3bc6-4b56-9a91-9ee22d5711a7 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:06.672298 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d9eaf-e9aa-45f9-9912-0e5c408428c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:06.672298 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d9eaf-e9aa-45f9-9912-0e5c408428c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:06.672298 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d9eaf-e9aa-45f9-9912-0e5c408428c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:06.672298 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d9eaf-e9aa-45f9-9912-0e5c408428c0 admin admin] PATH_INFO: `/v3/projects/d638513247f24b06b531e9090dfb77aa` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:06.673648 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d9eaf-e9aa-45f9-9912-0e5c408428c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d638513247f24b06b531e9090dfb77aa)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:06.675570 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d9eaf-e9aa-45f9-9912-0e5c408428c0 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:06.729574 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-385d9eaf-e9aa-45f9-9912-0e5c408428c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd638513247f24b06b531e9090dfb77aa', 'request_id': 'req-385d9eaf-e9aa-45f9-9912-0e5c408428c0'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:06.741894 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-385d9eaf-e9aa-45f9-9912-0e5c408428c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd638513247f24b06b531e9090dfb77aa', 'request_id': 'req-385d9eaf-e9aa-45f9-9912-0e5c408428c0'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:06.747865 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-385d9eaf-e9aa-45f9-9912-0e5c408428c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd638513247f24b06b531e9090dfb77aa', 'request_id': 'req-385d9eaf-e9aa-45f9-9912-0e5c408428c0'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:06.761713 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-385d9eaf-e9aa-45f9-9912-0e5c408428c0 admin admin] The token cache is being invalidate because project d638513247f24b06b531e9090dfb77aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:52:06.762010 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-385d9eaf-e9aa-45f9-9912-0e5c408428c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:06.762688 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-385d9eaf-e9aa-45f9-9912-0e5c408428c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:06.764456 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1384/2770] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:52:06 2021] DELETE /identity/v3/projects/d638513247f24b06b531e9090dfb77aa => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:52:06.770082 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a5113-ad33-49fa-8847-9e5568483a3b None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:06.770495 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a5113-ad33-49fa-8847-9e5568483a3b None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:06.770863 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a5113-ad33-49fa-8847-9e5568483a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:06.806927 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-e73a5113-ad33-49fa-8847-9e5568483a3b None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:52:06.808180 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-e73a5113-ad33-49fa-8847-9e5568483a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:06.878271 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1387/2771] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:52:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:52:06.885910 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b56485-cb2a-4396-933e-2489aecca733 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:06.886210 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b56485-cb2a-4396-933e-2489aecca733 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:06.886499 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b56485-cb2a-4396-933e-2489aecca733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:06.909006 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-74b56485-cb2a-4396-933e-2489aecca733 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:52:06.910173 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-74b56485-cb2a-4396-933e-2489aecca733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:06.918598 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1385/2772] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:52:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:52:06.923338 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a5113-ad33-49fa-8847-9e5568483a3b None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:06.932992 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a5113-ad33-49fa-8847-9e5568483a3b None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:06.938144 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64604310-ac3a-4287-8d68-2da6cddda3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:06.938740 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64604310-ac3a-4287-8d68-2da6cddda3bb admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:06.939031 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64604310-ac3a-4287-8d68-2da6cddda3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:06.939318 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64604310-ac3a-4287-8d68-2da6cddda3bb admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:06.940008 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64604310-ac3a-4287-8d68-2da6cddda3bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:52:06.940311 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64604310-ac3a-4287-8d68-2da6cddda3bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:06.941927 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64604310-ac3a-4287-8d68-2da6cddda3bb admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:06.954940 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1388/2773] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:52:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:52:06.959498 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b56485-cb2a-4396-933e-2489aecca733 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:06.969254 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b56485-cb2a-4396-933e-2489aecca733 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:06.974113 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b7602-cbdf-40a1-a5ec-ad50e87e9df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:06.975079 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b7602-cbdf-40a1-a5ec-ad50e87e9df8 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:06.975566 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b7602-cbdf-40a1-a5ec-ad50e87e9df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:06.976045 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b7602-cbdf-40a1-a5ec-ad50e87e9df8 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:06.976702 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b7602-cbdf-40a1-a5ec-ad50e87e9df8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:06.978820 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b7602-cbdf-40a1-a5ec-ad50e87e9df8 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:07.009413 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1386/2774] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:52:06 2021] POST /identity/v3/projects => generated 409 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:52:07.013796 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64604310-ac3a-4287-8d68-2da6cddda3bb admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:07.023630 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64604310-ac3a-4287-8d68-2da6cddda3bb admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:07.088642 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968165a-fa13-4571-a998-5123763a8453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:07.089283 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968165a-fa13-4571-a998-5123763a8453 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:07.089580 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968165a-fa13-4571-a998-5123763a8453 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:07.089869 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968165a-fa13-4571-a998-5123763a8453 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:07.090510 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968165a-fa13-4571-a998-5123763a8453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:07.092939 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968165a-fa13-4571-a998-5123763a8453 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:07.111713 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1389/2775] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:52:07 2021] POST /identity/v3/users => generated 305 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:52:07.115831 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b7602-cbdf-40a1-a5ec-ad50e87e9df8 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:07.125799 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b7602-cbdf-40a1-a5ec-ad50e87e9df8 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:07.130230 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb5787-c4e0-4206-b046-c6a2f62853a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:07.130830 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb5787-c4e0-4206-b046-c6a2f62853a0 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:07.131122 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb5787-c4e0-4206-b046-c6a2f62853a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:07.131408 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb5787-c4e0-4206-b046-c6a2f62853a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:07.132116 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb5787-c4e0-4206-b046-c6a2f62853a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:07.133732 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb5787-c4e0-4206-b046-c6a2f62853a0 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:07.144301 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1387/2776] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:52:07 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:52:07.148294 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968165a-fa13-4571-a998-5123763a8453 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:07.158402 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968165a-fa13-4571-a998-5123763a8453 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:07.162902 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdefab0-ce6b-4b70-b9e7-43d9932862a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:07.163575 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdefab0-ce6b-4b70-b9e7-43d9932862a9 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:07.163982 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdefab0-ce6b-4b70-b9e7-43d9932862a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:07.164311 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdefab0-ce6b-4b70-b9e7-43d9932862a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:07.165106 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdefab0-ce6b-4b70-b9e7-43d9932862a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:07.166893 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdefab0-ce6b-4b70-b9e7-43d9932862a9 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:07.177886 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1390/2777] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:52:07 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:52:07.182424 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb5787-c4e0-4206-b046-c6a2f62853a0 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:07.192165 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb5787-c4e0-4206-b046-c6a2f62853a0 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:07.196486 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1c501-17c9-4f54-8c91-b4010f2fb5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:07.197323 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1c501-17c9-4f54-8c91-b4010f2fb5a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:07.197608 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1c501-17c9-4f54-8c91-b4010f2fb5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:07.197887 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1c501-17c9-4f54-8c91-b4010f2fb5a7 admin admin] PATH_INFO: `/v3/projects/955346ea1a084a398f07eb0e664f244e/users/33133791a5c34fa288e51f4ee563fafd/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:07.217096 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1c501-17c9-4f54-8c91-b4010f2fb5a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=955346ea1a084a398f07eb0e664f244e, user_id=33133791a5c34fa288e51f4ee563fafd, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:07.219692 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1c501-17c9-4f54-8c91-b4010f2fb5a7 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:07.233696 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1388/2778] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:52:07 2021] PUT /identity/v3/projects/955346ea1a084a398f07eb0e664f244e/users/33133791a5c34fa288e51f4ee563fafd/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:52:07.243875 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4249a2-ac66-445b-9614-2f8fc97c4de6 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:07.244171 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4249a2-ac66-445b-9614-2f8fc97c4de6 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:07.244456 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4249a2-ac66-445b-9614-2f8fc97c4de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:07.281452 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-bf4249a2-ac66-445b-9614-2f8fc97c4de6 None None] MFA Rules not processed for user `33133791a5c34fa288e51f4ee563fafd`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:52:07.282518 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-bf4249a2-ac66-445b-9614-2f8fc97c4de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:07.355373 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1391/2779] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:52:07 2021] POST /identity/v3/auth/tokens => generated 3716 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:52:07.360516 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1c501-17c9-4f54-8c91-b4010f2fb5a7 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:07.428554 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1c501-17c9-4f54-8c91-b4010f2fb5a7 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:07.433284 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d8cb5-507f-42b9-b5fd-98e7df60d6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:07.433868 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d8cb5-507f-42b9-b5fd-98e7df60d6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:07.434155 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d8cb5-507f-42b9-b5fd-98e7df60d6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:07.434433 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d8cb5-507f-42b9-b5fd-98e7df60d6a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:07.435068 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d8cb5-507f-42b9-b5fd-98e7df60d6a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:07.436955 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d8cb5-507f-42b9-b5fd-98e7df60d6a2 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:07.462133 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1389/2780] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:52:07 2021] POST /identity/v3/projects => generated 409 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:52:07.466211 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4249a2-ac66-445b-9614-2f8fc97c4de6 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:07.477140 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4249a2-ac66-445b-9614-2f8fc97c4de6 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:07.539025 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1ca71-b11c-4f62-97ad-15597ca3d431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:07.539544 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1ca71-b11c-4f62-97ad-15597ca3d431 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:07.539831 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1ca71-b11c-4f62-97ad-15597ca3d431 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:07.540112 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1ca71-b11c-4f62-97ad-15597ca3d431 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:07.540757 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1ca71-b11c-4f62-97ad-15597ca3d431 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:07.542655 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1ca71-b11c-4f62-97ad-15597ca3d431 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:07.562164 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1392/2781] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:52:07 2021] POST /identity/v3/users => generated 311 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:52:07.566213 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d8cb5-507f-42b9-b5fd-98e7df60d6a2 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:07.576386 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d8cb5-507f-42b9-b5fd-98e7df60d6a2 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:07.581032 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d39449-d2f8-4d4e-95ac-796d7f8a8e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:07.581523 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d39449-d2f8-4d4e-95ac-796d7f8a8e75 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:07.581811 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d39449-d2f8-4d4e-95ac-796d7f8a8e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:07.582093 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d39449-d2f8-4d4e-95ac-796d7f8a8e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:07.582780 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d39449-d2f8-4d4e-95ac-796d7f8a8e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:07.584331 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d39449-d2f8-4d4e-95ac-796d7f8a8e75 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:07.595659 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1390/2782] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:52:07 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:52:07.599728 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1ca71-b11c-4f62-97ad-15597ca3d431 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:07.609340 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1ca71-b11c-4f62-97ad-15597ca3d431 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:07.613659 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a88c34-4227-47ce-b818-81c64c7f58c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:07.614458 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a88c34-4227-47ce-b818-81c64c7f58c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:07.614741 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a88c34-4227-47ce-b818-81c64c7f58c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:07.615018 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a88c34-4227-47ce-b818-81c64c7f58c9 admin admin] PATH_INFO: `/v3/projects/593b753f774744cdb43d0a8e2b7e44a9/users/8bd05ba73c774b488afa28fa002145b1/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:07.633648 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a88c34-4227-47ce-b818-81c64c7f58c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=593b753f774744cdb43d0a8e2b7e44a9, user_id=8bd05ba73c774b488afa28fa002145b1, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:07.636237 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a88c34-4227-47ce-b818-81c64c7f58c9 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:07.649235 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1393/2783] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:52:07 2021] PUT /identity/v3/projects/593b753f774744cdb43d0a8e2b7e44a9/users/8bd05ba73c774b488afa28fa002145b1/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:52:07.654005 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d39449-d2f8-4d4e-95ac-796d7f8a8e75 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:07.663489 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d39449-d2f8-4d4e-95ac-796d7f8a8e75 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:07.725566 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15adaa-393a-4b96-835d-b0c045f10bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:07.726213 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15adaa-393a-4b96-835d-b0c045f10bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:07.726512 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15adaa-393a-4b96-835d-b0c045f10bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:07.726796 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15adaa-393a-4b96-835d-b0c045f10bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:07.727490 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15adaa-393a-4b96-835d-b0c045f10bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:07.729097 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15adaa-393a-4b96-835d-b0c045f10bc4 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:07.739185 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1391/2784] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:52:07 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:52:07.743166 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a88c34-4227-47ce-b818-81c64c7f58c9 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:07.753029 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a88c34-4227-47ce-b818-81c64c7f58c9 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:07.757468 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd818a-daa8-4b03-b59a-7bf696d828b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:07.758273 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd818a-daa8-4b03-b59a-7bf696d828b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:07.758561 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd818a-daa8-4b03-b59a-7bf696d828b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:07.758856 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd818a-daa8-4b03-b59a-7bf696d828b9 admin admin] PATH_INFO: `/v3/projects/593b753f774744cdb43d0a8e2b7e44a9/users/8bd05ba73c774b488afa28fa002145b1/roles/90166eb3dcfa41e58450e140b8b0fea3` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:07.760676 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd818a-daa8-4b03-b59a-7bf696d828b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=593b753f774744cdb43d0a8e2b7e44a9, user_id=8bd05ba73c774b488afa28fa002145b1, role_id=90166eb3dcfa41e58450e140b8b0fea3)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:07.763871 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd818a-daa8-4b03-b59a-7bf696d828b9 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:07.774041 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1394/2785] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:52:07 2021] PUT /identity/v3/projects/593b753f774744cdb43d0a8e2b7e44a9/users/8bd05ba73c774b488afa28fa002145b1/roles/90166eb3dcfa41e58450e140b8b0fea3 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:52:07.785586 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da58f2-d5a3-4520-b10f-7dfe897bc2c7 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:07.785882 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da58f2-d5a3-4520-b10f-7dfe897bc2c7 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:07.786167 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da58f2-d5a3-4520-b10f-7dfe897bc2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:07.821510 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-a6da58f2-d5a3-4520-b10f-7dfe897bc2c7 None None] MFA Rules not processed for user `8bd05ba73c774b488afa28fa002145b1`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:52:07.822580 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-a6da58f2-d5a3-4520-b10f-7dfe897bc2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:07.899869 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1392/2786] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:52:07 2021] POST /identity/v3/auth/tokens => generated 3783 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:52:07.909429 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd818a-daa8-4b03-b59a-7bf696d828b9 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:07.911780 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-a0fd818a-daa8-4b03-b59a-7bf696d828b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:07.977922 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd818a-daa8-4b03-b59a-7bf696d828b9 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:07.981558 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d143345-f3ab-445f-aa58-68b41f6dbaf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:07.982141 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d143345-f3ab-445f-aa58-68b41f6dbaf8 service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:07.982431 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d143345-f3ab-445f-aa58-68b41f6dbaf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:07.982718 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d143345-f3ab-445f-aa58-68b41f6dbaf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:07.991484 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d143345-f3ab-445f-aa58-68b41f6dbaf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:07.992948 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d143345-f3ab-445f-aa58-68b41f6dbaf8 service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:08.002326 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1395/2787] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:52:07 2021] GET /identity/v3/auth/tokens => generated 3783 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:52:08.156364 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da58f2-d5a3-4520-b10f-7dfe897bc2c7 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:08.165934 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da58f2-d5a3-4520-b10f-7dfe897bc2c7 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:08.169936 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc76749-f4eb-4568-ab77-ee436b886027 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:08.170528 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc76749-f4eb-4568-ab77-ee436b886027 service cinder] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:08.170821 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc76749-f4eb-4568-ab77-ee436b886027 service cinder] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:08.171110 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc76749-f4eb-4568-ab77-ee436b886027 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:08.234007 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc76749-f4eb-4568-ab77-ee436b886027 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:08.235414 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc76749-f4eb-4568-ab77-ee436b886027 service cinder] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:08.244149 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1393/2788] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:52:08 2021] GET /identity/v3/auth/tokens => generated 3716 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:52:17.125653 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d143345-f3ab-445f-aa58-68b41f6dbaf8 service cinder] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:17.214074 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d143345-f3ab-445f-aa58-68b41f6dbaf8 service cinder] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:17.221679 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1e891-06e3-4b92-96f7-62b02e590e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:17.222768 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1e891-06e3-4b92-96f7-62b02e590e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:17.223149 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1e891-06e3-4b92-96f7-62b02e590e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:17.223641 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1e891-06e3-4b92-96f7-62b02e590e90 admin admin] PATH_INFO: `/v3/users/33133791a5c34fa288e51f4ee563fafd` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:17.225053 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1e891-06e3-4b92-96f7-62b02e590e90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33133791a5c34fa288e51f4ee563fafd)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:17.227129 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1e891-06e3-4b92-96f7-62b02e590e90 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:17.292340 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-61e1e891-06e3-4b92-96f7-62b02e590e90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33133791a5c34fa288e51f4ee563fafd'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:17.293477 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-61e1e891-06e3-4b92-96f7-62b02e590e90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33133791a5c34fa288e51f4ee563fafd'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:17.314408 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-61e1e891-06e3-4b92-96f7-62b02e590e90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33133791a5c34fa288e51f4ee563fafd'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:17.324170 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-61e1e891-06e3-4b92-96f7-62b02e590e90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33133791a5c34fa288e51f4ee563fafd'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:17.336241 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-61e1e891-06e3-4b92-96f7-62b02e590e90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33133791a5c34fa288e51f4ee563fafd'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:17.343449 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1396/2789] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:52:17 2021] DELETE /identity/v3/users/33133791a5c34fa288e51f4ee563fafd => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:52:17.348399 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a63355-9835-4427-95f2-4e1f9a2f28ff None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:17.348902 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a63355-9835-4427-95f2-4e1f9a2f28ff None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:17.349072 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a63355-9835-4427-95f2-4e1f9a2f28ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:17.377510 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-e4a63355-9835-4427-95f2-4e1f9a2f28ff None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:52:17.378584 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e4a63355-9835-4427-95f2-4e1f9a2f28ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:17.460931 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1394/2790] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:52:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:52:17.472444 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1e891-06e3-4b92-96f7-62b02e590e90 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:17.473817 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-61e1e891-06e3-4b92-96f7-62b02e590e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:17.541343 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1e891-06e3-4b92-96f7-62b02e590e90 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:17.545060 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3c999-0dde-4356-99c1-ce3f5876e95e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:17.545718 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3c999-0dde-4356-99c1-ce3f5876e95e service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:17.545934 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3c999-0dde-4356-99c1-ce3f5876e95e service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:17.546217 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3c999-0dde-4356-99c1-ce3f5876e95e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:17.556285 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c3c999-0dde-4356-99c1-ce3f5876e95e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:17.557742 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c3c999-0dde-4356-99c1-ce3f5876e95e service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:17.566993 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1397/2791] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:52:17 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:52:17.961335 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a63355-9835-4427-95f2-4e1f9a2f28ff None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:17.962770 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e4a63355-9835-4427-95f2-4e1f9a2f28ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:17.974243 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a63355-9835-4427-95f2-4e1f9a2f28ff None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:17.978665 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5044cf-0d5c-4ce5-a0ce-44eb200b0a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:17.979445 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5044cf-0d5c-4ce5-a0ce-44eb200b0a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:17.979733 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5044cf-0d5c-4ce5-a0ce-44eb200b0a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:17.980014 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5044cf-0d5c-4ce5-a0ce-44eb200b0a38 admin admin] PATH_INFO: `/v3/projects/955346ea1a084a398f07eb0e664f244e` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:17.981157 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5044cf-0d5c-4ce5-a0ce-44eb200b0a38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=955346ea1a084a398f07eb0e664f244e)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:17.983798 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5044cf-0d5c-4ce5-a0ce-44eb200b0a38 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:18.038547 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-8b5044cf-0d5c-4ce5-a0ce-44eb200b0a38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '955346ea1a084a398f07eb0e664f244e', 'request_id': 'req-8b5044cf-0d5c-4ce5-a0ce-44eb200b0a38'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:18.052622 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-8b5044cf-0d5c-4ce5-a0ce-44eb200b0a38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '955346ea1a084a398f07eb0e664f244e', 'request_id': 'req-8b5044cf-0d5c-4ce5-a0ce-44eb200b0a38'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:18.058316 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-8b5044cf-0d5c-4ce5-a0ce-44eb200b0a38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '955346ea1a084a398f07eb0e664f244e', 'request_id': 'req-8b5044cf-0d5c-4ce5-a0ce-44eb200b0a38'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:18.072748 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-8b5044cf-0d5c-4ce5-a0ce-44eb200b0a38 admin admin] The token cache is being invalidate because project 955346ea1a084a398f07eb0e664f244e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:52:18.073166 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-8b5044cf-0d5c-4ce5-a0ce-44eb200b0a38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:18.073913 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-8b5044cf-0d5c-4ce5-a0ce-44eb200b0a38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:18.075427 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1395/2792] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:52:17 2021] DELETE /identity/v3/projects/955346ea1a084a398f07eb0e664f244e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:52:18.079487 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3c999-0dde-4356-99c1-ce3f5876e95e service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:18.089901 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3c999-0dde-4356-99c1-ce3f5876e95e service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:18.160359 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f082c-f890-4e43-9656-560e9dc078fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:18.160870 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f082c-f890-4e43-9656-560e9dc078fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:18.161170 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f082c-f890-4e43-9656-560e9dc078fb admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:18.161451 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f082c-f890-4e43-9656-560e9dc078fb admin admin] PATH_INFO: `/v3/users/8bd05ba73c774b488afa28fa002145b1` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:18.162710 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f082c-f890-4e43-9656-560e9dc078fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bd05ba73c774b488afa28fa002145b1)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:18.164975 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f082c-f890-4e43-9656-560e9dc078fb admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:18.228596 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-c48f082c-f890-4e43-9656-560e9dc078fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bd05ba73c774b488afa28fa002145b1'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:18.229316 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-c48f082c-f890-4e43-9656-560e9dc078fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bd05ba73c774b488afa28fa002145b1'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:18.241987 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-c48f082c-f890-4e43-9656-560e9dc078fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bd05ba73c774b488afa28fa002145b1'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:18.251389 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-c48f082c-f890-4e43-9656-560e9dc078fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bd05ba73c774b488afa28fa002145b1'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:18.259802 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-c48f082c-f890-4e43-9656-560e9dc078fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bd05ba73c774b488afa28fa002145b1'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:18.266864 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1398/2793] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:52:18 2021] DELETE /identity/v3/users/8bd05ba73c774b488afa28fa002145b1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:52:18.661450 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5044cf-0d5c-4ce5-a0ce-44eb200b0a38 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:18.663249 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-8b5044cf-0d5c-4ce5-a0ce-44eb200b0a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:18.677259 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5044cf-0d5c-4ce5-a0ce-44eb200b0a38 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:18.749991 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a142d9e-48ae-4846-9578-799813e41253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:18.750782 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a142d9e-48ae-4846-9578-799813e41253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:18.751063 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a142d9e-48ae-4846-9578-799813e41253 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:18.751337 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a142d9e-48ae-4846-9578-799813e41253 admin admin] PATH_INFO: `/v3/projects/593b753f774744cdb43d0a8e2b7e44a9` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:18.752420 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a142d9e-48ae-4846-9578-799813e41253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=593b753f774744cdb43d0a8e2b7e44a9)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:18.754320 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a142d9e-48ae-4846-9578-799813e41253 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:18.819857 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-7a142d9e-48ae-4846-9578-799813e41253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '593b753f774744cdb43d0a8e2b7e44a9', 'request_id': 'req-7a142d9e-48ae-4846-9578-799813e41253'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:18.832366 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-7a142d9e-48ae-4846-9578-799813e41253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '593b753f774744cdb43d0a8e2b7e44a9', 'request_id': 'req-7a142d9e-48ae-4846-9578-799813e41253'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:18.838464 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-7a142d9e-48ae-4846-9578-799813e41253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '593b753f774744cdb43d0a8e2b7e44a9', 'request_id': 'req-7a142d9e-48ae-4846-9578-799813e41253'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:18.853280 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-7a142d9e-48ae-4846-9578-799813e41253 admin admin] The token cache is being invalidate because project 593b753f774744cdb43d0a8e2b7e44a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:52:18.853576 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-7a142d9e-48ae-4846-9578-799813e41253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:18.854253 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-7a142d9e-48ae-4846-9578-799813e41253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:18.856125 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1396/2794] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:52:18 2021] DELETE /identity/v3/projects/593b753f774744cdb43d0a8e2b7e44a9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:52:18.861511 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71aa57-6c99-49e7-a231-fae64a1b76c1 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:18.861874 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71aa57-6c99-49e7-a231-fae64a1b76c1 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:18.862275 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71aa57-6c99-49e7-a231-fae64a1b76c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:18.885320 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-7b71aa57-6c99-49e7-a231-fae64a1b76c1 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:52:18.886486 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-7b71aa57-6c99-49e7-a231-fae64a1b76c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:18.953699 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1399/2795] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:52:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:52:18.961745 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f1140-fa0c-4522-90c3-748c3e8af81f None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:18.962042 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f1140-fa0c-4522-90c3-748c3e8af81f None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:18.962444 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f1140-fa0c-4522-90c3-748c3e8af81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:18.985884 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-836f1140-fa0c-4522-90c3-748c3e8af81f None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:52:18.987037 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-836f1140-fa0c-4522-90c3-748c3e8af81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:18.994360 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1397/2796] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:52:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:52:18.998488 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71aa57-6c99-49e7-a231-fae64a1b76c1 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:19.007887 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71aa57-6c99-49e7-a231-fae64a1b76c1 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:19.012359 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452a0bd-e64a-4ac4-9346-ffa187bcced5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:19.013479 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452a0bd-e64a-4ac4-9346-ffa187bcced5 admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:19.013765 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452a0bd-e64a-4ac4-9346-ffa187bcced5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:19.014045 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452a0bd-e64a-4ac4-9346-ffa187bcced5 admin admin] PATH_INFO: `/v3/domains` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:19.014734 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452a0bd-e64a-4ac4-9346-ffa187bcced5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:52:19.015032 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452a0bd-e64a-4ac4-9346-ffa187bcced5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:19.016611 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452a0bd-e64a-4ac4-9346-ffa187bcced5 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:19.030700 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1400/2797] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:52:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:52:19.035030 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f1140-fa0c-4522-90c3-748c3e8af81f None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:19.046106 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f1140-fa0c-4522-90c3-748c3e8af81f None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:19.050714 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9fec2b-0d08-439c-98d4-d15290d1c21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:19.051295 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fec2b-0d08-439c-98d4-d15290d1c21d admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:19.051582 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fec2b-0d08-439c-98d4-d15290d1c21d admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:19.051863 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fec2b-0d08-439c-98d4-d15290d1c21d admin admin] PATH_INFO: `/v3/projects` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:19.052493 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9fec2b-0d08-439c-98d4-d15290d1c21d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:19.054391 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9fec2b-0d08-439c-98d4-d15290d1c21d admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:19.081055 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1398/2798] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:52:19 2021] POST /identity/v3/projects => generated 359 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:52:19.085369 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452a0bd-e64a-4ac4-9346-ffa187bcced5 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:19.095815 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452a0bd-e64a-4ac4-9346-ffa187bcced5 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:19.157063 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d79469-e185-489b-a8fb-e26159018be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:19.157670 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d79469-e185-489b-a8fb-e26159018be7 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:19.157961 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d79469-e185-489b-a8fb-e26159018be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:19.158247 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d79469-e185-489b-a8fb-e26159018be7 admin admin] PATH_INFO: `/v3/users` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:19.158894 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d79469-e185-489b-a8fb-e26159018be7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:19.160816 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d79469-e185-489b-a8fb-e26159018be7 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:19.179675 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1401/2799] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:52:19 2021] POST /identity/v3/users => generated 280 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:52:19.184182 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9fec2b-0d08-439c-98d4-d15290d1c21d admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:19.194827 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9fec2b-0d08-439c-98d4-d15290d1c21d admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:19.199319 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1551f-ef1a-4da8-bc29-fb0d53afa7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:19.199922 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1551f-ef1a-4da8-bc29-fb0d53afa7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:19.200814 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1551f-ef1a-4da8-bc29-fb0d53afa7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:19.201098 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1551f-ef1a-4da8-bc29-fb0d53afa7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:19.201939 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1551f-ef1a-4da8-bc29-fb0d53afa7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:19.203427 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1551f-ef1a-4da8-bc29-fb0d53afa7a9 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:19.214202 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1399/2800] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:52:19 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:52:19.218464 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d79469-e185-489b-a8fb-e26159018be7 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:19.228374 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d79469-e185-489b-a8fb-e26159018be7 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:19.233884 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1dba15-bfff-46fe-8957-7147c8e9690b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:19.234496 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dba15-bfff-46fe-8957-7147c8e9690b admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:19.234787 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dba15-bfff-46fe-8957-7147c8e9690b admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:19.235072 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dba15-bfff-46fe-8957-7147c8e9690b admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:19.235773 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1dba15-bfff-46fe-8957-7147c8e9690b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:19.237444 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1dba15-bfff-46fe-8957-7147c8e9690b admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:19.248385 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1402/2801] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:52:19 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:52:19.254188 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1551f-ef1a-4da8-bc29-fb0d53afa7a9 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:19.267396 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1551f-ef1a-4da8-bc29-fb0d53afa7a9 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:19.271948 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0243be-dcc1-4652-b745-02b215f26417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:19.272772 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0243be-dcc1-4652-b745-02b215f26417 admin admin] REQUEST_METHOD: `PUT` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:19.273098 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0243be-dcc1-4652-b745-02b215f26417 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:19.273384 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0243be-dcc1-4652-b745-02b215f26417 admin admin] PATH_INFO: `/v3/projects/1806672deaf943fcb6303821aedceac6/users/40621068ea6741239433f9d05d4b2318/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:19.273932 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df74be-a69a-4f95-a6fb-80ffbabc4d44 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:19.274491 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df74be-a69a-4f95-a6fb-80ffbabc4d44 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:19.274966 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df74be-a69a-4f95-a6fb-80ffbabc4d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:19.293111 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0243be-dcc1-4652-b745-02b215f26417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1806672deaf943fcb6303821aedceac6, user_id=40621068ea6741239433f9d05d4b2318, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:19.295783 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0243be-dcc1-4652-b745-02b215f26417 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:19.297280 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-39df74be-a69a-4f95-a6fb-80ffbabc4d44 None None] MFA Rules not processed for user `ee703ae6a79f48cdb9438f504085e206`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:52:19.298467 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-39df74be-a69a-4f95-a6fb-80ffbabc4d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:19.310073 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1400/2802] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:52:19 2021] PUT /identity/v3/projects/1806672deaf943fcb6303821aedceac6/users/40621068ea6741239433f9d05d4b2318/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:52:19.320340 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd59e0e-6677-4d67-a76e-ea5007336285 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:19.320634 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd59e0e-6677-4d67-a76e-ea5007336285 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:19.320988 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd59e0e-6677-4d67-a76e-ea5007336285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:19.359375 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-7cd59e0e-6677-4d67-a76e-ea5007336285 None None] MFA Rules not processed for user `40621068ea6741239433f9d05d4b2318`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:52:19.360543 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-7cd59e0e-6677-4d67-a76e-ea5007336285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:19.364616 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1403/2803] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:52:19 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:52:19.435208 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1401/2804] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:52:19 2021] POST /identity/v3/auth/tokens => generated 3666 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:52:19.462214 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abeb21-a390-483a-8ba5-e2f929a9196b None None] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:19.462515 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abeb21-a390-483a-8ba5-e2f929a9196b None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:19.462802 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abeb21-a390-483a-8ba5-e2f929a9196b None None] PATH_INFO: `/` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:19.464512 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1404/2805] 10.222.0.64 () {54 vars in 962 bytes} [Thu Dec 16 14:52:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:52:19.469503 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcbf6d-0213-4afc-994e-57cde4112438 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:19.469820 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcbf6d-0213-4afc-994e-57cde4112438 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:19.470100 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcbf6d-0213-4afc-994e-57cde4112438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:19.532514 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-41fcbf6d-0213-4afc-994e-57cde4112438 None None] MFA Rules not processed for user `0050dc5fdd5641318319ff698112188c`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:52:19.533692 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-41fcbf6d-0213-4afc-994e-57cde4112438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:19.592568 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1402/2806] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Dec 16 14:52:19 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:52:19.600480 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abeb21-a390-483a-8ba5-e2f929a9196b None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:19.611490 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abeb21-a390-483a-8ba5-e2f929a9196b None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:19.614930 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685d8ed-3248-45dd-8f34-c0768ceb0515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:19.615498 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685d8ed-3248-45dd-8f34-c0768ceb0515 service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:19.615787 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685d8ed-3248-45dd-8f34-c0768ceb0515 service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:19.616089 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685d8ed-3248-45dd-8f34-c0768ceb0515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:19.624989 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685d8ed-3248-45dd-8f34-c0768ceb0515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:19.626414 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685d8ed-3248-45dd-8f34-c0768ceb0515 service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:19.635450 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1405/2807] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:52:19 2021] GET /identity/v3/auth/tokens => generated 3666 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:52:19.789081 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcbf6d-0213-4afc-994e-57cde4112438 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:19.799344 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685d8ed-3248-45dd-8f34-c0768ceb0515 service cinder] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:19.801098 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-c685d8ed-3248-45dd-8f34-c0768ceb0515 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:19.867209 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685d8ed-3248-45dd-8f34-c0768ceb0515 service cinder] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:19.869804 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcbf6d-0213-4afc-994e-57cde4112438 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:19.870994 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc7587-45f5-4734-8833-744c1edba5af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:19.871586 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc7587-45f5-4734-8833-744c1edba5af service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:19.871874 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc7587-45f5-4734-8833-744c1edba5af service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:19.872156 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc7587-45f5-4734-8833-744c1edba5af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:19.873874 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-4fcc7587-45f5-4734-8833-744c1edba5af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:19.874819 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9195fa-23f1-4496-a215-eff3dba3a6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:19.875771 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9195fa-23f1-4496-a215-eff3dba3a6ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:19.876060 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9195fa-23f1-4496-a215-eff3dba3a6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:19.876359 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9195fa-23f1-4496-a215-eff3dba3a6ae admin admin] PATH_INFO: `/v3/users/40621068ea6741239433f9d05d4b2318` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:19.877563 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9195fa-23f1-4496-a215-eff3dba3a6ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=40621068ea6741239433f9d05d4b2318)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:19.879534 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9195fa-23f1-4496-a215-eff3dba3a6ae admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:19.885149 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc7587-45f5-4734-8833-744c1edba5af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:19.886603 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc7587-45f5-4734-8833-744c1edba5af service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:19.895453 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1406/2808] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:52:19 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:52:19.932356 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ba9195fa-23f1-4496-a215-eff3dba3a6ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40621068ea6741239433f9d05d4b2318'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:19.933024 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ba9195fa-23f1-4496-a215-eff3dba3a6ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40621068ea6741239433f9d05d4b2318'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:19.944672 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ba9195fa-23f1-4496-a215-eff3dba3a6ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40621068ea6741239433f9d05d4b2318'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:19.952154 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ba9195fa-23f1-4496-a215-eff3dba3a6ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40621068ea6741239433f9d05d4b2318'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:19.960470 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-ba9195fa-23f1-4496-a215-eff3dba3a6ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40621068ea6741239433f9d05d4b2318'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:19.967135 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1403/2809] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:52:19 2021] DELETE /identity/v3/users/40621068ea6741239433f9d05d4b2318 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:52:19.971755 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c8b02-af46-4da6-851a-a80e4f9d4f32 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:19.972135 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c8b02-af46-4da6-851a-a80e4f9d4f32 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:19.972547 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c8b02-af46-4da6-851a-a80e4f9d4f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:19.996630 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-df8c8b02-af46-4da6-851a-a80e4f9d4f32 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:52:19.998051 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-df8c8b02-af46-4da6-851a-a80e4f9d4f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:20.071831 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1407/2810] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:52:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:52:20.082353 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9195fa-23f1-4496-a215-eff3dba3a6ae admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:20.083772 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-ba9195fa-23f1-4496-a215-eff3dba3a6ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:20.157817 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9195fa-23f1-4496-a215-eff3dba3a6ae admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:20.161382 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5dfa91-2c40-4675-9e03-5f20c7610640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:20.161971 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dfa91-2c40-4675-9e03-5f20c7610640 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:20.162263 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dfa91-2c40-4675-9e03-5f20c7610640 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:20.162551 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dfa91-2c40-4675-9e03-5f20c7610640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:20.173888 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5dfa91-2c40-4675-9e03-5f20c7610640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:20.175624 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5dfa91-2c40-4675-9e03-5f20c7610640 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:20.187630 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1404/2811] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:52:20 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:52:20.571679 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c8b02-af46-4da6-851a-a80e4f9d4f32 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:20.573393 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-df8c8b02-af46-4da6-851a-a80e4f9d4f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:20.587213 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c8b02-af46-4da6-851a-a80e4f9d4f32 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:20.592911 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d854e7-0d78-4129-ac36-f951d42ebb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:20.593923 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d854e7-0d78-4129-ac36-f951d42ebb58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:20.594261 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d854e7-0d78-4129-ac36-f951d42ebb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:20.594544 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d854e7-0d78-4129-ac36-f951d42ebb58 admin admin] PATH_INFO: `/v3/projects/1806672deaf943fcb6303821aedceac6` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:20.595668 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d854e7-0d78-4129-ac36-f951d42ebb58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1806672deaf943fcb6303821aedceac6)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:20.597888 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d854e7-0d78-4129-ac36-f951d42ebb58 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:20.664854 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-f0d854e7-0d78-4129-ac36-f951d42ebb58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1806672deaf943fcb6303821aedceac6', 'request_id': 'req-f0d854e7-0d78-4129-ac36-f951d42ebb58'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:20.671862 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-f0d854e7-0d78-4129-ac36-f951d42ebb58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1806672deaf943fcb6303821aedceac6', 'request_id': 'req-f0d854e7-0d78-4129-ac36-f951d42ebb58'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:20.681574 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-f0d854e7-0d78-4129-ac36-f951d42ebb58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1806672deaf943fcb6303821aedceac6', 'request_id': 'req-f0d854e7-0d78-4129-ac36-f951d42ebb58'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:20.698966 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-f0d854e7-0d78-4129-ac36-f951d42ebb58 admin admin] The token cache is being invalidate because project 1806672deaf943fcb6303821aedceac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:52:20.699237 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-f0d854e7-0d78-4129-ac36-f951d42ebb58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:20.699881 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-f0d854e7-0d78-4129-ac36-f951d42ebb58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:20.701915 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1408/2812] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:52:20 2021] DELETE /identity/v3/projects/1806672deaf943fcb6303821aedceac6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:52:20.707868 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514eede-5092-4b96-a70e-9d44d54e99be None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:20.708165 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514eede-5092-4b96-a70e-9d44d54e99be None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:20.708456 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514eede-5092-4b96-a70e-9d44d54e99be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:20.739126 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-e514eede-5092-4b96-a70e-9d44d54e99be None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:52:20.739126 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e514eede-5092-4b96-a70e-9d44d54e99be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:20.806882 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1405/2813] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:52:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:52:20.817215 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2e42a-ce3a-4bff-a719-8ac66a94f012 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:20.817568 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2e42a-ce3a-4bff-a719-8ac66a94f012 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:20.817830 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2e42a-ce3a-4bff-a719-8ac66a94f012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:20.855196 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-54a2e42a-ce3a-4bff-a719-8ac66a94f012 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:52:20.856430 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-54a2e42a-ce3a-4bff-a719-8ac66a94f012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:20.864048 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1409/2814] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:52:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:52:20.868368 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514eede-5092-4b96-a70e-9d44d54e99be None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:20.880538 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514eede-5092-4b96-a70e-9d44d54e99be None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:20.885966 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a497e-464e-473d-b688-1c61f5830813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:20.886563 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a497e-464e-473d-b688-1c61f5830813 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:20.886852 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a497e-464e-473d-b688-1c61f5830813 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:20.887126 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a497e-464e-473d-b688-1c61f5830813 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:20.888361 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a497e-464e-473d-b688-1c61f5830813 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:52:20.888898 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a497e-464e-473d-b688-1c61f5830813 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:20.890464 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a497e-464e-473d-b688-1c61f5830813 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:20.904426 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1406/2815] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:52:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:52:20.908597 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2e42a-ce3a-4bff-a719-8ac66a94f012 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:20.918614 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2e42a-ce3a-4bff-a719-8ac66a94f012 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:20.923097 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ae5e3-fa8f-420d-965a-c710d92dcc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:20.923718 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ae5e3-fa8f-420d-965a-c710d92dcc8d admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:20.924006 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ae5e3-fa8f-420d-965a-c710d92dcc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:20.924287 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ae5e3-fa8f-420d-965a-c710d92dcc8d admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:20.925066 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ae5e3-fa8f-420d-965a-c710d92dcc8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:20.927173 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ae5e3-fa8f-420d-965a-c710d92dcc8d admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:20.955472 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1410/2816] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:52:20 2021] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:52:20.959827 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a497e-464e-473d-b688-1c61f5830813 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:20.969742 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a497e-464e-473d-b688-1c61f5830813 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:21.036941 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a3b69-bda6-49fd-9ac4-702a8b56d46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:21.037577 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a3b69-bda6-49fd-9ac4-702a8b56d46a admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:21.037870 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a3b69-bda6-49fd-9ac4-702a8b56d46a admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:21.038173 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a3b69-bda6-49fd-9ac4-702a8b56d46a admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:21.038812 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a3b69-bda6-49fd-9ac4-702a8b56d46a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:21.040864 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a3b69-bda6-49fd-9ac4-702a8b56d46a admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:21.062557 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1407/2817] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:52:20 2021] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:52:21.066605 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ae5e3-fa8f-420d-965a-c710d92dcc8d admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:21.077495 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ae5e3-fa8f-420d-965a-c710d92dcc8d admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:21.081911 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87972cc6-d2fa-4a8f-9a05-52b2b60499da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:21.082505 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87972cc6-d2fa-4a8f-9a05-52b2b60499da admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:21.082795 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87972cc6-d2fa-4a8f-9a05-52b2b60499da admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:21.083077 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87972cc6-d2fa-4a8f-9a05-52b2b60499da admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:21.083766 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87972cc6-d2fa-4a8f-9a05-52b2b60499da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:21.085393 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87972cc6-d2fa-4a8f-9a05-52b2b60499da admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:21.095865 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1411/2818] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:52:21 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:52:21.100133 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a3b69-bda6-49fd-9ac4-702a8b56d46a admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:21.111025 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a3b69-bda6-49fd-9ac4-702a8b56d46a admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:21.115476 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b1ea0-1ce8-4bc6-becf-73067b74f5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:21.116092 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b1ea0-1ce8-4bc6-becf-73067b74f5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:21.116376 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b1ea0-1ce8-4bc6-becf-73067b74f5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:21.116658 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b1ea0-1ce8-4bc6-becf-73067b74f5b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:21.117385 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b1ea0-1ce8-4bc6-becf-73067b74f5b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:21.118979 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b1ea0-1ce8-4bc6-becf-73067b74f5b1 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:21.131460 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1408/2819] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:52:21 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:52:21.135820 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87972cc6-d2fa-4a8f-9a05-52b2b60499da admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:21.146016 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87972cc6-d2fa-4a8f-9a05-52b2b60499da admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:21.150416 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83580481-8070-4e32-ae49-a6742e61cd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:21.151232 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83580481-8070-4e32-ae49-a6742e61cd17 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:21.151524 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83580481-8070-4e32-ae49-a6742e61cd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:21.151809 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83580481-8070-4e32-ae49-a6742e61cd17 admin admin] PATH_INFO: `/v3/projects/d4337612b20545839feb5c9f70cd3b94/users/4dced08b370540988936bfc727e065ca/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:21.171296 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83580481-8070-4e32-ae49-a6742e61cd17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4337612b20545839feb5c9f70cd3b94, user_id=4dced08b370540988936bfc727e065ca, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:21.173971 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83580481-8070-4e32-ae49-a6742e61cd17 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:21.187776 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1412/2820] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:52:21 2021] PUT /identity/v3/projects/d4337612b20545839feb5c9f70cd3b94/users/4dced08b370540988936bfc727e065ca/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:52:21.197953 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac83d6-634c-4ebb-9c73-b4e6e4db0ef8 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:21.198368 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac83d6-634c-4ebb-9c73-b4e6e4db0ef8 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:21.198677 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac83d6-634c-4ebb-9c73-b4e6e4db0ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:21.234925 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-c2ac83d6-634c-4ebb-9c73-b4e6e4db0ef8 None None] MFA Rules not processed for user `4dced08b370540988936bfc727e065ca`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:52:21.236080 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-c2ac83d6-634c-4ebb-9c73-b4e6e4db0ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:21.315645 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1409/2821] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:52:21 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:52:21.326094 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83580481-8070-4e32-ae49-a6742e61cd17 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:21.327844 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-83580481-8070-4e32-ae49-a6742e61cd17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:21.395666 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83580481-8070-4e32-ae49-a6742e61cd17 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:21.399511 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ef4ec-a2d6-4800-add8-f00b87a6c521 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0050dc5fdd5641318319ff698112188c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:21.400134 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ef4ec-a2d6-4800-add8-f00b87a6c521 service cinder] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:21.400476 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ef4ec-a2d6-4800-add8-f00b87a6c521 service cinder] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:21.400728 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ef4ec-a2d6-4800-add8-f00b87a6c521 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:21.410435 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ef4ec-a2d6-4800-add8-f00b87a6c521 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:21.411856 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ef4ec-a2d6-4800-add8-f00b87a6c521 service cinder] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:21.421064 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1413/2822] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:52:21 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:52:41.514125 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac83d6-634c-4ebb-9c73-b4e6e4db0ef8 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:41.582539 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac83d6-634c-4ebb-9c73-b4e6e4db0ef8 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:41.586922 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300bd1c-1dc3-4501-9600-b8f8e8390a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:41.587718 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300bd1c-1dc3-4501-9600-b8f8e8390a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:41.588036 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300bd1c-1dc3-4501-9600-b8f8e8390a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:41.588318 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300bd1c-1dc3-4501-9600-b8f8e8390a21 admin admin] PATH_INFO: `/v3/users/4dced08b370540988936bfc727e065ca` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:41.589431 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300bd1c-1dc3-4501-9600-b8f8e8390a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dced08b370540988936bfc727e065ca)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:41.591303 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300bd1c-1dc3-4501-9600-b8f8e8390a21 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:41.639496 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-e300bd1c-1dc3-4501-9600-b8f8e8390a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dced08b370540988936bfc727e065ca'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:41.640133 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-e300bd1c-1dc3-4501-9600-b8f8e8390a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dced08b370540988936bfc727e065ca'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:41.651668 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-e300bd1c-1dc3-4501-9600-b8f8e8390a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dced08b370540988936bfc727e065ca'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:41.659567 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-e300bd1c-1dc3-4501-9600-b8f8e8390a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dced08b370540988936bfc727e065ca'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:41.667958 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-e300bd1c-1dc3-4501-9600-b8f8e8390a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dced08b370540988936bfc727e065ca'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:41.674399 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1410/2823] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:52:41 2021] DELETE /identity/v3/users/4dced08b370540988936bfc727e065ca => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:52:41.678914 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a37a3-3ba3-41cc-a54d-52fd0bc4f4ce None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:41.679468 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a37a3-3ba3-41cc-a54d-52fd0bc4f4ce None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:41.679468 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a37a3-3ba3-41cc-a54d-52fd0bc4f4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:41.700795 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-c78a37a3-3ba3-41cc-a54d-52fd0bc4f4ce None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:52:41.701964 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-c78a37a3-3ba3-41cc-a54d-52fd0bc4f4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:41.765726 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1414/2824] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:52:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:52:41.776067 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300bd1c-1dc3-4501-9600-b8f8e8390a21 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:41.777438 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-e300bd1c-1dc3-4501-9600-b8f8e8390a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:41.840176 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300bd1c-1dc3-4501-9600-b8f8e8390a21 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:41.844120 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113db92-427b-4bfa-9b22-89f765ba3520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:41.844691 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113db92-427b-4bfa-9b22-89f765ba3520 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:41.845018 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113db92-427b-4bfa-9b22-89f765ba3520 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:41.845288 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113db92-427b-4bfa-9b22-89f765ba3520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:41.854095 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113db92-427b-4bfa-9b22-89f765ba3520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:41.855476 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113db92-427b-4bfa-9b22-89f765ba3520 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:41.866107 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1411/2825] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:52:41 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:52:42.277594 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a37a3-3ba3-41cc-a54d-52fd0bc4f4ce None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:42.279077 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-c78a37a3-3ba3-41cc-a54d-52fd0bc4f4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:42.290977 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a37a3-3ba3-41cc-a54d-52fd0bc4f4ce None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:42.295304 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae82f3-7ce4-47d8-beae-54b311d52a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:42.296118 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae82f3-7ce4-47d8-beae-54b311d52a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:42.296405 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae82f3-7ce4-47d8-beae-54b311d52a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:42.296687 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae82f3-7ce4-47d8-beae-54b311d52a7d admin admin] PATH_INFO: `/v3/projects/d4337612b20545839feb5c9f70cd3b94` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:42.297807 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae82f3-7ce4-47d8-beae-54b311d52a7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4337612b20545839feb5c9f70cd3b94)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:42.299690 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae82f3-7ce4-47d8-beae-54b311d52a7d admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:42.352635 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ecae82f3-7ce4-47d8-beae-54b311d52a7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4337612b20545839feb5c9f70cd3b94', 'request_id': 'req-ecae82f3-7ce4-47d8-beae-54b311d52a7d'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:42.357691 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ecae82f3-7ce4-47d8-beae-54b311d52a7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4337612b20545839feb5c9f70cd3b94', 'request_id': 'req-ecae82f3-7ce4-47d8-beae-54b311d52a7d'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:42.365294 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ecae82f3-7ce4-47d8-beae-54b311d52a7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4337612b20545839feb5c9f70cd3b94', 'request_id': 'req-ecae82f3-7ce4-47d8-beae-54b311d52a7d'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:42.382124 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ecae82f3-7ce4-47d8-beae-54b311d52a7d admin admin] The token cache is being invalidate because project d4337612b20545839feb5c9f70cd3b94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:52:42.382412 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ecae82f3-7ce4-47d8-beae-54b311d52a7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:42.383057 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-ecae82f3-7ce4-47d8-beae-54b311d52a7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:42.384515 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1415/2826] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:52:42 2021] DELETE /identity/v3/projects/d4337612b20545839feb5c9f70cd3b94 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:52:42.390749 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb1209-2d7a-4127-870b-803f6125184b None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:42.391052 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb1209-2d7a-4127-870b-803f6125184b None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:42.391334 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb1209-2d7a-4127-870b-803f6125184b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:42.413633 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-85fb1209-2d7a-4127-870b-803f6125184b None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:52:42.414792 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-85fb1209-2d7a-4127-870b-803f6125184b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:42.481626 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1412/2827] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:52:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:52:42.490049 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d59217-e05f-4cec-a410-caddfc65e2da None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:42.490572 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d59217-e05f-4cec-a410-caddfc65e2da None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:42.490735 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d59217-e05f-4cec-a410-caddfc65e2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:42.517521 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-a3d59217-e05f-4cec-a410-caddfc65e2da None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:52:42.518707 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-a3d59217-e05f-4cec-a410-caddfc65e2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:42.527094 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1416/2828] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:52:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:52:42.531432 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb1209-2d7a-4127-870b-803f6125184b None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:42.540897 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb1209-2d7a-4127-870b-803f6125184b None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:42.547558 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c72981-390c-4c86-83d4-5df2f2504f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:42.548510 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c72981-390c-4c86-83d4-5df2f2504f98 admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:42.548660 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c72981-390c-4c86-83d4-5df2f2504f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:42.549027 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c72981-390c-4c86-83d4-5df2f2504f98 admin admin] PATH_INFO: `/v3/domains` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:42.549614 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c72981-390c-4c86-83d4-5df2f2504f98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 16 14:52:42.549905 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c72981-390c-4c86-83d4-5df2f2504f98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:42.551545 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c72981-390c-4c86-83d4-5df2f2504f98 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:42.568950 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1413/2829] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Dec 16 14:52:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:52:42.573397 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d59217-e05f-4cec-a410-caddfc65e2da None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:42.582797 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d59217-e05f-4cec-a410-caddfc65e2da None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:42.587220 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f8d0d-53b0-405f-a9e2-3f77755b6be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:42.587800 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f8d0d-53b0-405f-a9e2-3f77755b6be0 admin admin] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:42.588086 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f8d0d-53b0-405f-a9e2-3f77755b6be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:42.588366 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f8d0d-53b0-405f-a9e2-3f77755b6be0 admin admin] PATH_INFO: `/v3/projects` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:42.589019 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f8d0d-53b0-405f-a9e2-3f77755b6be0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:42.590903 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f8d0d-53b0-405f-a9e2-3f77755b6be0 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:42.616847 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1417/2830] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Dec 16 14:52:42 2021] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:52:42.621449 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c72981-390c-4c86-83d4-5df2f2504f98 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:42.632591 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c72981-390c-4c86-83d4-5df2f2504f98 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:42.698078 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb078790-78f5-4b80-8ea6-ac467335cead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:42.698683 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb078790-78f5-4b80-8ea6-ac467335cead admin admin] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:42.698976 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb078790-78f5-4b80-8ea6-ac467335cead admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:42.699256 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb078790-78f5-4b80-8ea6-ac467335cead admin admin] PATH_INFO: `/v3/users` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:42.699903 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb078790-78f5-4b80-8ea6-ac467335cead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:42.702057 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb078790-78f5-4b80-8ea6-ac467335cead admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:42.723090 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1414/2831] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Dec 16 14:52:42 2021] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:52:42.727206 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f8d0d-53b0-405f-a9e2-3f77755b6be0 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:42.738843 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f8d0d-53b0-405f-a9e2-3f77755b6be0 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:42.743364 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de3b1d-1cd4-49c6-8ae1-270b4af334df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:42.743966 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de3b1d-1cd4-49c6-8ae1-270b4af334df admin admin] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:42.744255 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de3b1d-1cd4-49c6-8ae1-270b4af334df admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:42.744543 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de3b1d-1cd4-49c6-8ae1-270b4af334df admin admin] PATH_INFO: `/v3/roles` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:42.745278 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de3b1d-1cd4-49c6-8ae1-270b4af334df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:42.746856 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de3b1d-1cd4-49c6-8ae1-270b4af334df admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:42.757809 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1418/2832] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:52:42 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:52:42.761837 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb078790-78f5-4b80-8ea6-ac467335cead admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:42.771358 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb078790-78f5-4b80-8ea6-ac467335cead admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:42.775922 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17860a-ff01-4cbf-89c6-b64715303c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:42.776544 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17860a-ff01-4cbf-89c6-b64715303c3b admin admin] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:42.776913 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17860a-ff01-4cbf-89c6-b64715303c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:42.777200 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17860a-ff01-4cbf-89c6-b64715303c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:42.777892 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17860a-ff01-4cbf-89c6-b64715303c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:42.779489 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17860a-ff01-4cbf-89c6-b64715303c3b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:42.790066 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1415/2833] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Dec 16 14:52:42 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:52:42.794180 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de3b1d-1cd4-49c6-8ae1-270b4af334df admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:42.804647 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de3b1d-1cd4-49c6-8ae1-270b4af334df admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:42.809450 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c4149-95e4-4dfa-86f5-070892da4713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:42.810337 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c4149-95e4-4dfa-86f5-070892da4713 admin admin] REQUEST_METHOD: `PUT` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:42.810572 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c4149-95e4-4dfa-86f5-070892da4713 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:42.810850 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c4149-95e4-4dfa-86f5-070892da4713 admin admin] PATH_INFO: `/v3/projects/b50ac71c2dde424caae58dfc1365bfbd/users/a2886fe32bb84b39848189d047619e89/roles/0f176f9289ff497b8ed18a84bcfd34da` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:42.834692 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c4149-95e4-4dfa-86f5-070892da4713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b50ac71c2dde424caae58dfc1365bfbd, user_id=a2886fe32bb84b39848189d047619e89, role_id=0f176f9289ff497b8ed18a84bcfd34da)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:42.837381 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c4149-95e4-4dfa-86f5-070892da4713 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:42.852898 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1419/2834] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Dec 16 14:52:42 2021] PUT /identity/v3/projects/b50ac71c2dde424caae58dfc1365bfbd/users/a2886fe32bb84b39848189d047619e89/roles/0f176f9289ff497b8ed18a84bcfd34da => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:52:42.863433 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166f495-1e77-4e39-84bd-a9d07754b559 None None] REQUEST_METHOD: `POST` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:42.863760 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166f495-1e77-4e39-84bd-a9d07754b559 None None] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:42.863995 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166f495-1e77-4e39-84bd-a9d07754b559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:42.900721 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.auth.core [None req-f166f495-1e77-4e39-84bd-a9d07754b559 None None] MFA Rules not processed for user `a2886fe32bb84b39848189d047619e89`. Rule list: `[]` (Enabled: `True`). {{(pid=67595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:52:42.901899 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-f166f495-1e77-4e39-84bd-a9d07754b559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:42.973574 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1416/2835] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:52:42 2021] POST /identity/v3/auth/tokens => generated 3676 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:52:42.985358 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c4149-95e4-4dfa-86f5-070892da4713 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:42.986989 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-d87c4149-95e4-4dfa-86f5-070892da4713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:43.051012 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c4149-95e4-4dfa-86f5-070892da4713 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:43.054389 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b938ad3-49c4-4fe4-88d0-5c3995decf1a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ccebf28ac494f608c33437fc34139be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:43.054977 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b938ad3-49c4-4fe4-88d0-5c3995decf1a service glance] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:43.055259 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b938ad3-49c4-4fe4-88d0-5c3995decf1a service glance] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:43.055537 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b938ad3-49c4-4fe4-88d0-5c3995decf1a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:43.064853 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b938ad3-49c4-4fe4-88d0-5c3995decf1a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:43.066362 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b938ad3-49c4-4fe4-88d0-5c3995decf1a service glance] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:52:43.074966 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1420/2836] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:52:42 2021] GET /identity/v3/auth/tokens => generated 3676 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:53:17.478155 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166f495-1e77-4e39-84bd-a9d07754b559 None None] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:53:17.547885 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166f495-1e77-4e39-84bd-a9d07754b559 None None] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:53:17.553543 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d40cd-9ccf-48c6-af95-c57edb216713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:53:17.554578 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d40cd-9ccf-48c6-af95-c57edb216713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:53:17.554889 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d40cd-9ccf-48c6-af95-c57edb216713 admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:53:17.555418 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d40cd-9ccf-48c6-af95-c57edb216713 admin admin] PATH_INFO: `/v3/users/a2886fe32bb84b39848189d047619e89` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:53:17.557177 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d40cd-9ccf-48c6-af95-c57edb216713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2886fe32bb84b39848189d047619e89)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:53:17.559478 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d40cd-9ccf-48c6-af95-c57edb216713 admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:53:17.610159 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-506d40cd-9ccf-48c6-af95-c57edb216713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2886fe32bb84b39848189d047619e89'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:53:17.610826 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-506d40cd-9ccf-48c6-af95-c57edb216713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2886fe32bb84b39848189d047619e89'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:53:17.622749 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-506d40cd-9ccf-48c6-af95-c57edb216713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2886fe32bb84b39848189d047619e89'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:53:17.629654 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-506d40cd-9ccf-48c6-af95-c57edb216713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2886fe32bb84b39848189d047619e89'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:53:17.637882 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-506d40cd-9ccf-48c6-af95-c57edb216713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2886fe32bb84b39848189d047619e89'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:53:17.643653 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1417/2837] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:53:17 2021] DELETE /identity/v3/users/a2886fe32bb84b39848189d047619e89 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:53:17.649064 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa3167-0453-4198-9400-c0ea2029cdd4 None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:53:17.649606 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa3167-0453-4198-9400-c0ea2029cdd4 None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:53:17.649606 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa3167-0453-4198-9400-c0ea2029cdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:53:17.671427 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-2ffa3167-0453-4198-9400-c0ea2029cdd4 None None] MFA Rules not processed for user `8c2ac62eab7c4164bfd09ecc79a439aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:53:17.672578 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-2ffa3167-0453-4198-9400-c0ea2029cdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:53:17.738890 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1421/2838] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:53:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:53:17.749109 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d40cd-9ccf-48c6-af95-c57edb216713 admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:53:17.750454 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-506d40cd-9ccf-48c6-af95-c57edb216713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:53:17.815977 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d40cd-9ccf-48c6-af95-c57edb216713 admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:53:17.820580 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06996045-5294-4448-8119-a159d4d1a967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:53:17.821199 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06996045-5294-4448-8119-a159d4d1a967 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:53:17.821527 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06996045-5294-4448-8119-a159d4d1a967 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:53:17.821849 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06996045-5294-4448-8119-a159d4d1a967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:53:17.831746 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06996045-5294-4448-8119-a159d4d1a967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:53:17.833224 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06996045-5294-4448-8119-a159d4d1a967 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:53:17.843178 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1418/2839] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:53:17 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:53:18.200075 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa3167-0453-4198-9400-c0ea2029cdd4 None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:53:18.201475 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-2ffa3167-0453-4198-9400-c0ea2029cdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:53:18.212715 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa3167-0453-4198-9400-c0ea2029cdd4 None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:53:18.217150 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a62b5-c1a7-4a14-ac4c-2df72d0a1d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:53:18.217941 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a62b5-c1a7-4a14-ac4c-2df72d0a1d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:53:18.218230 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a62b5-c1a7-4a14-ac4c-2df72d0a1d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:53:18.218512 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a62b5-c1a7-4a14-ac4c-2df72d0a1d9c admin admin] PATH_INFO: `/v3/projects/b50ac71c2dde424caae58dfc1365bfbd` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:53:18.219619 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a62b5-c1a7-4a14-ac4c-2df72d0a1d9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b50ac71c2dde424caae58dfc1365bfbd)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:53:18.221557 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a62b5-c1a7-4a14-ac4c-2df72d0a1d9c admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:53:18.271901 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-4b6a62b5-c1a7-4a14-ac4c-2df72d0a1d9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b50ac71c2dde424caae58dfc1365bfbd', 'request_id': 'req-4b6a62b5-c1a7-4a14-ac4c-2df72d0a1d9c'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:53:18.276973 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-4b6a62b5-c1a7-4a14-ac4c-2df72d0a1d9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b50ac71c2dde424caae58dfc1365bfbd', 'request_id': 'req-4b6a62b5-c1a7-4a14-ac4c-2df72d0a1d9c'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:53:18.284493 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-4b6a62b5-c1a7-4a14-ac4c-2df72d0a1d9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b50ac71c2dde424caae58dfc1365bfbd', 'request_id': 'req-4b6a62b5-c1a7-4a14-ac4c-2df72d0a1d9c'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:53:18.302953 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-4b6a62b5-c1a7-4a14-ac4c-2df72d0a1d9c admin admin] The token cache is being invalidate because project b50ac71c2dde424caae58dfc1365bfbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:53:18.303241 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-4b6a62b5-c1a7-4a14-ac4c-2df72d0a1d9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:53:18.303896 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-4b6a62b5-c1a7-4a14-ac4c-2df72d0a1d9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:53:18.305394 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1422/2840] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:53:18 2021] DELETE /identity/v3/projects/b50ac71c2dde424caae58dfc1365bfbd => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:53:28.224519 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06996045-5294-4448-8119-a159d4d1a967 service neutron] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:53:28.226011 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-06996045-5294-4448-8119-a159d4d1a967 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:53:28.331200 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06996045-5294-4448-8119-a159d4d1a967 service neutron] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:53:28.396097 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4241c-918b-4f57-9395-805dafb32d2b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9a2114d29c4edeb20f394140d390bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:53:28.396717 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4241c-918b-4f57-9395-805dafb32d2b service placement] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:53:28.397045 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4241c-918b-4f57-9395-805dafb32d2b service placement] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:53:28.397333 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4241c-918b-4f57-9395-805dafb32d2b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:53:28.399011 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-9be4241c-918b-4f57-9395-805dafb32d2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:53:28.409721 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4241c-918b-4f57-9395-805dafb32d2b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:53:28.411437 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4241c-918b-4f57-9395-805dafb32d2b service placement] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:53:28.421037 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1419/2841] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:53:28 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:54:26.682617 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7301960-5ad4-41e1-b229-504e57ce7b2a None None] REQUEST_METHOD: `POST` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:54:26.683492 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7301960-5ad4-41e1-b229-504e57ce7b2a None None] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:54:26.683723 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7301960-5ad4-41e1-b229-504e57ce7b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:54:26.705835 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.auth.core [None req-d7301960-5ad4-41e1-b229-504e57ce7b2a None None] MFA Rules not processed for user `ee703ae6a79f48cdb9438f504085e206`. Rule list: `[]` (Enabled: `True`). {{(pid=67594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:54:26.707012 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-d7301960-5ad4-41e1-b229-504e57ce7b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:54:26.769998 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1423/2842] 10.222.0.64 () {58 vars in 957 bytes} [Thu Dec 16 14:54:26 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:54:27.249400 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4241c-918b-4f57-9395-805dafb32d2b service placement] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:54:27.250837 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-9be4241c-918b-4f57-9395-805dafb32d2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:54:27.326566 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4241c-918b-4f57-9395-805dafb32d2b service placement] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:54:27.330220 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc9f92-ac88-46ff-a255-c5e110649282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:54:27.330814 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc9f92-ac88-46ff-a255-c5e110649282 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:54:27.331102 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc9f92-ac88-46ff-a255-c5e110649282 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:54:27.331382 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc9f92-ac88-46ff-a255-c5e110649282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:54:27.333524 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-49dc9f92-ac88-46ff-a255-c5e110649282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:54:27.344816 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc9f92-ac88-46ff-a255-c5e110649282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:54:27.346239 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc9f92-ac88-46ff-a255-c5e110649282 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:54:27.355447 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1420/2843] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:54:27 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:54:37.274521 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7301960-5ad4-41e1-b229-504e57ce7b2a None None] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:54:37.276540 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-d7301960-5ad4-41e1-b229-504e57ce7b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:54:37.392321 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7301960-5ad4-41e1-b229-504e57ce7b2a None None] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:54:37.398263 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3803a4b-dc61-4728-8ce2-8418e8e17eb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:54:37.398858 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3803a4b-dc61-4728-8ce2-8418e8e17eb4 service nova] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:54:37.399146 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3803a4b-dc61-4728-8ce2-8418e8e17eb4 service nova] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:54:37.399429 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3803a4b-dc61-4728-8ce2-8418e8e17eb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:54:37.401661 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-f3803a4b-dc61-4728-8ce2-8418e8e17eb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:54:37.412108 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3803a4b-dc61-4728-8ce2-8418e8e17eb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:54:37.413723 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3803a4b-dc61-4728-8ce2-8418e8e17eb4 service nova] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:54:37.423387 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1424/2844] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:54:37 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:55:28.849482 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc9f92-ac88-46ff-a255-c5e110649282 service neutron] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:55:28.858586 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc9f92-ac88-46ff-a255-c5e110649282 service neutron] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:55:28.862069 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915edd5-1bdf-4b57-b704-973858ae0bf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:55:28.862641 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915edd5-1bdf-4b57-b704-973858ae0bf7 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:55:28.862931 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915edd5-1bdf-4b57-b704-973858ae0bf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:55:28.863218 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915edd5-1bdf-4b57-b704-973858ae0bf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:55:28.864906 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-d915edd5-1bdf-4b57-b704-973858ae0bf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:55:28.874942 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915edd5-1bdf-4b57-b704-973858ae0bf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:55:28.876345 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915edd5-1bdf-4b57-b704-973858ae0bf7 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:55:28.884271 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1421/2845] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:55:28 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:56:20.243484 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3803a4b-dc61-4728-8ce2-8418e8e17eb4 service nova] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:56:20.246875 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-f3803a4b-dc61-4728-8ce2-8418e8e17eb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:56:20.276400 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3803a4b-dc61-4728-8ce2-8418e8e17eb4 service nova] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:56:20.290323 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a69cc9-1921-48a5-9075-b11388c8af49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e416527de444ef1b744da062ee1e7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:56:20.291494 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a69cc9-1921-48a5-9075-b11388c8af49 service nova] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:56:20.292190 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a69cc9-1921-48a5-9075-b11388c8af49 service nova] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:56:20.292998 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a69cc9-1921-48a5-9075-b11388c8af49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:56:20.295923 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-29a69cc9-1921-48a5-9075-b11388c8af49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:56:20.313196 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a69cc9-1921-48a5-9075-b11388c8af49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:56:20.315455 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a69cc9-1921-48a5-9075-b11388c8af49 service nova] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:56:20.327190 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1425/2846] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:56:20 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:56:20.622712 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915edd5-1bdf-4b57-b704-973858ae0bf7 service neutron] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:56:20.634439 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915edd5-1bdf-4b57-b704-973858ae0bf7 service neutron] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:56:20.638389 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05e67a-aa6e-40eb-9d6d-03aafb0297e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:56:20.639172 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05e67a-aa6e-40eb-9d6d-03aafb0297e2 service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:56:20.639705 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05e67a-aa6e-40eb-9d6d-03aafb0297e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:56:20.640277 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05e67a-aa6e-40eb-9d6d-03aafb0297e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:56:20.643141 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-df05e67a-aa6e-40eb-9d6d-03aafb0297e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:56:20.661862 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05e67a-aa6e-40eb-9d6d-03aafb0297e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:56:20.661862 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05e67a-aa6e-40eb-9d6d-03aafb0297e2 service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:56:20.675796 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1422/2847] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:56:20 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:56:22.140150 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a69cc9-1921-48a5-9075-b11388c8af49 service nova] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:56:22.149729 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a69cc9-1921-48a5-9075-b11388c8af49 service nova] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:56:22.153196 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7c124-9d9d-4fdc-9455-6d6f56681eb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:56:22.153771 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7c124-9d9d-4fdc-9455-6d6f56681eb6 service neutron] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:56:22.154084 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7c124-9d9d-4fdc-9455-6d6f56681eb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:56:22.154345 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7c124-9d9d-4fdc-9455-6d6f56681eb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:56:22.156037 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-dfd7c124-9d9d-4fdc-9455-6d6f56681eb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:56:22.170592 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7c124-9d9d-4fdc-9455-6d6f56681eb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:56:22.172039 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7c124-9d9d-4fdc-9455-6d6f56681eb6 service neutron] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:56:22.184504 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1426/2848] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:56:22 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:56:37.324248 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05e67a-aa6e-40eb-9d6d-03aafb0297e2 service neutron] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:56:37.333782 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05e67a-aa6e-40eb-9d6d-03aafb0297e2 service neutron] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:56:37.337266 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305f941-4f02-47af-b9c7-d76942e47fce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e25627f3384826b35caf92a804c6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:56:37.337841 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305f941-4f02-47af-b9c7-d76942e47fce service neutron] REQUEST_METHOD: `GET` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:56:37.338130 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305f941-4f02-47af-b9c7-d76942e47fce service neutron] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:56:37.338462 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305f941-4f02-47af-b9c7-d76942e47fce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:56:37.347266 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-f305f941-4f02-47af-b9c7-d76942e47fce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:56:37.418635 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305f941-4f02-47af-b9c7-d76942e47fce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:56:37.420069 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305f941-4f02-47af-b9c7-d76942e47fce service neutron] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:56:37.431948 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1423/2849] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:56:37 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:56:47.731554 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7c124-9d9d-4fdc-9455-6d6f56681eb6 service neutron] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:56:47.732982 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-dfd7c124-9d9d-4fdc-9455-6d6f56681eb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:56:47.745415 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7c124-9d9d-4fdc-9455-6d6f56681eb6 service neutron] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:56:47.749967 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbf34a-2ebc-48dc-b55a-eeccda0b2275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:56:47.751309 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbf34a-2ebc-48dc-b55a-eeccda0b2275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:56:47.751595 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbf34a-2ebc-48dc-b55a-eeccda0b2275 admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:56:47.751874 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbf34a-2ebc-48dc-b55a-eeccda0b2275 admin admin] PATH_INFO: `/v3/users/ee703ae6a79f48cdb9438f504085e206` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:56:47.753037 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbf34a-2ebc-48dc-b55a-eeccda0b2275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee703ae6a79f48cdb9438f504085e206)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:56:47.754974 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbf34a-2ebc-48dc-b55a-eeccda0b2275 admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:56:47.802497 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-33dbf34a-2ebc-48dc-b55a-eeccda0b2275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee703ae6a79f48cdb9438f504085e206'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:56:47.803069 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-33dbf34a-2ebc-48dc-b55a-eeccda0b2275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee703ae6a79f48cdb9438f504085e206'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:56:47.817691 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-33dbf34a-2ebc-48dc-b55a-eeccda0b2275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee703ae6a79f48cdb9438f504085e206'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:56:47.825874 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-33dbf34a-2ebc-48dc-b55a-eeccda0b2275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee703ae6a79f48cdb9438f504085e206'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:56:47.833673 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-33dbf34a-2ebc-48dc-b55a-eeccda0b2275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee703ae6a79f48cdb9438f504085e206'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:56:47.839695 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1427/2850] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:56:47 2021] DELETE /identity/v3/users/ee703ae6a79f48cdb9438f504085e206 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:56:48.077012 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305f941-4f02-47af-b9c7-d76942e47fce service neutron] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:56:48.087781 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305f941-4f02-47af-b9c7-d76942e47fce service neutron] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:56:48.155908 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d830f29-3291-4447-8160-95ddff031e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:56:48.156953 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d830f29-3291-4447-8160-95ddff031e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:56:48.157290 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d830f29-3291-4447-8160-95ddff031e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:56:48.157748 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d830f29-3291-4447-8160-95ddff031e1f admin admin] PATH_INFO: `/v3/projects/d963a0aa72964047885ee0212d5055dc` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:56:48.158885 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d830f29-3291-4447-8160-95ddff031e1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d963a0aa72964047885ee0212d5055dc)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:56:48.161180 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d830f29-3291-4447-8160-95ddff031e1f admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:56:48.210852 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-0d830f29-3291-4447-8160-95ddff031e1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd963a0aa72964047885ee0212d5055dc', 'request_id': 'req-0d830f29-3291-4447-8160-95ddff031e1f'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:56:48.228655 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-0d830f29-3291-4447-8160-95ddff031e1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd963a0aa72964047885ee0212d5055dc', 'request_id': 'req-0d830f29-3291-4447-8160-95ddff031e1f'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:56:48.234334 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-0d830f29-3291-4447-8160-95ddff031e1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd963a0aa72964047885ee0212d5055dc', 'request_id': 'req-0d830f29-3291-4447-8160-95ddff031e1f'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:56:48.247070 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-0d830f29-3291-4447-8160-95ddff031e1f admin admin] The token cache is being invalidate because project d963a0aa72964047885ee0212d5055dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:56:48.247376 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-0d830f29-3291-4447-8160-95ddff031e1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:56:48.248032 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-0d830f29-3291-4447-8160-95ddff031e1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:56:48.249524 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1424/2851] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:56:48 2021] DELETE /identity/v3/projects/d963a0aa72964047885ee0212d5055dc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:56:48.254172 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbf34a-2ebc-48dc-b55a-eeccda0b2275 admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:56:48.255592 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-33dbf34a-2ebc-48dc-b55a-eeccda0b2275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:56:48.269058 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbf34a-2ebc-48dc-b55a-eeccda0b2275 admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:56:48.343214 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d96b0-4270-4795-8cdf-999a424f648f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:56:48.343937 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d96b0-4270-4795-8cdf-999a424f648f admin admin] REQUEST_METHOD: `DELETE` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:56:48.344769 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d96b0-4270-4795-8cdf-999a424f648f admin admin] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:56:48.345086 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d96b0-4270-4795-8cdf-999a424f648f admin admin] PATH_INFO: `/v3/users/2d1a0fe9eeac491196c8263705935773` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:56:48.346223 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d96b0-4270-4795-8cdf-999a424f648f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d1a0fe9eeac491196c8263705935773)` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:56:48.348170 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d96b0-4270-4795-8cdf-999a424f648f admin admin] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:56:48.398949 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-9a5d96b0-4270-4795-8cdf-999a424f648f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d1a0fe9eeac491196c8263705935773'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:56:48.399547 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-9a5d96b0-4270-4795-8cdf-999a424f648f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d1a0fe9eeac491196c8263705935773'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:56:48.411705 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-9a5d96b0-4270-4795-8cdf-999a424f648f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d1a0fe9eeac491196c8263705935773'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:56:48.419150 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-9a5d96b0-4270-4795-8cdf-999a424f648f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d1a0fe9eeac491196c8263705935773'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:56:48.426708 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.notifications [None req-9a5d96b0-4270-4795-8cdf-999a424f648f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d1a0fe9eeac491196c8263705935773'} {{(pid=67594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:56:48.432533 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1428/2852] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Dec 16 14:56:48 2021] DELETE /identity/v3/users/2d1a0fe9eeac491196c8263705935773 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:56:48.653714 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d830f29-3291-4447-8160-95ddff031e1f admin admin] Authenticating user token {{(pid=67595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:56:48.655177 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.fernet_utils [None req-0d830f29-3291-4447-8160-95ddff031e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:56:48.668676 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d830f29-3291-4447-8160-95ddff031e1f admin admin] Validating token access rules against request {{(pid=67595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:56:48.731615 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4c7c9-50c0-483e-863d-e5c7cb455a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2ac62eab7c4164bfd09ecc79a439aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4379b60ef2094a39988c4f13a32f6cb0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:56:48.736175 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4c7c9-50c0-483e-863d-e5c7cb455a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:56:48.736175 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4c7c9-50c0-483e-863d-e5c7cb455a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:56:48.736175 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4c7c9-50c0-483e-863d-e5c7cb455a4b admin admin] PATH_INFO: `/v3/projects/e8b7a54394d34c20af37142d9c96b4b1` {{(pid=67595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:56:48.736175 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4c7c9-50c0-483e-863d-e5c7cb455a4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8b7a54394d34c20af37142d9c96b4b1)` {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:56:48.736552 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4c7c9-50c0-483e-863d-e5c7cb455a4b admin admin] RBAC: Authorization granted {{(pid=67595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:56:48.786311 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-6fe4c7c9-50c0-483e-863d-e5c7cb455a4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8b7a54394d34c20af37142d9c96b4b1', 'request_id': 'req-6fe4c7c9-50c0-483e-863d-e5c7cb455a4b'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:56:48.804478 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-6fe4c7c9-50c0-483e-863d-e5c7cb455a4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8b7a54394d34c20af37142d9c96b4b1', 'request_id': 'req-6fe4c7c9-50c0-483e-863d-e5c7cb455a4b'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:56:48.810157 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-6fe4c7c9-50c0-483e-863d-e5c7cb455a4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8b7a54394d34c20af37142d9c96b4b1', 'request_id': 'req-6fe4c7c9-50c0-483e-863d-e5c7cb455a4b'} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:56:48.823581 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-6fe4c7c9-50c0-483e-863d-e5c7cb455a4b admin admin] The token cache is being invalidate because project e8b7a54394d34c20af37142d9c96b4b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:56:48.823871 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-6fe4c7c9-50c0-483e-863d-e5c7cb455a4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:56:48.824573 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: DEBUG keystone.notifications [None req-6fe4c7c9-50c0-483e-863d-e5c7cb455a4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:56:48.826059 dv-cinder-821892-3-iscsi devstack@keystone.service[67595]: [pid: 67595|app: 0|req: 1425/2853] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Dec 16 14:56:48 2021] DELETE /identity/v3/projects/e8b7a54394d34c20af37142d9c96b4b1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:58:34.136172 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d96b0-4270-4795-8cdf-999a424f648f admin admin] Authenticating user token {{(pid=67594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:58:34.137524 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-9a5d96b0-4270-4795-8cdf-999a424f648f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:58:34.211089 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d96b0-4270-4795-8cdf-999a424f648f admin admin] Validating token access rules against request {{(pid=67594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:58:34.275122 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b364c64-f99f-4fd8-840a-52a715a6c130 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e9a2114d29c4edeb20f394140d390bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '244c8ef98d0445c6a0279c46d5cb7e55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:58:34.275608 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b364c64-f99f-4fd8-840a-52a715a6c130 service placement] REQUEST_METHOD: `GET` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:58:34.275899 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b364c64-f99f-4fd8-840a-52a715a6c130 service placement] SCRIPT_NAME: `/identity` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:58:34.276186 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b364c64-f99f-4fd8-840a-52a715a6c130 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=67594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:58:34.277913 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.fernet_utils [None req-7b364c64-f99f-4fd8-840a-52a715a6c130 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:58:34.289325 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b364c64-f99f-4fd8-840a-52a715a6c130 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:58:34.290890 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b364c64-f99f-4fd8-840a-52a715a6c130 service placement] RBAC: Authorization granted {{(pid=67594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 16 14:58:34.300435 dv-cinder-821892-3-iscsi devstack@keystone.service[67594]: [pid: 67594|app: 0|req: 1429/2854] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Dec 16 14:58:34 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)